-- Logs begin at Fri 2022-09-16 02:54:16 UTC, end at Fri 2022-09-16 04:09:14 UTC. -- Sep 16 03:26:00.440330 dv-cinder-857993-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 16 03:26:00.447923 dv-cinder-857993-1-smb devstack@keystone.service[81765]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 16 03:26:00.451861 dv-cinder-857993-1-smb devstack@keystone.service[81765]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 16 03:26:00 2022] *** Sep 16 03:26:00.451861 dv-cinder-857993-1-smb devstack@keystone.service[81765]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 16 03:26:00.451861 dv-cinder-857993-1-smb devstack@keystone.service[81765]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 16 03:26:00.451861 dv-cinder-857993-1-smb devstack@keystone.service[81765]: nodename: dv-cinder-857993-1-smb Sep 16 03:26:00.451861 dv-cinder-857993-1-smb devstack@keystone.service[81765]: machine: x86_64 Sep 16 03:26:00.451861 dv-cinder-857993-1-smb devstack@keystone.service[81765]: clock source: unix Sep 16 03:26:00.451861 dv-cinder-857993-1-smb devstack@keystone.service[81765]: pcre jit disabled Sep 16 03:26:00.451861 dv-cinder-857993-1-smb devstack@keystone.service[81765]: detected number of CPU cores: 4 Sep 16 03:26:00.451861 dv-cinder-857993-1-smb devstack@keystone.service[81765]: current working directory: / Sep 16 03:26:00.451861 dv-cinder-857993-1-smb devstack@keystone.service[81765]: detected binary path: /usr/bin/uwsgi-core Sep 16 03:26:00.451861 dv-cinder-857993-1-smb devstack@keystone.service[81765]: your processes number limit is 47680 Sep 16 03:26:00.451861 dv-cinder-857993-1-smb devstack@keystone.service[81765]: your memory page size is 4096 bytes Sep 16 03:26:00.451861 dv-cinder-857993-1-smb devstack@keystone.service[81765]: detected max file descriptor number: 2048 Sep 16 03:26:00.451861 dv-cinder-857993-1-smb devstack@keystone.service[81765]: lock engine: pthread robust mutexes Sep 16 03:26:00.451861 dv-cinder-857993-1-smb devstack@keystone.service[81765]: thunder lock: enabled Sep 16 03:26:00.451861 dv-cinder-857993-1-smb devstack@keystone.service[81765]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 16 03:26:00.451861 dv-cinder-857993-1-smb devstack@keystone.service[81765]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 16 03:26:00.491339 dv-cinder-857993-1-smb devstack@keystone.service[81765]: Python main interpreter initialized at 0x56315ea709c0 Sep 16 03:26:00.491339 dv-cinder-857993-1-smb devstack@keystone.service[81765]: python threads support enabled Sep 16 03:26:00.491339 dv-cinder-857993-1-smb devstack@keystone.service[81765]: your server socket listen backlog is limited to 100 connections Sep 16 03:26:00.491339 dv-cinder-857993-1-smb devstack@keystone.service[81765]: your mercy for graceful operations on workers is 90 seconds Sep 16 03:26:00.491664 dv-cinder-857993-1-smb devstack@keystone.service[81765]: mapped 403077 bytes (393 KB) for 2 cores Sep 16 03:26:00.491747 dv-cinder-857993-1-smb devstack@keystone.service[81765]: *** Operational MODE: preforking *** Sep 16 03:26:00.492021 dv-cinder-857993-1-smb devstack@keystone.service[81765]: *** uWSGI is running in multiple interpreter mode *** Sep 16 03:26:00.492021 dv-cinder-857993-1-smb devstack@keystone.service[81765]: spawned uWSGI master process (pid: 81765) Sep 16 03:26:00.492223 dv-cinder-857993-1-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 16 03:26:00.493184 dv-cinder-857993-1-smb devstack@keystone.service[81765]: spawned uWSGI worker 1 (pid: 81775, cores: 1) Sep 16 03:26:00.493184 dv-cinder-857993-1-smb devstack@keystone.service[81765]: spawned uWSGI worker 2 (pid: 81776, cores: 1) Sep 16 03:26:00.493319 dv-cinder-857993-1-smb devstack@keystone.service[81765]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 16 03:26:04.825822 dv-cinder-857993-1-smb devstack@keystone.service[81776]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 03:26:04.825822 dv-cinder-857993-1-smb devstack@keystone.service[81776]: from cryptography.utils import int_from_bytes Sep 16 03:26:04.826639 dv-cinder-857993-1-smb devstack@keystone.service[81776]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 03:26:04.826639 dv-cinder-857993-1-smb devstack@keystone.service[81776]: from cryptography.utils import int_from_bytes Sep 16 03:26:04.829136 dv-cinder-857993-1-smb devstack@keystone.service[81775]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 03:26:04.829136 dv-cinder-857993-1-smb devstack@keystone.service[81775]: from cryptography.utils import int_from_bytes Sep 16 03:26:04.829595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 03:26:04.829595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: from cryptography.utils import int_from_bytes Sep 16 03:26:04.884714 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 16 03:26:04.884895 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 16 03:26:04.884987 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 16 03:26:04.885076 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 16 03:26:04.885171 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] command line args: [] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 16 03:26:04.885251 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] command line args: [] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 16 03:26:04.885360 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 16 03:26:04.885494 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 16 03:26:04.885582 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ================================================================================ {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 16 03:26:04.885707 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ================================================================================ {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 16 03:26:04.885785 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] admin_token = **** {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.885983 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] admin_token = **** {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.886061 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] config_dir = [] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.886208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.886291 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] config_dir = [] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.886392 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] config_source = [] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.886475 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.886572 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] debug = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.886649 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] config_source = [] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.886771 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.887454 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] debug = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.887454 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.887454 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.887454 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.887696 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.887757 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.887818 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.887999 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.888079 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.888248 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.888326 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] list_limit = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.888435 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] log_config_append = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.888517 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] list_limit = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.888642 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.888726 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] log_config_append = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.888849 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.888931 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] log_dir = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.889037 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] log_file = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.889119 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] log_dir = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.889190 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] log_file = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.889272 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.889431 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.889522 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.889710 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.889797 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.889963 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.890048 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.890204 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.890296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.890368 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.890435 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.890584 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.890697 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.890783 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.890906 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.891031 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.891169 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.891267 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.891455 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.891553 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.891689 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.891783 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.891939 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.892022 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.892201 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.892298 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.892451 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.892545 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.892708 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.892805 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.893200 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.33/identity {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.893286 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.33/identity {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.893419 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] publish_errors = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.893492 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] publish_errors = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.893605 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.893706 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.893891 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.894084 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.894265 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.894436 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.894611 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.894776 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.894928 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.895008 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.895431 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] standard_threads = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.895556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] standard_threads = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.895625 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.895689 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.895755 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.895821 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.895885 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.895942 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.895998 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] use_journal = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.896054 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] use_journal = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.896117 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] use_json = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.896278 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] use_json = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.896355 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] use_stderr = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.896422 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] use_stderr = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.896498 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] use_syslog = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.896574 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] use_syslog = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.896725 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.896799 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 03:26:04.896874 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.896949 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.897025 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.897094 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.897173 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.897347 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.897433 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.897592 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.897708 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.897872 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.897961 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.898116 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.898199 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.898353 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.898431 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.898598 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.898690 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.898851 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.898931 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.899101 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.899185 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.899339 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.899430 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.899577 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.899656 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.899812 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.899891 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.900054 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.900139 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.900327 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.900411 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.900567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.900648 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.900805 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.900885 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.901101 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.901181 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.901348 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.901426 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.901587 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.901687 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.901853 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.901932 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.902111 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.902190 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.902364 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.902454 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.902615 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.902693 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.902849 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.902928 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.903083 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.903169 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.903315 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.903400 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.903553 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.903632 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.903803 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.903888 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.904053 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.904139 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.904284 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.904362 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.904516 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.904596 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.904764 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.904843 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.905013 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.905091 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.905251 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.905331 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.905523 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.905615 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.905755 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.905833 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.905996 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.906075 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.906231 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.906307 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.906463 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.906556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.906696 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.906771 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.906924 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.906992 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.907156 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.907232 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.907390 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.907460 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.907630 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.907736 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.907874 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.907992 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.908148 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.908260 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.908411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.908527 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.908674 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.908783 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.908927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.909048 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.909183 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.909296 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.909405 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.909538 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.909679 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.909829 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.909940 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.910074 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.910192 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.910307 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.910444 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.910553 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.910672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.910811 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.910926 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.911067 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.911067 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.911280 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.911280 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.911513 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.911628 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.911764 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.911886 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.911998 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.911998 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.912218 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.912218 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.912398 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.912469 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.912586 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.912662 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.912732 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.912800 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.912869 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.912975 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.913059 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.913132 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.913200 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.913385 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.913465 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.913675 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.918550 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.918637 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.918713 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.918773 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.918829 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.918897 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.918979 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.918979 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.919104 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.919104 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.919225 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.919292 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.919372 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.919453 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.919528 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.919597 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.919664 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.919731 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.919803 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.919880 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.919949 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.920017 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.920084 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.920151 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.920218 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.920292 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.920367 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.920435 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.920508 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.920582 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.920651 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.920651 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.920787 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.920787 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.920911 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.920911 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.921034 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.921105 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.921170 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.921239 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.921302 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.921368 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.921436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.921511 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.921580 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.921672 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.921734 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.921734 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.921852 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.921933 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.922004 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.922072 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.922139 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.922206 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.922273 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.922350 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.922419 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.922487 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.922554 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.922622 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.922689 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.922764 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.922829 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.922906 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.922982 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.923052 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.923119 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.923194 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.923263 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.923330 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.923397 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.923490 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] auth.external = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.923568 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.923638 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.923705 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] auth.external = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.923705 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.923836 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.923836 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.923959 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.924027 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] auth.password = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.924095 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.924170 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] auth.token = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.924251 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] auth.password = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.924322 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.924396 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] auth.token = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.924466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.924533 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.924609 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.924679 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.924758 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.924828 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.924895 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.924963 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.925144 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.925227 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.925377 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.925457 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.925618 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] credential.caching = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.925805 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.925943 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.926072 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] credential.caching = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.926191 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.926307 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.926423 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.926539 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.926664 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.926855 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.926974 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.927090 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.927205 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.927337 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.927463 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.927580 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.927696 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.927813 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.927940 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.928133 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.928261 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.928380 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.928495 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.928617 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.928735 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.928860 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.928978 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.929094 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.929215 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.929338 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.929455 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.929579 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.929752 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] federation.caching = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.929871 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.929987 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.930103 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] federation.caching = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.930229 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.930356 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.930474 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.930590 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.930706 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.930821 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.930939 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.931063 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.931181 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.931296 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.931412 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.931527 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.932249 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.932382 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.932501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.932619 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.932735 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.932851 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.932967 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.933092 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.933210 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] identity.caching = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.933326 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.933443 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.933558 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] identity.caching = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.933687 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.933687 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.933924 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.933924 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.934142 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.934258 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.934373 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.934498 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.934616 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.934732 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.934847 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.934963 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.935080 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.935204 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.935322 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.935437 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.935553 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.935553 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.935819 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.935947 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.936065 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.936189 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.936307 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.936422 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.936538 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.936663 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.936781 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.936781 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.937008 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.937008 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.937235 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.937235 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.937455 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.937571 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.937702 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.937702 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.937942 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.938061 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.938178 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.938294 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.938418 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.938535 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.938659 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.938777 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.938893 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.939008 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.939123 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.939238 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.939363 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.939480 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.939596 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.939712 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.939828 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.939943 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.940067 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.940184 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.940301 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.940437 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.940553 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.940706 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.940837 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.940956 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.941072 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.941188 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.941304 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.941457 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.941590 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.941725 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.941843 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.941959 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.942075 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.942191 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.942320 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.942439 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.942556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.942672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.942788 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.942904 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.943029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.943147 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.943263 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.943263 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.943482 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.943598 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.943723 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.943723 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.943955 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.944075 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.944192 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.944315 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.944442 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.944562 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.944678 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.944795 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.944910 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.945016 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.945122 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.945239 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.945355 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.945471 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.945588 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.945716 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.945884 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.946006 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.946123 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.946239 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.946355 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.946471 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.946596 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.946715 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.946832 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.946948 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.947064 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.947179 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.947307 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.947426 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.947542 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.947659 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.947775 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.947894 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.948019 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.948137 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.948253 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.948369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.948485 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.948607 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.948734 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.948852 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.948968 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.949084 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.949200 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.949316 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.949440 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.949563 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.949705 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.949824 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.949941 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.950073 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.950193 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.950309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.950425 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.950541 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.950692 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.950822 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.950941 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.951099 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.951226 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.951326 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.951423 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.951594 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.951696 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.951793 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.951891 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.951987 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.952084 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.952189 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.952289 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.952385 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.952489 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.952587 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.952684 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.952789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.952889 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.952986 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.953090 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.953188 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.953284 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.953392 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.953492 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.953589 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.953710 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.953817 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] resource.caching = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.953915 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.958177 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.958293 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.958375 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.958447 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] resource.caching = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.958521 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.958592 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.958675 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.958749 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.958819 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.958889 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.958959 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.959029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.959108 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.959181 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.959252 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.959321 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.959391 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.959461 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.959540 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] role.caching = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.959613 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.959683 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] role.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.959754 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.959824 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.959894 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] role.caching = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.959976 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.959976 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.960107 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] role.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.960107 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.960233 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.960303 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.960380 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.960452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.960523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.960593 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.960663 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.960733 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.960811 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.960811 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.960940 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.961010 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.961085 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.961156 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.961234 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.961307 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.961377 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.961377 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.961503 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.961572 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.961713 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.961791 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.961866 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.961937 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.962007 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.962086 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.962155 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.962155 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.962277 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.962348 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.962417 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.962495 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.962568 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.962638 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.962707 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.963278 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.963354 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.963433 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.963506 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.963578 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.963648 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.963718 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.963788 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.963866 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.963939 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.964009 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.964078 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.964148 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.964218 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.964296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.964368 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.964434 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.964504 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.964574 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.964644 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.964722 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.964795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.964865 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.964935 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.965005 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] token.caching = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.965075 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.965157 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.965230 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.965300 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.965369 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.965439 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.965509 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] token.caching = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.965617 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.965719 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.965888 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.966007 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.966128 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.966209 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.966375 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.966458 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.966620 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.966700 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.966867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.966945 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.967101 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.967181 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.967341 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.967421 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.967580 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.967660 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.967818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.967899 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.968084 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.968164 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.968314 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.968405 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.968559 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.968651 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.968824 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.968904 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.969055 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.969149 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] database.connection = **** {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.969304 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.969386 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.969547 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.969645 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.969809 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.969890 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] database.connection = **** {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.970056 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.970135 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.970282 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.970358 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.970516 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.970597 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.970751 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.970831 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.970987 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.971069 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.971231 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.971311 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.971466 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.971546 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.971707 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.971789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.971940 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.972019 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.972182 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.972261 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.972416 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.972497 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.972656 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.972734 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.972884 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.972962 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.973130 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.973210 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.973347 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.973428 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.973586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 16 03:26:04.973727 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.973866 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.974105 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 03:26:04.974279 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 16 03:26:05.006001 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.006145 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.006223 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.006383 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.006471 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.006614 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.015470 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.015661 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.044230 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.044463 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.044633 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.044868 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.105138 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.105372 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.155291 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.155527 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.155617 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.155797 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.311772 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.311963 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.312047 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.312130 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.312204 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.312278 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.312426 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.312513 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.312675 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.312795 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.312899 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.313009 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.338737 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.338848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.338975 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.339120 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.339252 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.339388 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.339498 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.339622 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.339706 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.339851 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.339936 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.340075 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.340157 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.340302 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.351326 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.351714 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.370390 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.370519 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.370631 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.370716 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.370862 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.370947 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.371094 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.371177 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.371316 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.371408 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.371537 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.371620 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.371755 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.371838 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 03:26:05.389088 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.389303 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 16 03:26:05.389388 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.389575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 16 03:26:05.389679 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.389866 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 16 03:26:05.389960 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.390144 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 16 03:26:05.390227 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.390408 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.390490 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.390677 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.390834 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.390956 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.391077 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.391249 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.401040 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.401235 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.401319 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.401518 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.401600 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.401825 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.401908 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.402114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.408927 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 03:26:05.409108 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 03:26:05.411892 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 03:26:05.412060 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 03:26:05.412186 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.412347 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.412477 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.412633 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.412770 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.412921 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.413060 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.413212 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.413328 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.413477 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.413604 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.413776 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.413908 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.414053 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.414188 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.414330 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.414470 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.414611 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.414747 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.414886 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.438234 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.438420 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.439724 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 03:26:05.439897 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 03:26:05.440015 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.440188 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.444753 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 03:26:05.444887 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 03:26:05.445044 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.445175 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.445331 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.445462 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.452306 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 03:26:05.452426 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 03:26:05.452597 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.452725 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.458362 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 03:26:05.458466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 03:26:05.458663 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.458745 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.458951 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.459033 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.459239 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.459330 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.459520 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.459602 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.459798 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.459878 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.460068 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.460150 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.460353 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.460461 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.476049 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.476235 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.476316 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.476426 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.480758 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 03:26:05.480851 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 03:26:05.484053 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.484151 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.484356 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.484438 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.488606 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 03:26:05.488727 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 03:26:05.491767 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 03:26:05.491952 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 03:26:05.495084 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.495309 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.495392 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.495618 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.495700 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.495913 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.495995 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.496207 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.496289 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.496488 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.496569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.496784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.512687 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 03:26:05.512978 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.513258 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.513338 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 03:26:05.513528 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.513622 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.513891 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.514159 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.520621 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.521375 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.522191 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.522983 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.523711 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.523993 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.524532 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.524815 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.527308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 03:26:05.527599 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.527888 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.528176 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.528270 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 03:26:05.528476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.528565 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.528765 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.529051 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.529448 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.539832 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 03:26:05.540107 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.540394 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.540677 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.540757 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 03:26:05.541087 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.541203 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.541372 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.541455 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.541672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.541756 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.542065 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.542354 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.542638 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.558163 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 03:26:05.559368 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 03:26:05.561083 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 03:26:05.562399 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 03:26:05.564046 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.565296 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.565537 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.566795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.567041 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 03:26:05.567330 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.567727 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.568265 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 03:26:05.568554 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.568962 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.574706 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.575970 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.576180 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 03:26:05.577449 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 03:26:05.579120 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.579523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.579817 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.580100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.580421 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.580825 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.581120 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.581405 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.588067 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 03:26:05.588364 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.588652 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.589395 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 03:26:05.589716 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.590008 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.595629 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 03:26:05.595920 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.596206 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.596486 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.596765 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.596971 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 03:26:05.597053 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.597262 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.597345 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.597551 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.597651 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.597854 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.597948 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.598133 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.598213 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.598408 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.598488 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.598672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.598760 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.598953 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.599033 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.599225 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.599304 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.599522 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.599800 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.600067 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.600349 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.600623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 03:26:05.633828 dv-cinder-857993-1-smb devstack@keystone.service[81776]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56315ea709c0 pid: 81776 (default app) Sep 16 03:26:05.635959 dv-cinder-857993-1-smb devstack@keystone.service[81775]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56315ea709c0 pid: 81775 (default app) Sep 16 03:26:05.637607 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc5e84-701e-48cd-958f-220ba332ba58 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:05.637921 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc5e84-701e-48cd-958f-220ba332ba58 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:05.638196 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc5e84-701e-48cd-958f-220ba332ba58 None None] PATH_INFO: `/v3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:05.642332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 791 bytes} [Fri Sep 16 03:26:05 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:13.467590 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136bf264-5dcb-4b90-af04-29e3072a7797 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:13.468146 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136bf264-5dcb-4b90-af04-29e3072a7797 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:13.468146 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136bf264-5dcb-4b90-af04-29e3072a7797 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:13.472355 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1/2] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:26:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 03:26:13.477706 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764f0c7-f64b-4260-9a5e-24d7676c069f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:13.478275 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764f0c7-f64b-4260-9a5e-24d7676c069f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:13.478879 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764f0c7-f64b-4260-9a5e-24d7676c069f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:13.552342 dv-cinder-857993-1-smb devstack@keystone.service[81776]: INFO dbcounter [None req-3764f0c7-f64b-4260-9a5e-24d7676c069f None None] Registered counter for database keystone Sep 16 03:26:13.573251 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG oslo_db.sqlalchemy.engines [None req-3764f0c7-f64b-4260-9a5e-24d7676c069f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81776) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 03:26:13.579576 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writer thread running {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 03:26:13.759386 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG passlib.handlers.bcrypt [None req-3764f0c7-f64b-4260-9a5e-24d7676c069f None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81776) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 16 03:26:13.759752 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG passlib.handlers.bcrypt [None req-3764f0c7-f64b-4260-9a5e-24d7676c069f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81776) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 16 03:26:13.818050 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3764f0c7-f64b-4260-9a5e-24d7676c069f None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:26:13.819668 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3764f0c7-f64b-4260-9a5e-24d7676c069f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:26:13.944610 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2/3] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:26:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 16 03:26:14.229471 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136bf264-5dcb-4b90-af04-29e3072a7797 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:14.299710 dv-cinder-857993-1-smb devstack@keystone.service[81775]: INFO dbcounter [None req-136bf264-5dcb-4b90-af04-29e3072a7797 None None] Registered counter for database keystone Sep 16 03:26:14.319149 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG oslo_db.sqlalchemy.engines [None req-136bf264-5dcb-4b90-af04-29e3072a7797 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81775) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 03:26:14.325376 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writer thread running {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 03:26:14.445031 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136bf264-5dcb-4b90-af04-29e3072a7797 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:14.449429 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54b579-0c90-4f68-81ac-99cbbc11d970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:14.450092 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54b579-0c90-4f68-81ac-99cbbc11d970 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:14.450376 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54b579-0c90-4f68-81ac-99cbbc11d970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:14.450648 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54b579-0c90-4f68-81ac-99cbbc11d970 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:14.458909 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc54b579-0c90-4f68-81ac-99cbbc11d970 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:14.510524 dv-cinder-857993-1-smb devstack@keystone.service[81775]: WARNING keystone.common.rbac_enforcer.enforcer [None req-dc54b579-0c90-4f68-81ac-99cbbc11d970 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 16 03:26:14.511060 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc54b579-0c90-4f68-81ac-99cbbc11d970 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:14.519931 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2/4] 10.222.0.33 () {58 vars in 1324 bytes} [Fri Sep 16 03:26:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 03:26:14.526239 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764f0c7-f64b-4260-9a5e-24d7676c069f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:14.543094 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764f0c7-f64b-4260-9a5e-24d7676c069f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:14.547442 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff71a8-3789-4b3e-b076-d2907baf0ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:14.548544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff71a8-3789-4b3e-b076-d2907baf0ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:14.548827 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff71a8-3789-4b3e-b076-d2907baf0ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:14.549115 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff71a8-3789-4b3e-b076-d2907baf0ae3 admin admin] PATH_INFO: `/v3/projects/4c378d507cbc42e4b80e3f5c14a93477` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:14.550714 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff71a8-3789-4b3e-b076-d2907baf0ae3 admin admin] RBAC: Authorizing `identity:get_project(project_id=4c378d507cbc42e4b80e3f5c14a93477)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:14.602926 dv-cinder-857993-1-smb devstack@keystone.service[81776]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6eff71a8-3789-4b3e-b076-d2907baf0ae3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 16 03:26:14.603806 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff71a8-3789-4b3e-b076-d2907baf0ae3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:14.608287 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3/5] 10.222.0.33 () {56 vars in 1207 bytes} [Fri Sep 16 03:26:14 2022] GET /identity/v3/projects/4c378d507cbc42e4b80e3f5c14a93477 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:26:16.724252 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee976713-aef3-4406-8d81-5453cc5f6e8a None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:16.724641 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee976713-aef3-4406-8d81-5453cc5f6e8a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:16.724801 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee976713-aef3-4406-8d81-5453cc5f6e8a None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:16.728875 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3/6] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:26:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:26:16.734216 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa42844-fc5b-4b0c-9a62-82915ae2a050 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:16.734622 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa42844-fc5b-4b0c-9a62-82915ae2a050 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:16.734778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa42844-fc5b-4b0c-9a62-82915ae2a050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:16.755026 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4aa42844-fc5b-4b0c-9a62-82915ae2a050 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:26:16.756542 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4aa42844-fc5b-4b0c-9a62-82915ae2a050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:26:16.764886 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4/7] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:26:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 16 03:26:17.033091 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee976713-aef3-4406-8d81-5453cc5f6e8a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:17.045595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee976713-aef3-4406-8d81-5453cc5f6e8a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:17.049821 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb328f-a4b1-4e86-9fd3-77db0bd6b680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:17.050426 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb328f-a4b1-4e86-9fd3-77db0bd6b680 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:17.050706 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb328f-a4b1-4e86-9fd3-77db0bd6b680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:17.050978 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb328f-a4b1-4e86-9fd3-77db0bd6b680 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:17.058656 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb328f-a4b1-4e86-9fd3-77db0bd6b680 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:17.060428 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb328f-a4b1-4e86-9fd3-77db0bd6b680 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:17.069017 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4/8] 10.222.0.33 () {58 vars in 1324 bytes} [Fri Sep 16 03:26:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 03:26:17.074459 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa42844-fc5b-4b0c-9a62-82915ae2a050 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:17.083325 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa42844-fc5b-4b0c-9a62-82915ae2a050 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:17.088085 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f0fb0-5444-45ad-8130-0fc6a4735625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:17.088708 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f0fb0-5444-45ad-8130-0fc6a4735625 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:17.089031 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f0fb0-5444-45ad-8130-0fc6a4735625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:17.089303 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f0fb0-5444-45ad-8130-0fc6a4735625 admin admin] PATH_INFO: `/v3/users/a6d47188867a4d9384390f05eba70a8c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:17.090640 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f0fb0-5444-45ad-8130-0fc6a4735625 admin admin] RBAC: Authorizing `identity:get_user(user_id=a6d47188867a4d9384390f05eba70a8c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:17.092437 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f0fb0-5444-45ad-8130-0fc6a4735625 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:17.093949 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 5/9] 10.222.0.33 () {56 vars in 1198 bytes} [Fri Sep 16 03:26:17 2022] GET /identity/v3/users/a6d47188867a4d9384390f05eba70a8c => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:19.324876 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa9a9a-199b-45df-af9e-51dcf1a11fd9 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:19.325410 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa9a9a-199b-45df-af9e-51dcf1a11fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:19.325410 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa9a9a-199b-45df-af9e-51dcf1a11fd9 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:19.326897 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 5/10] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 03:26:19.329035 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cb014-8e02-4be7-bf94-c04ba01a5523 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:19.329456 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cb014-8e02-4be7-bf94-c04ba01a5523 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:19.329591 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cb014-8e02-4be7-bf94-c04ba01a5523 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:19.330919 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 6/11] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 03:26:19.331750 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814f242-b263-4c4d-a333-dbfbcbd5efa3 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:19.332103 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814f242-b263-4c4d-a333-dbfbcbd5efa3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:19.332314 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814f242-b263-4c4d-a333-dbfbcbd5efa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:19.335985 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d04d09-6acb-4888-9605-fc80a348abe5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:19.336274 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d04d09-6acb-4888-9605-fc80a348abe5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:19.336553 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d04d09-6acb-4888-9605-fc80a348abe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:19.355159 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-25d04d09-6acb-4888-9605-fc80a348abe5 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:26:19.356346 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-25d04d09-6acb-4888-9605-fc80a348abe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:26:19.374331 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG passlib.handlers.bcrypt [None req-0814f242-b263-4c4d-a333-dbfbcbd5efa3 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81775) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 16 03:26:19.374728 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG passlib.handlers.bcrypt [None req-0814f242-b263-4c4d-a333-dbfbcbd5efa3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81775) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 16 03:26:19.424088 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0814f242-b263-4c4d-a333-dbfbcbd5efa3 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:26:19.425692 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0814f242-b263-4c4d-a333-dbfbcbd5efa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:26:19.435862 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 7/12] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:26:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 03:26:19.522203 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 6/13] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:26:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 03:26:19.699562 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d04d09-6acb-4888-9605-fc80a348abe5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:19.722996 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:19.786391 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0814f242-b263-4c4d-a333-dbfbcbd5efa3 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:19.802565 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d04d09-6acb-4888-9605-fc80a348abe5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:19.835650 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89d633-9326-4c65-9be5-a43cba436e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:19.836255 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89d633-9326-4c65-9be5-a43cba436e45 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:19.836532 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89d633-9326-4c65-9be5-a43cba436e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:19.836803 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89d633-9326-4c65-9be5-a43cba436e45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:19.885413 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0814f242-b263-4c4d-a333-dbfbcbd5efa3 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:19.887692 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:19.901677 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e89d633-9326-4c65-9be5-a43cba436e45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:19.903158 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e89d633-9326-4c65-9be5-a43cba436e45 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:19.922684 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4961ed2-1200-4e7c-aaae-e158403f6e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:19.923788 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4961ed2-1200-4e7c-aaae-e158403f6e64 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:19.924070 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4961ed2-1200-4e7c-aaae-e158403f6e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:19.924347 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4961ed2-1200-4e7c-aaae-e158403f6e64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:19.925686 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:19.936316 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4961ed2-1200-4e7c-aaae-e158403f6e64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:26:19.945718 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-a4961ed2-1200-4e7c-aaae-e158403f6e64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:26:19.945718 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:26:19.945718 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:26:19.945718 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:26:19.945718 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:26:19.945718 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:26:19.945718 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:26:19.945718 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:26:19.945718 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:26:19.945718 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:26:19.945718 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:26:19.945718 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:26:19.945718 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:26:19.945718 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:26:19.945718 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:26:19.945718 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:26:19.946836 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:26:19.946836 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:26:19.946836 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:26:19.946836 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:26:19.946836 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:26:19.946836 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:26:19.946836 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:26:19.946836 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:26:19.946836 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:26:19.946836 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:26:19.946836 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:26:19.946836 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:26:19.946836 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:26:19.946836 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:26:19.946836 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:26:19.946836 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:26:19.947637 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:26:19.947637 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:26:19.947637 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:26:19.947637 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:26:19.947637 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:26:19.947637 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:26:19.947637 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:26:19.947637 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:26:19.947637 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:26:19.947637 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:26:19.947637 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:26:19.947637 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:26:19.947637 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 7/14] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 03:26:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:26:19.952661 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4961ed2-1200-4e7c-aaae-e158403f6e64 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:20.001046 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 8/15] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:26:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 16 03:26:20.006525 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89d633-9326-4c65-9be5-a43cba436e45 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:20.051555 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4961ed2-1200-4e7c-aaae-e158403f6e64 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:20.085623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975f389-abe2-4489-8b2b-6ca48d29368c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:20.086248 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975f389-abe2-4489-8b2b-6ca48d29368c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:20.086526 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975f389-abe2-4489-8b2b-6ca48d29368c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:20.086795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975f389-abe2-4489-8b2b-6ca48d29368c None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:20.087465 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d975f389-abe2-4489-8b2b-6ca48d29368c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:26:20.087764 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d975f389-abe2-4489-8b2b-6ca48d29368c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:20.089182 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d975f389-abe2-4489-8b2b-6ca48d29368c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:20.100248 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89d633-9326-4c65-9be5-a43cba436e45 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:20.100642 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 8/16] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:26:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:26:20.106266 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975f389-abe2-4489-8b2b-6ca48d29368c None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:20.122430 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:20.132766 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:20.133573 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7110dc2-40c6-401d-b942-bd4b4f1a2de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:20.136178 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7110dc2-40c6-401d-b942-bd4b4f1a2de1 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:20.136178 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7110dc2-40c6-401d-b942-bd4b4f1a2de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:20.136178 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7110dc2-40c6-401d-b942-bd4b4f1a2de1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:20.145561 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7110dc2-40c6-401d-b942-bd4b4f1a2de1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:20.147074 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7110dc2-40c6-401d-b942-bd4b4f1a2de1 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:20.165411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-f7110dc2-40c6-401d-b942-bd4b4f1a2de1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:26:20.165411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:26:20.165411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:26:20.165411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:26:20.165411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:26:20.165411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:26:20.165411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:26:20.165411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:26:20.165411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:26:20.165411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:26:20.165411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:26:20.165411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:26:20.165411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:26:20.165411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:26:20.165411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:26:20.165411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:26:20.171299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:26:20.171299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:26:20.171299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:26:20.171299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:26:20.171299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:26:20.171299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:26:20.171299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:26:20.171299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:26:20.171299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:26:20.171299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:26:20.171299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:26:20.171299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:26:20.171299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:26:20.171299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:26:20.171299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:26:20.171299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:26:20.171299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:26:20.172080 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:26:20.172080 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:26:20.172080 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:26:20.172080 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 9/17] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:26:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:26:20.172289 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7110dc2-40c6-401d-b942-bd4b4f1a2de1 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:20.204514 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975f389-abe2-4489-8b2b-6ca48d29368c None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:20.239216 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3725a-63e7-49f3-8231-5834dd9a8b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:20.239857 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3725a-63e7-49f3-8231-5834dd9a8b52 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:20.240142 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3725a-63e7-49f3-8231-5834dd9a8b52 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:20.240416 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3725a-63e7-49f3-8231-5834dd9a8b52 None admin] PATH_INFO: `/v3/users/a6d47188867a4d9384390f05eba70a8c` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:20.241947 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3725a-63e7-49f3-8231-5834dd9a8b52 None admin] RBAC: Authorizing `identity:get_user(user_id=a6d47188867a4d9384390f05eba70a8c)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:20.243417 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3725a-63e7-49f3-8231-5834dd9a8b52 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:20.245685 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 9/18] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:26:20 2022] GET /identity/v3/users/a6d47188867a4d9384390f05eba70a8c => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:26:20.251003 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3725a-63e7-49f3-8231-5834dd9a8b52 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:20.269612 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7110dc2-40c6-401d-b942-bd4b4f1a2de1 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:20.305161 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b3fa4-b0b9-423c-bbc7-64c6edac6f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:20.305802 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b3fa4-b0b9-423c-bbc7-64c6edac6f09 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:20.306086 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b3fa4-b0b9-423c-bbc7-64c6edac6f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:20.306931 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b3fa4-b0b9-423c-bbc7-64c6edac6f09 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:20.307568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b3fa4-b0b9-423c-bbc7-64c6edac6f09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:26:20.307871 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b3fa4-b0b9-423c-bbc7-64c6edac6f09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:20.309256 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b3fa4-b0b9-423c-bbc7-64c6edac6f09 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:20.325591 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 10/19] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:26:20.346188 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:20.353555 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3725a-63e7-49f3-8231-5834dd9a8b52 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:20.390273 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca32f87-c2f1-4786-b2f6-1a4853a9eb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:20.390921 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca32f87-c2f1-4786-b2f6-1a4853a9eb9c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:20.391200 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca32f87-c2f1-4786-b2f6-1a4853a9eb9c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:20.391473 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca32f87-c2f1-4786-b2f6-1a4853a9eb9c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:20.392619 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca32f87-c2f1-4786-b2f6-1a4853a9eb9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:20.394122 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca32f87-c2f1-4786-b2f6-1a4853a9eb9c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:20.396169 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 10/20] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:26:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:26:20.402220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b3fa4-b0b9-423c-bbc7-64c6edac6f09 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:20.437572 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:20.506158 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b3fa4-b0b9-423c-bbc7-64c6edac6f09 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:20.540563 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c78d33-d440-481f-8b84-0f874208ea59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:20.541178 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c78d33-d440-481f-8b84-0f874208ea59 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:20.541460 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c78d33-d440-481f-8b84-0f874208ea59 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:20.541765 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c78d33-d440-481f-8b84-0f874208ea59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:20.542497 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c78d33-d440-481f-8b84-0f874208ea59 None admin] RBAC: Adding query filter params (role.id=4ffac54101e248479bcdc0e54890020f, scope.domain.id=default, user.id=a6d47188867a4d9384390f05eba70a8c) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:26:20.542805 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c78d33-d440-481f-8b84-0f874208ea59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:20.544244 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c78d33-d440-481f-8b84-0f874208ea59 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:20.551015 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 11/21] 10.222.0.33 () {56 vars in 1322 bytes} [Fri Sep 16 03:26:20 2022] GET /identity/v3/role_assignments?user.id=a6d47188867a4d9384390f05eba70a8c&scope.domain.id=default&role.id=4ffac54101e248479bcdc0e54890020f => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:22.748582 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115ab35-9cee-4c9b-be8d-5f48c6724a59 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:22.749516 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115ab35-9cee-4c9b-be8d-5f48c6724a59 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:22.750027 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115ab35-9cee-4c9b-be8d-5f48c6724a59 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:22.751534 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 11/22] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:26:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:26:22.756741 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b430dc-279d-4f34-8520-7937015a65eb None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:22.757138 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b430dc-279d-4f34-8520-7937015a65eb None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:22.757292 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b430dc-279d-4f34-8520-7937015a65eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:22.783143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c2b430dc-279d-4f34-8520-7937015a65eb None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:26:22.784594 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c2b430dc-279d-4f34-8520-7937015a65eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:26:22.872290 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 12/23] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:26:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:26:23.084406 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa2fe0-1249-4a30-9fef-a32c7ded8797 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:23.085077 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa2fe0-1249-4a30-9fef-a32c7ded8797 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:23.085548 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa2fe0-1249-4a30-9fef-a32c7ded8797 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:23.087421 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 12/24] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:26:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:26:23.092258 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3c771-1ec3-476e-b09a-c7a2f570603a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:23.092556 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3c771-1ec3-476e-b09a-c7a2f570603a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:23.092832 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3c771-1ec3-476e-b09a-c7a2f570603a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:23.122900 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-74b3c771-1ec3-476e-b09a-c7a2f570603a None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:26:23.124217 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-74b3c771-1ec3-476e-b09a-c7a2f570603a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:26:23.151652 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:23.207549 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 13/25] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:26:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 03:26:23.421514 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa2fe0-1249-4a30-9fef-a32c7ded8797 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:23.470370 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8099ca-9d6c-4f21-946b-479a2fb385a8 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:23.471024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8099ca-9d6c-4f21-946b-479a2fb385a8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:23.471509 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8099ca-9d6c-4f21-946b-479a2fb385a8 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:23.472898 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 14/26] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:26:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:26:23.488758 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80f85a-42d7-4a9c-b238-042d8a7258a0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:23.489324 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80f85a-42d7-4a9c-b238-042d8a7258a0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:23.489772 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80f85a-42d7-4a9c-b238-042d8a7258a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:23.528233 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-dd80f85a-42d7-4a9c-b238-042d8a7258a0 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:26:23.530584 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-dd80f85a-42d7-4a9c-b238-042d8a7258a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:26:23.553613 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa2fe0-1249-4a30-9fef-a32c7ded8797 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:23.620366 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b430f9fc-a7e5-43f4-8eb6-3b727c633cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:23.621003 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430f9fc-a7e5-43f4-8eb6-3b727c633cfc None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:23.621284 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430f9fc-a7e5-43f4-8eb6-3b727c633cfc None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:23.621824 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430f9fc-a7e5-43f4-8eb6-3b727c633cfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:23.662580 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 15/27] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:26:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 03:26:23.663049 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b430f9fc-a7e5-43f4-8eb6-3b727c633cfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:23.664544 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b430f9fc-a7e5-43f4-8eb6-3b727c633cfc None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:23.690618 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c046d7a-c959-4a60-8130-88782a0b3458 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:23.690781 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-b430f9fc-a7e5-43f4-8eb6-3b727c633cfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:26:23.690781 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:26:23.690781 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:26:23.690781 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:26:23.690781 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:26:23.690781 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:26:23.690781 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:26:23.690781 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:26:23.690781 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:26:23.690781 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:26:23.690781 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:26:23.690781 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:26:23.690781 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:26:23.690781 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:26:23.690781 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:26:23.690781 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:26:23.691556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:26:23.691556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:26:23.691556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:26:23.691556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:26:23.691556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:26:23.691556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:26:23.691556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:26:23.691556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:26:23.691556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:26:23.691556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:26:23.691556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:26:23.691556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:26:23.691556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:26:23.691556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:26:23.691556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:26:23.691556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:26:23.691556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:26:23.692321 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:26:23.692321 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:26:23.692321 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:26:23.692321 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 13/28] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:26:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:26:23.694057 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c046d7a-c959-4a60-8130-88782a0b3458 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:23.694342 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c046d7a-c959-4a60-8130-88782a0b3458 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:23.696705 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 16/29] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:26:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:26:23.704432 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba59a0-8c17-4cd6-a125-d1eb1daec6cd None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:23.704720 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba59a0-8c17-4cd6-a125-d1eb1daec6cd None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:23.704997 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba59a0-8c17-4cd6-a125-d1eb1daec6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:23.708768 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c046d7a-c959-4a60-8130-88782a0b3458 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:23.743343 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-35ba59a0-8c17-4cd6-a125-d1eb1daec6cd None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:26:23.745070 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-35ba59a0-8c17-4cd6-a125-d1eb1daec6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:26:23.772390 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:23.873257 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 14/30] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:26:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:26:23.874345 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba59a0-8c17-4cd6-a125-d1eb1daec6cd None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:23.907541 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:23.932240 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c046d7a-c959-4a60-8130-88782a0b3458 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:23.981074 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955c630-d6e7-4e50-8099-f14612f3153c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:23.981827 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955c630-d6e7-4e50-8099-f14612f3153c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:23.982312 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955c630-d6e7-4e50-8099-f14612f3153c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:23.982722 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955c630-d6e7-4e50-8099-f14612f3153c None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:23.983515 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955c630-d6e7-4e50-8099-f14612f3153c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:26:23.984009 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955c630-d6e7-4e50-8099-f14612f3153c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:23.985596 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955c630-d6e7-4e50-8099-f14612f3153c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:24.006011 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 17/31] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:26:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:24.007063 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955c630-d6e7-4e50-8099-f14612f3153c None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:24.060933 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba59a0-8c17-4cd6-a125-d1eb1daec6cd None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:24.154322 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570064da-d360-4982-aa94-a5e23a46e46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:24.155376 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570064da-d360-4982-aa94-a5e23a46e46f None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:24.155850 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570064da-d360-4982-aa94-a5e23a46e46f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:24.156327 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570064da-d360-4982-aa94-a5e23a46e46f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:24.162085 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955c630-d6e7-4e50-8099-f14612f3153c None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:24.182860 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570064da-d360-4982-aa94-a5e23a46e46f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:26:24.188183 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-570064da-d360-4982-aa94-a5e23a46e46f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:26:24.188183 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:26:24.188183 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:26:24.188183 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:26:24.188183 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:26:24.188183 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:26:24.188183 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:26:24.188183 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:26:24.188183 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:26:24.188183 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:26:24.188183 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:26:24.188183 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:26:24.188183 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:26:24.188183 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:26:24.188183 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:26:24.188183 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:26:24.188988 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:26:24.188988 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:26:24.188988 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:26:24.188988 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:26:24.188988 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:26:24.188988 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:26:24.188988 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:26:24.188988 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:26:24.188988 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:26:24.188988 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:26:24.188988 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:26:24.188988 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:26:24.188988 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:26:24.188988 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:26:24.188988 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:26:24.188988 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:26:24.189760 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:26:24.189760 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:26:24.189760 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:26:24.189760 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:26:24.189760 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:26:24.189760 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:26:24.189760 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:26:24.189760 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:26:24.189760 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:26:24.189760 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:26:24.189760 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:26:24.189760 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:26:24.197662 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 15/32] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 03:26:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:26:24.198832 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570064da-d360-4982-aa94-a5e23a46e46f None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:24.205683 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dee133-e678-4937-a20c-7b47f07b4aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:24.205683 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dee133-e678-4937-a20c-7b47f07b4aab None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:24.205683 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dee133-e678-4937-a20c-7b47f07b4aab None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:24.205683 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dee133-e678-4937-a20c-7b47f07b4aab None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:24.205995 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dee133-e678-4937-a20c-7b47f07b4aab None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:24.205995 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dee133-e678-4937-a20c-7b47f07b4aab None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:24.211256 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:24.319288 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570064da-d360-4982-aa94-a5e23a46e46f None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:24.355383 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03329d77-e6a5-4170-9e64-2c444a3c58e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:24.356058 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03329d77-e6a5-4170-9e64-2c444a3c58e8 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:24.356344 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03329d77-e6a5-4170-9e64-2c444a3c58e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:24.356622 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03329d77-e6a5-4170-9e64-2c444a3c58e8 None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:24.357344 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03329d77-e6a5-4170-9e64-2c444a3c58e8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:24.358996 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03329d77-e6a5-4170-9e64-2c444a3c58e8 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:24.441562 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 18/33] 10.222.0.33 () {60 vars in 1131 bytes} [Fri Sep 16 03:26:24 2022] POST /identity/v3/roles => generated 219 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:26:24.443056 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dee133-e678-4937-a20c-7b47f07b4aab None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:24.464360 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:24.579859 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dee133-e678-4937-a20c-7b47f07b4aab None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:24.614123 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 16/34] 10.222.0.33 () {60 vars in 1141 bytes} [Fri Sep 16 03:26:24 2022] POST /identity/v3/projects => generated 301 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:26:24.614963 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03329d77-e6a5-4170-9e64-2c444a3c58e8 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:24.620254 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b9351-609e-4603-9123-0e9c78e4707f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:24.620891 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b9351-609e-4603-9123-0e9c78e4707f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:24.621177 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b9351-609e-4603-9123-0e9c78e4707f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:24.621456 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b9351-609e-4603-9123-0e9c78e4707f None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:24.622196 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b9351-609e-4603-9123-0e9c78e4707f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:26:24.622509 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b9351-609e-4603-9123-0e9c78e4707f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:24.624160 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b9351-609e-4603-9123-0e9c78e4707f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:24.640936 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 19/35] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:26:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:24.645676 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f02a8d-548d-4913-9485-6e4fa77862d6 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:24.645676 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f02a8d-548d-4913-9485-6e4fa77862d6 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:24.645676 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f02a8d-548d-4913-9485-6e4fa77862d6 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:24.645676 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 20/36] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:26:24.646406 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceda5df-26dc-435b-9c24-320daf83efb8 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:24.646514 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceda5df-26dc-435b-9c24-320daf83efb8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:24.646774 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceda5df-26dc-435b-9c24-320daf83efb8 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:24.648465 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 21/37] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:26:24.652619 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceda5df-26dc-435b-9c24-320daf83efb8 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:24.706075 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:24.757835 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:24.762089 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03329d77-e6a5-4170-9e64-2c444a3c58e8 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:24.796510 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceda5df-26dc-435b-9c24-320daf83efb8 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:24.801756 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb90562-63aa-4553-be3e-d24529d0f4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:24.802195 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb90562-63aa-4553-be3e-d24529d0f4d9 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:24.802404 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb90562-63aa-4553-be3e-d24529d0f4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:24.802648 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb90562-63aa-4553-be3e-d24529d0f4d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:24.803415 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb90562-63aa-4553-be3e-d24529d0f4d9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:24.804945 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb90562-63aa-4553-be3e-d24529d0f4d9 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:24.830162 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2754435-a5e9-4df3-b2e5-610b099a5a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:24.830759 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2754435-a5e9-4df3-b2e5-610b099a5a8f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:24.831043 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2754435-a5e9-4df3-b2e5-610b099a5a8f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:24.831325 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2754435-a5e9-4df3-b2e5-610b099a5a8f None admin] PATH_INFO: `/v3/users/a6d47188867a4d9384390f05eba70a8c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:24.832556 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2754435-a5e9-4df3-b2e5-610b099a5a8f None admin] RBAC: Authorizing `identity:get_user(user_id=a6d47188867a4d9384390f05eba70a8c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:24.834106 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2754435-a5e9-4df3-b2e5-610b099a5a8f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:24.835681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 22/38] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:26:24 2022] GET /identity/v3/users/a6d47188867a4d9384390f05eba70a8c => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:24.836795 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba7047-2dde-42f5-8aba-8bd2b393d553 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:24.837084 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba7047-2dde-42f5-8aba-8bd2b393d553 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:24.837938 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba7047-2dde-42f5-8aba-8bd2b393d553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:24.857046 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c4ba7047-2dde-42f5-8aba-8bd2b393d553 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:26:24.858657 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c4ba7047-2dde-42f5-8aba-8bd2b393d553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:26:24.872164 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 17/39] 10.222.0.33 () {60 vars in 1131 bytes} [Fri Sep 16 03:26:24 2022] POST /identity/v3/roles => generated 225 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:26:24.873473 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd4c26-f542-4ba4-b710-aa8e36ca2b8c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:24.873866 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd4c26-f542-4ba4-b710-aa8e36ca2b8c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:24.874145 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd4c26-f542-4ba4-b710-aa8e36ca2b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:24.894377 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-78dd4c26-f542-4ba4-b710-aa8e36ca2b8c None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:26:24.896262 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-78dd4c26-f542-4ba4-b710-aa8e36ca2b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:26:24.976257 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 18/40] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:26:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:26:24.987378 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd4c26-f542-4ba4-b710-aa8e36ca2b8c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:25.047433 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 23/41] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:26:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:26:25.053146 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:25.109029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd4c26-f542-4ba4-b710-aa8e36ca2b8c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:25.144279 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38843c7-0aa7-4aee-bf6a-94764bc36bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:25.144930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38843c7-0aa7-4aee-bf6a-94764bc36bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:25.145267 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38843c7-0aa7-4aee-bf6a-94764bc36bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:25.145824 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38843c7-0aa7-4aee-bf6a-94764bc36bb0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:25.146957 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38843c7-0aa7-4aee-bf6a-94764bc36bb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:25.148490 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38843c7-0aa7-4aee-bf6a-94764bc36bb0 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:25.151102 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 19/42] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:26:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:25.156341 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba7047-2dde-42f5-8aba-8bd2b393d553 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:25.230462 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:25.244647 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38843c7-0aa7-4aee-bf6a-94764bc36bb0 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:25.263554 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba7047-2dde-42f5-8aba-8bd2b393d553 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:25.300611 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c808c8-b35b-4585-840f-c1ba36d2432b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:25.301287 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c808c8-b35b-4585-840f-c1ba36d2432b None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:25.301573 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c808c8-b35b-4585-840f-c1ba36d2432b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:25.301883 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c808c8-b35b-4585-840f-c1ba36d2432b None admin] PATH_INFO: `/v3/domains/default/users/a6d47188867a4d9384390f05eba70a8c/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:25.303823 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c808c8-b35b-4585-840f-c1ba36d2432b None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a6d47188867a4d9384390f05eba70a8c, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:25.305266 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c808c8-b35b-4585-840f-c1ba36d2432b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:25.350817 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38843c7-0aa7-4aee-bf6a-94764bc36bb0 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:25.363965 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:25.383316 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba57666-bde9-4bf0-acd7-573de33c8736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:25.383944 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba57666-bde9-4bf0-acd7-573de33c8736 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:25.384844 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba57666-bde9-4bf0-acd7-573de33c8736 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:25.385129 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba57666-bde9-4bf0-acd7-573de33c8736 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:25.386240 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba57666-bde9-4bf0-acd7-573de33c8736 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:25.387675 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba57666-bde9-4bf0-acd7-573de33c8736 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:25.389213 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 20/43] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:26:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:26:25.396134 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba57666-bde9-4bf0-acd7-573de33c8736 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:25.419640 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 24/44] 10.222.0.33 () {58 vars in 1361 bytes} [Fri Sep 16 03:26:25 2022] PUT /identity/v3/domains/default/users/a6d47188867a4d9384390f05eba70a8c/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:26:25.436340 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c808c8-b35b-4585-840f-c1ba36d2432b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:25.500019 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba57666-bde9-4bf0-acd7-573de33c8736 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:25.539008 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d85c7f-1f10-4a2a-b8f2-8d8062eecc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:25.539643 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d85c7f-1f10-4a2a-b8f2-8d8062eecc95 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:25.540013 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d85c7f-1f10-4a2a-b8f2-8d8062eecc95 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:25.540299 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d85c7f-1f10-4a2a-b8f2-8d8062eecc95 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:25.541571 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d85c7f-1f10-4a2a-b8f2-8d8062eecc95 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:25.543016 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d85c7f-1f10-4a2a-b8f2-8d8062eecc95 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:25.569366 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c808c8-b35b-4585-840f-c1ba36d2432b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:25.598050 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:25.606366 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055911e-3be5-4f6b-b01a-cfd3f52dcd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:25.606993 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055911e-3be5-4f6b-b01a-cfd3f52dcd1c None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:25.607283 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055911e-3be5-4f6b-b01a-cfd3f52dcd1c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:25.607624 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055911e-3be5-4f6b-b01a-cfd3f52dcd1c None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:25.608408 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4055911e-3be5-4f6b-b01a-cfd3f52dcd1c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:25.609805 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4055911e-3be5-4f6b-b01a-cfd3f52dcd1c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:25.631026 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 21/45] 10.222.0.33 () {60 vars in 1131 bytes} [Fri Sep 16 03:26:25 2022] POST /identity/v3/roles => generated 223 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:26:25.715721 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 25/46] 10.222.0.33 () {60 vars in 1141 bytes} [Fri Sep 16 03:26:25 2022] POST /identity/v3/projects => generated 312 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:26:27.606499 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c5485-db3e-49d8-946b-c85d007541a4 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:27.607015 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c5485-db3e-49d8-946b-c85d007541a4 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:27.607096 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c5485-db3e-49d8-946b-c85d007541a4 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:27.608381 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 22/47] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:26:27.613771 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516cf58-0b72-4622-a9b4-ccf05669646c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:27.614167 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516cf58-0b72-4622-a9b4-ccf05669646c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:27.614345 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516cf58-0b72-4622-a9b4-ccf05669646c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:27.632762 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0516cf58-0b72-4622-a9b4-ccf05669646c None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:26:27.633982 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0516cf58-0b72-4622-a9b4-ccf05669646c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:26:27.702819 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 26/48] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:26:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:26:27.865229 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb401bd-5a42-4553-9a64-80d8217c33c4 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:27.865439 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb401bd-5a42-4553-9a64-80d8217c33c4 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:27.865744 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb401bd-5a42-4553-9a64-80d8217c33c4 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:27.867071 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 23/49] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:26:27.872526 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7e20f-3bf4-4aff-ad86-3b5ca7323c5c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:27.872820 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7e20f-3bf4-4aff-ad86-3b5ca7323c5c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:27.873103 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7e20f-3bf4-4aff-ad86-3b5ca7323c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:27.891453 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0df7e20f-3bf4-4aff-ad86-3b5ca7323c5c None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:26:27.892652 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0df7e20f-3bf4-4aff-ad86-3b5ca7323c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:26:27.957349 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 27/50] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:26:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:26:27.971560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb401bd-5a42-4553-9a64-80d8217c33c4 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:28.015513 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:28.071630 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb401bd-5a42-4553-9a64-80d8217c33c4 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:28.104011 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b8bf4-03f2-4f22-a294-68d0efe57209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:28.104634 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b8bf4-03f2-4f22-a294-68d0efe57209 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:28.104970 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b8bf4-03f2-4f22-a294-68d0efe57209 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:28.105248 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b8bf4-03f2-4f22-a294-68d0efe57209 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:28.114994 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b8bf4-03f2-4f22-a294-68d0efe57209 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:26:28.122201 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-ac5b8bf4-03f2-4f22-a294-68d0efe57209 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:26:28.122201 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:26:28.122201 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:26:28.122201 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:26:28.122201 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:26:28.122201 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:26:28.122201 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:26:28.122201 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:26:28.122201 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:26:28.122201 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:26:28.122201 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:26:28.122201 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:26:28.122201 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:26:28.122201 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:26:28.122201 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:26:28.122201 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:26:28.123208 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:26:28.123208 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:26:28.123208 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:26:28.123208 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:26:28.123208 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:26:28.123208 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:26:28.123208 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:26:28.123208 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:26:28.123208 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:26:28.123208 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:26:28.123208 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:26:28.123208 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:26:28.123208 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:26:28.123208 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:26:28.123208 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:26:28.123208 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:26:28.124150 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:26:28.124150 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:26:28.124150 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:26:28.124150 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:26:28.124150 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:26:28.124150 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:26:28.124150 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:26:28.124150 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:26:28.124150 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:26:28.124150 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:26:28.124150 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:26:28.124150 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:26:28.124150 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 24/51] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 03:26:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:26:28.127210 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df7e20f-3bf4-4aff-ad86-3b5ca7323c5c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:28.169030 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:28.224823 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b8bf4-03f2-4f22-a294-68d0efe57209 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:28.225321 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df7e20f-3bf4-4aff-ad86-3b5ca7323c5c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:28.258527 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620324a-57b8-4ed4-94f9-6f2bcdebb140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:28.259189 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620324a-57b8-4ed4-94f9-6f2bcdebb140 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:28.259478 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620324a-57b8-4ed4-94f9-6f2bcdebb140 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:28.259758 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620324a-57b8-4ed4-94f9-6f2bcdebb140 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:28.260461 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620324a-57b8-4ed4-94f9-6f2bcdebb140 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:26:28.261419 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620324a-57b8-4ed4-94f9-6f2bcdebb140 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:28.262201 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620324a-57b8-4ed4-94f9-6f2bcdebb140 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:28.270750 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 28/52] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:26:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:28.276819 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620324a-57b8-4ed4-94f9-6f2bcdebb140 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:28.326201 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b8bf4-03f2-4f22-a294-68d0efe57209 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:28.327698 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:28.360142 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864edcea-7622-4385-ab6c-4c69c2de0480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:28.360773 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864edcea-7622-4385-ab6c-4c69c2de0480 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:28.361059 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864edcea-7622-4385-ab6c-4c69c2de0480 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:28.361340 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864edcea-7622-4385-ab6c-4c69c2de0480 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:28.362489 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864edcea-7622-4385-ab6c-4c69c2de0480 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:28.363948 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864edcea-7622-4385-ab6c-4c69c2de0480 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:28.370516 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 25/53] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:26:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:26:28.371541 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864edcea-7622-4385-ab6c-4c69c2de0480 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:28.374658 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620324a-57b8-4ed4-94f9-6f2bcdebb140 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:28.376121 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:28.407964 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faca63d-f762-4d7c-a529-f1cd4c2121fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:28.408594 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faca63d-f762-4d7c-a529-f1cd4c2121fe None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:28.408878 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faca63d-f762-4d7c-a529-f1cd4c2121fe None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:28.409160 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faca63d-f762-4d7c-a529-f1cd4c2121fe None admin] PATH_INFO: `/v3/users/a6d47188867a4d9384390f05eba70a8c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:28.410360 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faca63d-f762-4d7c-a529-f1cd4c2121fe None admin] RBAC: Authorizing `identity:get_user(user_id=a6d47188867a4d9384390f05eba70a8c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:28.411804 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faca63d-f762-4d7c-a529-f1cd4c2121fe None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:28.413375 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 29/54] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:26:28 2022] GET /identity/v3/users/a6d47188867a4d9384390f05eba70a8c => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:26:28.418828 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faca63d-f762-4d7c-a529-f1cd4c2121fe None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:28.469735 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864edcea-7622-4385-ab6c-4c69c2de0480 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:28.502736 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99fc97-986f-4ad2-a050-852b6a1a46a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:28.503353 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99fc97-986f-4ad2-a050-852b6a1a46a1 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:28.503641 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99fc97-986f-4ad2-a050-852b6a1a46a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:28.503922 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99fc97-986f-4ad2-a050-852b6a1a46a1 None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:28.504575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99fc97-986f-4ad2-a050-852b6a1a46a1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:28.506065 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99fc97-986f-4ad2-a050-852b6a1a46a1 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:28.514427 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faca63d-f762-4d7c-a529-f1cd4c2121fe None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:28.552466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cefdb-4ffe-4ca5-a99a-3ea1bbda7c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:28.553098 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cefdb-4ffe-4ca5-a99a-3ea1bbda7c80 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:28.555551 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cefdb-4ffe-4ca5-a99a-3ea1bbda7c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:28.555829 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cefdb-4ffe-4ca5-a99a-3ea1bbda7c80 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:28.556986 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287cefdb-4ffe-4ca5-a99a-3ea1bbda7c80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:28.558460 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287cefdb-4ffe-4ca5-a99a-3ea1bbda7c80 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:28.560019 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 30/55] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:26:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:28.565606 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cefdb-4ffe-4ca5-a99a-3ea1bbda7c80 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:28.603832 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:28.613443 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 26/56] 10.222.0.33 () {60 vars in 1140 bytes} [Fri Sep 16 03:26:28 2022] POST /identity/v3/projects => generated 298 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:26:28.667376 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cefdb-4ffe-4ca5-a99a-3ea1bbda7c80 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:28.709245 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24c564-ea5b-46cb-83d7-300d7fc84ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:28.709905 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24c564-ea5b-46cb-83d7-300d7fc84ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:28.710187 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24c564-ea5b-46cb-83d7-300d7fc84ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:28.710461 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24c564-ea5b-46cb-83d7-300d7fc84ad4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:28.711203 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24c564-ea5b-46cb-83d7-300d7fc84ad4 None admin] RBAC: Adding query filter params (role.id=4ffac54101e248479bcdc0e54890020f, scope.domain.id=default, user.id=a6d47188867a4d9384390f05eba70a8c) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:26:28.711512 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24c564-ea5b-46cb-83d7-300d7fc84ad4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:28.713564 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24c564-ea5b-46cb-83d7-300d7fc84ad4 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:28.720154 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 31/57] 10.222.0.33 () {56 vars in 1322 bytes} [Fri Sep 16 03:26:28 2022] GET /identity/v3/role_assignments?user.id=a6d47188867a4d9384390f05eba70a8c&scope.domain.id=default&role.id=4ffac54101e248479bcdc0e54890020f => generated 530 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:26:30.742541 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33915044-e6d9-4303-ba70-1d5f9ec1a6ab None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:30.742949 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33915044-e6d9-4303-ba70-1d5f9ec1a6ab None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:30.743105 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33915044-e6d9-4303-ba70-1d5f9ec1a6ab None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:30.744957 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 27/58] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:26:30.750252 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41533a2a-b1e6-421c-97e5-d5f6bb2c590d None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:30.750636 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41533a2a-b1e6-421c-97e5-d5f6bb2c590d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:30.750824 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41533a2a-b1e6-421c-97e5-d5f6bb2c590d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:30.769068 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-41533a2a-b1e6-421c-97e5-d5f6bb2c590d None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:26:30.770301 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-41533a2a-b1e6-421c-97e5-d5f6bb2c590d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:26:30.833743 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 32/59] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:26:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:26:31.100251 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33915044-e6d9-4303-ba70-1d5f9ec1a6ab None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:31.126121 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:31.303753 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33915044-e6d9-4303-ba70-1d5f9ec1a6ab None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:31.335661 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b90e06-1462-42bb-afb3-5eaebb9bcaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:31.336275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b90e06-1462-42bb-afb3-5eaebb9bcaa3 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:31.336555 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b90e06-1462-42bb-afb3-5eaebb9bcaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:31.336829 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b90e06-1462-42bb-afb3-5eaebb9bcaa3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:31.338494 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b90e06-1462-42bb-afb3-5eaebb9bcaa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:31.339907 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b90e06-1462-42bb-afb3-5eaebb9bcaa3 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:31.341427 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 28/60] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:26:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:31.346989 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41533a2a-b1e6-421c-97e5-d5f6bb2c590d None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:31.376654 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:31.441744 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41533a2a-b1e6-421c-97e5-d5f6bb2c590d None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:31.474002 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e426f-cace-4068-a6b9-26fa02876db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:31.474604 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e426f-cace-4068-a6b9-26fa02876db7 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:31.474888 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e426f-cace-4068-a6b9-26fa02876db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:31.475165 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e426f-cace-4068-a6b9-26fa02876db7 None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:31.475824 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05e426f-cace-4068-a6b9-26fa02876db7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:31.477260 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05e426f-cace-4068-a6b9-26fa02876db7 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:31.579743 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 33/61] 10.222.0.33 () {60 vars in 1132 bytes} [Fri Sep 16 03:26:31 2022] POST /identity/v3/users => generated 275 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:26:34.943576 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94f537-7d79-452c-9587-f5da6c862b89 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:34.944507 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94f537-7d79-452c-9587-f5da6c862b89 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:34.944507 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94f537-7d79-452c-9587-f5da6c862b89 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:34.945847 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 29/62] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:26:34.951471 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e62c5-5fa7-4ec7-92b3-5a23b5744ac1 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:34.951903 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e62c5-5fa7-4ec7-92b3-5a23b5744ac1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:34.951979 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e62c5-5fa7-4ec7-92b3-5a23b5744ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:34.978724 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-737e62c5-5fa7-4ec7-92b3-5a23b5744ac1 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:26:34.979951 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-737e62c5-5fa7-4ec7-92b3-5a23b5744ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:26:35.018255 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea09a2-9733-426a-b3d5-96bebb0cc2dd None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:35.018905 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea09a2-9733-426a-b3d5-96bebb0cc2dd None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:35.019718 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea09a2-9733-426a-b3d5-96bebb0cc2dd None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:35.022009 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 30/63] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:26:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:26:35.028350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e83a7-eacf-40e0-bcdf-2626301e1eee None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:35.028897 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e83a7-eacf-40e0-bcdf-2626301e1eee None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:35.029391 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e83a7-eacf-40e0-bcdf-2626301e1eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:35.065424 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9e7e83a7-eacf-40e0-bcdf-2626301e1eee None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:26:35.066699 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9e7e83a7-eacf-40e0-bcdf-2626301e1eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:26:35.092219 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 34/64] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:26:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:26:35.175611 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 31/65] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:26:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 03:26:35.195933 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec2889-e9c8-4072-a063-13c213a3a046 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:35.196231 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec2889-e9c8-4072-a063-13c213a3a046 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:35.196584 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec2889-e9c8-4072-a063-13c213a3a046 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:35.198212 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 35/66] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:26:35.203310 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d38bec-3224-44f7-a69f-4ace62e5d0af None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:35.203598 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d38bec-3224-44f7-a69f-4ace62e5d0af None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:35.203876 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d38bec-3224-44f7-a69f-4ace62e5d0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:35.230993 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f0d38bec-3224-44f7-a69f-4ace62e5d0af None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:26:35.232169 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f0d38bec-3224-44f7-a69f-4ace62e5d0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:26:35.250784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:35.323578 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 32/67] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:26:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:26:35.426171 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec2889-e9c8-4072-a063-13c213a3a046 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:35.431376 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d6823-77ba-4e73-910e-cd7dcf23d0a4 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:35.431900 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d6823-77ba-4e73-910e-cd7dcf23d0a4 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:35.432379 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d6823-77ba-4e73-910e-cd7dcf23d0a4 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:35.433968 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 33/68] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:26:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:26:35.440224 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e27db8-cebc-414a-a99c-5f099e4bd1a6 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:35.440824 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e27db8-cebc-414a-a99c-5f099e4bd1a6 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:35.441305 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e27db8-cebc-414a-a99c-5f099e4bd1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:35.456070 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:35.486222 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f7e27db8-cebc-414a-a99c-5f099e4bd1a6 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:26:35.488285 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f7e27db8-cebc-414a-a99c-5f099e4bd1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:26:35.572805 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec2889-e9c8-4072-a063-13c213a3a046 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:35.579846 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 34/69] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:26:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:26:35.580893 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e27db8-cebc-414a-a99c-5f099e4bd1a6 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:35.610981 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b6416-8f34-4971-a495-d22114d8b46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:35.611701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b6416-8f34-4971-a495-d22114d8b46e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:35.612052 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b6416-8f34-4971-a495-d22114d8b46e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:35.612400 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b6416-8f34-4971-a495-d22114d8b46e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:35.624969 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b6416-8f34-4971-a495-d22114d8b46e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:26:35.631602 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-2d2b6416-8f34-4971-a495-d22114d8b46e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 03:26:35.631602 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:26:35.631602 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:26:35.631602 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:26:35.631602 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:26:35.631602 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:26:35.631602 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:26:35.631602 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:26:35.631602 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:26:35.631602 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:26:35.631602 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:26:35.631602 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:26:35.631602 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:26:35.631602 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:26:35.631602 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:26:35.631602 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:26:35.632501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:26:35.632501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:26:35.632501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:26:35.632501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:26:35.632501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:26:35.632501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:26:35.632501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:26:35.632501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:26:35.632501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:26:35.632501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:26:35.632501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:26:35.632501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:26:35.632501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:26:35.632501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:26:35.632501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:26:35.632501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:26:35.633246 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:26:35.633246 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:26:35.633246 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:26:35.633246 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:26:35.633246 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:26:35.633246 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:26:35.633246 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:26:35.633246 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:26:35.633246 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:26:35.633246 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:26:35.633246 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 03:26:35.633246 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:26:35.633246 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 36/70] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 03:26:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:26:35.635262 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b6225-b0a7-494c-8cbb-4dc22fe4cfbb None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:35.635262 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b6225-b0a7-494c-8cbb-4dc22fe4cfbb None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:35.635262 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b6225-b0a7-494c-8cbb-4dc22fe4cfbb None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:35.636480 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 37/71] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:26:35.637122 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b6225-b0a7-494c-8cbb-4dc22fe4cfbb None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:35.680052 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:35.705384 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e27db8-cebc-414a-a99c-5f099e4bd1a6 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:35.724387 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:35.744441 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915fff58-f8ed-40aa-a312-a7d59372e96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:35.745082 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fff58-f8ed-40aa-a312-a7d59372e96c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:35.745372 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fff58-f8ed-40aa-a312-a7d59372e96c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:35.745675 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fff58-f8ed-40aa-a312-a7d59372e96c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:35.747611 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b6225-b0a7-494c-8cbb-4dc22fe4cfbb None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:35.756377 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915fff58-f8ed-40aa-a312-a7d59372e96c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:26:35.761911 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-915fff58-f8ed-40aa-a312-a7d59372e96c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 03:26:35.761911 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:26:35.761911 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:26:35.761911 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:26:35.761911 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:26:35.761911 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:26:35.761911 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:26:35.761911 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:26:35.761911 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:26:35.761911 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:26:35.761911 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:26:35.761911 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:26:35.761911 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:26:35.761911 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:26:35.761911 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:26:35.761911 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:26:35.762936 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:26:35.762936 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:26:35.762936 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:26:35.762936 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:26:35.762936 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:26:35.762936 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:26:35.762936 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:26:35.762936 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:26:35.762936 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:26:35.762936 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:26:35.762936 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:26:35.762936 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:26:35.762936 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:26:35.762936 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:26:35.762936 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:26:35.762936 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:26:35.763678 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:26:35.763678 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:26:35.763678 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:26:35.763678 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:26:35.763678 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:26:35.763678 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:26:35.763678 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:26:35.763678 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:26:35.763678 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:26:35.763678 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:26:35.763678 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 03:26:35.763678 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:26:35.763678 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 35/72] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:26:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:26:35.764297 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915fff58-f8ed-40aa-a312-a7d59372e96c None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:35.789934 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840b09b-82f4-4ce6-a353-349e915482a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:35.790600 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840b09b-82f4-4ce6-a353-349e915482a6 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:35.791965 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840b09b-82f4-4ce6-a353-349e915482a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:35.792245 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840b09b-82f4-4ce6-a353-349e915482a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:35.802495 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b840b09b-82f4-4ce6-a353-349e915482a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:26:35.808296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-b840b09b-82f4-4ce6-a353-349e915482a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:26:35.808296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:26:35.808296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:26:35.808296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:26:35.808296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:26:35.808296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:26:35.808296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:26:35.808296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:26:35.808296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:26:35.808296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:26:35.808296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:26:35.808296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:26:35.808296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:26:35.808296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:26:35.808296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:26:35.808296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:26:35.809133 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:26:35.809133 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:26:35.809133 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:26:35.809133 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:26:35.809133 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:26:35.809133 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:26:35.809133 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:26:35.809133 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:26:35.809133 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:26:35.809133 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:26:35.809133 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:26:35.809133 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:26:35.809133 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:26:35.809133 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:26:35.809133 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:26:35.809133 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:26:35.810353 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:26:35.810353 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:26:35.810353 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:26:35.810353 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:26:35.810353 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:26:35.810353 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:26:35.810353 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:26:35.810353 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:26:35.810353 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:26:35.810353 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:26:35.810353 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:26:35.810353 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:26:35.810353 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 38/73] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 03:26:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:26:35.811277 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b4121-a5c5-4958-823b-009d7513f390 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:35.811786 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b4121-a5c5-4958-823b-009d7513f390 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:35.812234 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b4121-a5c5-4958-823b-009d7513f390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:35.829904 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1a0b4121-a5c5-4958-823b-009d7513f390 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:26:35.831092 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1a0b4121-a5c5-4958-823b-009d7513f390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:26:35.871075 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915fff58-f8ed-40aa-a312-a7d59372e96c None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:35.896219 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 39/74] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:26:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:26:35.897133 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b4121-a5c5-4958-823b-009d7513f390 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:35.916371 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2409e62-3c2a-4374-9c85-e4bfa7e6a3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:35.917232 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2409e62-3c2a-4374-9c85-e4bfa7e6a3e7 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:35.917748 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2409e62-3c2a-4374-9c85-e4bfa7e6a3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:35.918176 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2409e62-3c2a-4374-9c85-e4bfa7e6a3e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:35.918829 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2409e62-3c2a-4374-9c85-e4bfa7e6a3e7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:26:35.919140 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2409e62-3c2a-4374-9c85-e4bfa7e6a3e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:35.920509 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2409e62-3c2a-4374-9c85-e4bfa7e6a3e7 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:35.929677 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 36/75] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:26:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:35.930453 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2409e62-3c2a-4374-9c85-e4bfa7e6a3e7 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:35.932963 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:35.970328 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:36.004239 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b4121-a5c5-4958-823b-009d7513f390 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:36.039861 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476fdcd-eb38-47ea-a33a-9944bb8077ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:36.041058 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476fdcd-eb38-47ea-a33a-9944bb8077ba None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:36.041338 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476fdcd-eb38-47ea-a33a-9944bb8077ba None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:36.041609 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476fdcd-eb38-47ea-a33a-9944bb8077ba None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:36.042303 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476fdcd-eb38-47ea-a33a-9944bb8077ba None admin] RBAC: Adding query filter params (name=member) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:26:36.042605 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476fdcd-eb38-47ea-a33a-9944bb8077ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:36.043879 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2409e62-3c2a-4374-9c85-e4bfa7e6a3e7 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:36.044298 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476fdcd-eb38-47ea-a33a-9944bb8077ba None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:36.053682 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 40/76] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 03:26:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:36.053682 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476fdcd-eb38-47ea-a33a-9944bb8077ba None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:36.083619 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35a59a-a990-4ed3-87da-fd69d4ab2b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:36.084243 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35a59a-a990-4ed3-87da-fd69d4ab2b45 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:36.084529 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35a59a-a990-4ed3-87da-fd69d4ab2b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:36.084810 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35a59a-a990-4ed3-87da-fd69d4ab2b45 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:36.085477 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35a59a-a990-4ed3-87da-fd69d4ab2b45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:26:36.085833 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35a59a-a990-4ed3-87da-fd69d4ab2b45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:36.087836 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35a59a-a990-4ed3-87da-fd69d4ab2b45 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:36.100738 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 37/77] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:26:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:36.100738 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35a59a-a990-4ed3-87da-fd69d4ab2b45 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:36.163740 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:36.167142 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476fdcd-eb38-47ea-a33a-9944bb8077ba None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:36.193923 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:36.200061 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf33f77-9b57-412c-ad2d-0683363d0b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:36.200695 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf33f77-9b57-412c-ad2d-0683363d0b31 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:36.200788 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35a59a-a990-4ed3-87da-fd69d4ab2b45 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:36.200980 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf33f77-9b57-412c-ad2d-0683363d0b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:36.201255 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf33f77-9b57-412c-ad2d-0683363d0b31 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:36.202426 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf33f77-9b57-412c-ad2d-0683363d0b31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:36.203879 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf33f77-9b57-412c-ad2d-0683363d0b31 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:36.205423 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 41/78] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:26:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:36.206210 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf33f77-9b57-412c-ad2d-0683363d0b31 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:36.236414 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91a64e-1f84-407f-b18b-87e445a19c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:36.237038 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91a64e-1f84-407f-b18b-87e445a19c2c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:36.237331 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91a64e-1f84-407f-b18b-87e445a19c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:36.237610 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91a64e-1f84-407f-b18b-87e445a19c2c None admin] PATH_INFO: `/v3/users/8b1624609cc944cd86ca9c71ee9d61d0` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:36.252106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91a64e-1f84-407f-b18b-87e445a19c2c None admin] RBAC: Authorizing `identity:get_user(user_id=8b1624609cc944cd86ca9c71ee9d61d0)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:36.253556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91a64e-1f84-407f-b18b-87e445a19c2c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:36.255217 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 38/79] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:26:36 2022] GET /identity/v3/users/8b1624609cc944cd86ca9c71ee9d61d0 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:36.256006 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91a64e-1f84-407f-b18b-87e445a19c2c None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:36.309828 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf33f77-9b57-412c-ad2d-0683363d0b31 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:36.343833 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474376b-3b45-4d93-a8e1-f80286acd1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:36.344463 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474376b-3b45-4d93-a8e1-f80286acd1b2 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:36.344742 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474376b-3b45-4d93-a8e1-f80286acd1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:36.345021 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474376b-3b45-4d93-a8e1-f80286acd1b2 None admin] PATH_INFO: `/v3/users/8b1624609cc944cd86ca9c71ee9d61d0` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:36.346178 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a474376b-3b45-4d93-a8e1-f80286acd1b2 None admin] RBAC: Authorizing `identity:get_user(user_id=8b1624609cc944cd86ca9c71ee9d61d0)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:36.347644 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a474376b-3b45-4d93-a8e1-f80286acd1b2 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:36.349192 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 42/80] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:26:36 2022] GET /identity/v3/users/8b1624609cc944cd86ca9c71ee9d61d0 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:36.349974 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474376b-3b45-4d93-a8e1-f80286acd1b2 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:36.354107 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91a64e-1f84-407f-b18b-87e445a19c2c None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:36.375947 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:36.387711 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c3131-8811-4e78-9ea1-55412e50b07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:36.388348 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c3131-8811-4e78-9ea1-55412e50b07a None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:36.388638 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c3131-8811-4e78-9ea1-55412e50b07a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:36.388914 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c3131-8811-4e78-9ea1-55412e50b07a None admin] PATH_INFO: `/v3/users/a6d47188867a4d9384390f05eba70a8c` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:36.390083 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c3131-8811-4e78-9ea1-55412e50b07a None admin] RBAC: Authorizing `identity:get_user(user_id=a6d47188867a4d9384390f05eba70a8c)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:36.393023 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c3131-8811-4e78-9ea1-55412e50b07a None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:36.393114 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 39/81] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:26:36 2022] GET /identity/v3/users/a6d47188867a4d9384390f05eba70a8c => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:36.395248 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c3131-8811-4e78-9ea1-55412e50b07a None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:36.420449 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:36.454698 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474376b-3b45-4d93-a8e1-f80286acd1b2 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:36.487724 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671cacf-0619-4817-b42e-ef72e7e6ef31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:36.488361 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671cacf-0619-4817-b42e-ef72e7e6ef31 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:36.488649 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671cacf-0619-4817-b42e-ef72e7e6ef31 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:36.488934 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671cacf-0619-4817-b42e-ef72e7e6ef31 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:36.495422 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c3131-8811-4e78-9ea1-55412e50b07a None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:36.498780 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671cacf-0619-4817-b42e-ef72e7e6ef31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:26:36.504134 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-e671cacf-0619-4817-b42e-ef72e7e6ef31 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 03:26:36.504134 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:26:36.504134 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:26:36.504134 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:26:36.504134 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:26:36.504134 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:26:36.504134 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:26:36.504134 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:26:36.504134 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:26:36.504134 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:26:36.504134 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:26:36.504134 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:26:36.504134 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:26:36.504134 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:26:36.504134 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:26:36.504134 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:26:36.505101 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:26:36.505101 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:26:36.505101 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:26:36.505101 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:26:36.505101 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:26:36.505101 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:26:36.505101 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:26:36.505101 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:26:36.505101 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:26:36.505101 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:26:36.505101 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:26:36.505101 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:26:36.505101 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:26:36.505101 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:26:36.505101 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:26:36.505101 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:26:36.506297 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:26:36.506297 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:26:36.506297 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:26:36.506297 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:26:36.506297 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:26:36.506297 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:26:36.506297 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:26:36.506297 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:26:36.506297 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:26:36.506297 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:26:36.506297 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 03:26:36.506297 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:26:36.506297 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 43/82] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:26:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:26:36.506297 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671cacf-0619-4817-b42e-ef72e7e6ef31 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:36.530978 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0213b4d-95f0-4d4c-8333-006395ba349a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:36.531592 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0213b4d-95f0-4d4c-8333-006395ba349a None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:36.531883 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0213b4d-95f0-4d4c-8333-006395ba349a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:36.532170 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0213b4d-95f0-4d4c-8333-006395ba349a None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:36.532830 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0213b4d-95f0-4d4c-8333-006395ba349a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:36.534313 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0213b4d-95f0-4d4c-8333-006395ba349a None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:36.604444 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671cacf-0619-4817-b42e-ef72e7e6ef31 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:36.612096 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 40/83] 10.222.0.33 () {60 vars in 1132 bytes} [Fri Sep 16 03:26:36 2022] POST /identity/v3/users => generated 289 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:26:36.612998 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0213b4d-95f0-4d4c-8333-006395ba349a None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:36.636036 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:36.646712 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f08be8-dfaa-4ee6-b456-07af352e5460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:36.647367 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f08be8-dfaa-4ee6-b456-07af352e5460 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:36.647655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f08be8-dfaa-4ee6-b456-07af352e5460 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:36.647939 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f08be8-dfaa-4ee6-b456-07af352e5460 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:36.682049 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:36.728832 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f08be8-dfaa-4ee6-b456-07af352e5460 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:36.730561 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f08be8-dfaa-4ee6-b456-07af352e5460 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:36.751890 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0213b4d-95f0-4d4c-8333-006395ba349a None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:36.795651 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d441b-c292-42bd-9226-7b81ae6c5448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:36.796233 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d441b-c292-42bd-9226-7b81ae6c5448 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:36.796520 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d441b-c292-42bd-9226-7b81ae6c5448 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:36.796798 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d441b-c292-42bd-9226-7b81ae6c5448 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:36.839585 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 44/84] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:26:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 03:26:36.840454 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f08be8-dfaa-4ee6-b456-07af352e5460 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:36.870999 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:36.887257 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d441b-c292-42bd-9226-7b81ae6c5448 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:36.889067 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d441b-c292-42bd-9226-7b81ae6c5448 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:36.944536 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:36.962381 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f08be8-dfaa-4ee6-b456-07af352e5460 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:37.004014 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e6f2d-eef5-4c55-baf4-f78fe8be85e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:37.004645 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e6f2d-eef5-4c55-baf4-f78fe8be85e4 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:37.004866 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e6f2d-eef5-4c55-baf4-f78fe8be85e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:37.005146 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e6f2d-eef5-4c55-baf4-f78fe8be85e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:37.020000 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 41/85] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:26:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 03:26:37.020000 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d441b-c292-42bd-9226-7b81ae6c5448 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:37.078811 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e6f2d-eef5-4c55-baf4-f78fe8be85e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:37.080313 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e6f2d-eef5-4c55-baf4-f78fe8be85e4 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:37.108371 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:37.144212 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d441b-c292-42bd-9226-7b81ae6c5448 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:37.184648 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468fc55e-211e-4c3c-9ccb-70a7aa8775a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:37.185505 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fc55e-211e-4c3c-9ccb-70a7aa8775a9 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:37.185991 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fc55e-211e-4c3c-9ccb-70a7aa8775a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:37.186411 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fc55e-211e-4c3c-9ccb-70a7aa8775a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:37.186903 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 45/86] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:26:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 03:26:37.187426 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468fc55e-211e-4c3c-9ccb-70a7aa8775a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:26:37.187760 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e6f2d-eef5-4c55-baf4-f78fe8be85e4 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:37.188112 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468fc55e-211e-4c3c-9ccb-70a7aa8775a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:37.189763 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468fc55e-211e-4c3c-9ccb-70a7aa8775a9 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:37.199336 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 42/87] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 03:26:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:37.200429 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468fc55e-211e-4c3c-9ccb-70a7aa8775a9 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:37.213171 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:37.314604 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e6f2d-eef5-4c55-baf4-f78fe8be85e4 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:37.315199 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468fc55e-211e-4c3c-9ccb-70a7aa8775a9 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:37.346043 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:37.358191 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe0a9b-51c9-46b7-803a-833b37b0bc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:37.358835 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe0a9b-51c9-46b7-803a-833b37b0bc0f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:37.359118 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe0a9b-51c9-46b7-803a-833b37b0bc0f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:37.360830 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe0a9b-51c9-46b7-803a-833b37b0bc0f None admin] PATH_INFO: `/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:37.361065 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe0a9b-51c9-46b7-803a-833b37b0bc0f None admin] RBAC: Authorizing `identity:get_project(project_id=e01bdca6ef9f47b192f68f70ff0bbdad)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:37.362611 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe0a9b-51c9-46b7-803a-833b37b0bc0f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:37.364240 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 46/88] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:26:37 2022] GET /identity/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:37.369744 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe0a9b-51c9-46b7-803a-833b37b0bc0f None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:37.369880 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315a0e8-cf71-411c-bb96-41edaa85ebe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:37.369880 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315a0e8-cf71-411c-bb96-41edaa85ebe8 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:37.369880 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315a0e8-cf71-411c-bb96-41edaa85ebe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:37.369880 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315a0e8-cf71-411c-bb96-41edaa85ebe8 None admin] PATH_INFO: `/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:37.370682 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315a0e8-cf71-411c-bb96-41edaa85ebe8 None admin] RBAC: Authorizing `identity:get_project(project_id=e01bdca6ef9f47b192f68f70ff0bbdad)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:37.372191 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315a0e8-cf71-411c-bb96-41edaa85ebe8 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:37.380470 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 43/89] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:26:37 2022] GET /identity/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:37.381353 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315a0e8-cf71-411c-bb96-41edaa85ebe8 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:37.470961 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:37.497910 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315a0e8-cf71-411c-bb96-41edaa85ebe8 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:37.499209 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe0a9b-51c9-46b7-803a-833b37b0bc0f None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:37.535835 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26594fc1-50c0-462f-86ed-2292d5a66953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:37.536635 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26594fc1-50c0-462f-86ed-2292d5a66953 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:37.537001 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26594fc1-50c0-462f-86ed-2292d5a66953 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:37.537194 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26594fc1-50c0-462f-86ed-2292d5a66953 None admin] PATH_INFO: `/v3/users/8b1624609cc944cd86ca9c71ee9d61d0` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:37.538491 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26594fc1-50c0-462f-86ed-2292d5a66953 None admin] RBAC: Authorizing `identity:get_user(user_id=8b1624609cc944cd86ca9c71ee9d61d0)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:37.541509 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26594fc1-50c0-462f-86ed-2292d5a66953 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:37.543195 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 44/90] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:26:37 2022] GET /identity/v3/users/8b1624609cc944cd86ca9c71ee9d61d0 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:37.544067 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26594fc1-50c0-462f-86ed-2292d5a66953 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:37.545859 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edceae89-9b6e-4bd7-bc30-8b2adbeab642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:37.546801 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edceae89-9b6e-4bd7-bc30-8b2adbeab642 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:37.547408 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edceae89-9b6e-4bd7-bc30-8b2adbeab642 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:37.548057 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edceae89-9b6e-4bd7-bc30-8b2adbeab642 None admin] PATH_INFO: `/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:37.550331 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edceae89-9b6e-4bd7-bc30-8b2adbeab642 None admin] RBAC: Authorizing `identity:get_project(project_id=e01bdca6ef9f47b192f68f70ff0bbdad)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:37.552026 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edceae89-9b6e-4bd7-bc30-8b2adbeab642 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:37.553870 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 47/91] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:26:37 2022] GET /identity/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:37.555251 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edceae89-9b6e-4bd7-bc30-8b2adbeab642 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:37.630503 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:37.670708 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26594fc1-50c0-462f-86ed-2292d5a66953 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:37.680906 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edceae89-9b6e-4bd7-bc30-8b2adbeab642 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:37.715362 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1213e9e-0ff2-4c3b-93e4-55e34894d399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:37.716036 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1213e9e-0ff2-4c3b-93e4-55e34894d399 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:37.716284 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1213e9e-0ff2-4c3b-93e4-55e34894d399 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:37.716586 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1213e9e-0ff2-4c3b-93e4-55e34894d399 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:37.717317 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1213e9e-0ff2-4c3b-93e4-55e34894d399 None admin] RBAC: Adding query filter params (role.id=fcb362c8a9fd47fbbb6b14397cae171c, scope.project.id=e01bdca6ef9f47b192f68f70ff0bbdad, user.id=8b1624609cc944cd86ca9c71ee9d61d0) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:26:37.717650 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1213e9e-0ff2-4c3b-93e4-55e34894d399 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:37.719967 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1213e9e-0ff2-4c3b-93e4-55e34894d399 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:37.731386 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 45/92] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:26:37 2022] GET /identity/v3/role_assignments?user.id=8b1624609cc944cd86ca9c71ee9d61d0&scope.project.id=e01bdca6ef9f47b192f68f70ff0bbdad&role.id=fcb362c8a9fd47fbbb6b14397cae171c => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:37.731910 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15294e1c-1781-4612-87bd-421d35e14526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:37.732203 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1213e9e-0ff2-4c3b-93e4-55e34894d399 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:37.733084 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15294e1c-1781-4612-87bd-421d35e14526 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:37.733769 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15294e1c-1781-4612-87bd-421d35e14526 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:37.734241 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15294e1c-1781-4612-87bd-421d35e14526 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:37.735169 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15294e1c-1781-4612-87bd-421d35e14526 None admin] RBAC: Adding query filter params (role.id=7591562cf9564b288c108609d8e334b3, scope.project.id=e01bdca6ef9f47b192f68f70ff0bbdad, user.id=8b1624609cc944cd86ca9c71ee9d61d0) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:26:37.735678 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15294e1c-1781-4612-87bd-421d35e14526 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:37.737373 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15294e1c-1781-4612-87bd-421d35e14526 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:37.749547 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 48/93] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:26:37 2022] GET /identity/v3/role_assignments?user.id=8b1624609cc944cd86ca9c71ee9d61d0&scope.project.id=e01bdca6ef9f47b192f68f70ff0bbdad&role.id=7591562cf9564b288c108609d8e334b3 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:37.750866 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15294e1c-1781-4612-87bd-421d35e14526 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:37.756842 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:37.987261 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15294e1c-1781-4612-87bd-421d35e14526 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:38.011748 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1213e9e-0ff2-4c3b-93e4-55e34894d399 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:38.028921 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:38.050470 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba2ebf-0838-4c5a-a369-717e8ba40c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:38.051099 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba2ebf-0838-4c5a-a369-717e8ba40c50 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:38.051383 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba2ebf-0838-4c5a-a369-717e8ba40c50 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:38.051661 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba2ebf-0838-4c5a-a369-717e8ba40c50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:38.052405 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba2ebf-0838-4c5a-a369-717e8ba40c50 None admin] RBAC: Adding query filter params (role.id=4ffac54101e248479bcdc0e54890020f, scope.project.id=e01bdca6ef9f47b192f68f70ff0bbdad, user.id=a6d47188867a4d9384390f05eba70a8c) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:26:38.052716 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba2ebf-0838-4c5a-a369-717e8ba40c50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:38.054226 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba2ebf-0838-4c5a-a369-717e8ba40c50 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:38.067828 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 49/94] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:26:37 2022] GET /identity/v3/role_assignments?user.id=a6d47188867a4d9384390f05eba70a8c&scope.project.id=e01bdca6ef9f47b192f68f70ff0bbdad&role.id=4ffac54101e248479bcdc0e54890020f => generated 259 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:38.083443 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc95a3-4fb1-4de0-94ff-44645cada5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:38.084099 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc95a3-4fb1-4de0-94ff-44645cada5d4 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:38.084388 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc95a3-4fb1-4de0-94ff-44645cada5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:38.084669 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc95a3-4fb1-4de0-94ff-44645cada5d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:38.180443 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc95a3-4fb1-4de0-94ff-44645cada5d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:38.182007 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc95a3-4fb1-4de0-94ff-44645cada5d4 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:38.197355 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:38.313879 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 46/95] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:26:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 03:26:38.319822 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba2ebf-0838-4c5a-a369-717e8ba40c50 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:38.457535 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba2ebf-0838-4c5a-a369-717e8ba40c50 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:38.503248 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963a61e-a3a9-46c0-92bb-c98ba2343d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:38.504231 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963a61e-a3a9-46c0-92bb-c98ba2343d67 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:38.504741 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963a61e-a3a9-46c0-92bb-c98ba2343d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:38.505245 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963a61e-a3a9-46c0-92bb-c98ba2343d67 None admin] PATH_INFO: `/v3/projects/e4619c468b984829b2b07ecd02f668d2` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:38.506681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7963a61e-a3a9-46c0-92bb-c98ba2343d67 None admin] RBAC: Authorizing `identity:get_project(project_id=e4619c468b984829b2b07ecd02f668d2)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:38.508341 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7963a61e-a3a9-46c0-92bb-c98ba2343d67 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:38.510877 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 50/96] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:26:38 2022] GET /identity/v3/projects/e4619c468b984829b2b07ecd02f668d2 => generated 312 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:38.516793 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc95a3-4fb1-4de0-94ff-44645cada5d4 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:38.631003 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc95a3-4fb1-4de0-94ff-44645cada5d4 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:38.643506 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:38.677133 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f5c3f5-4fd8-4e48-80bf-08d70b9d4ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:38.677793 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5c3f5-4fd8-4e48-80bf-08d70b9d4ef2 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:38.678080 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5c3f5-4fd8-4e48-80bf-08d70b9d4ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:38.678368 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5c3f5-4fd8-4e48-80bf-08d70b9d4ef2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:38.679112 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f5c3f5-4fd8-4e48-80bf-08d70b9d4ef2 None admin] RBAC: Adding query filter params (role.id=7591562cf9564b288c108609d8e334b3, scope.project.id=e4619c468b984829b2b07ecd02f668d2, user.id=8b1624609cc944cd86ca9c71ee9d61d0) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:26:38.679425 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f5c3f5-4fd8-4e48-80bf-08d70b9d4ef2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:38.680953 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f5c3f5-4fd8-4e48-80bf-08d70b9d4ef2 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:38.687071 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 47/97] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:26:38 2022] GET /identity/v3/role_assignments?user.id=8b1624609cc944cd86ca9c71ee9d61d0&scope.project.id=e4619c468b984829b2b07ecd02f668d2&role.id=7591562cf9564b288c108609d8e334b3 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:39.299701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ca330-0b67-40e6-b1bc-525945dede6c None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:39.300208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ca330-0b67-40e6-b1bc-525945dede6c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:39.300279 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ca330-0b67-40e6-b1bc-525945dede6c None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:39.301762 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 51/98] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:26:39.307104 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990a732-c6c1-4295-be8a-e3750c103ae9 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:39.307487 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990a732-c6c1-4295-be8a-e3750c103ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:39.307670 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990a732-c6c1-4295-be8a-e3750c103ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:39.330600 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0990a732-c6c1-4295-be8a-e3750c103ae9 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:26:39.331808 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0990a732-c6c1-4295-be8a-e3750c103ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:26:39.415614 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 48/99] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:26:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:26:39.665579 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d336f-24c0-4f10-a536-394441bab0c9 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:39.665936 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d336f-24c0-4f10-a536-394441bab0c9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:39.666115 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d336f-24c0-4f10-a536-394441bab0c9 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:39.667607 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 52/100] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:26:39.673241 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122bbb7-b32c-469a-9c5f-04534bdfeca2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:39.673551 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122bbb7-b32c-469a-9c5f-04534bdfeca2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:39.673870 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122bbb7-b32c-469a-9c5f-04534bdfeca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:39.702000 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9122bbb7-b32c-469a-9c5f-04534bdfeca2 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:26:39.703228 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9122bbb7-b32c-469a-9c5f-04534bdfeca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:26:39.779529 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 49/101] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:26:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:26:39.945420 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d336f-24c0-4f10-a536-394441bab0c9 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:40.026675 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:40.093430 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d336f-24c0-4f10-a536-394441bab0c9 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:40.139266 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007a750-9c8b-4b89-b063-7904bb1c560a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:40.139969 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007a750-9c8b-4b89-b063-7904bb1c560a None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:40.140264 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007a750-9c8b-4b89-b063-7904bb1c560a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:40.140546 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007a750-9c8b-4b89-b063-7904bb1c560a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:40.141702 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4007a750-9c8b-4b89-b063-7904bb1c560a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:40.143203 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4007a750-9c8b-4b89-b063-7904bb1c560a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:40.144788 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 53/102] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:26:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:40.150633 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122bbb7-b32c-469a-9c5f-04534bdfeca2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:40.201806 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:40.208815 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007a750-9c8b-4b89-b063-7904bb1c560a None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:40.297567 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122bbb7-b32c-469a-9c5f-04534bdfeca2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:40.339844 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73e92e-0946-4b74-b49d-c5cba9f4741e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:40.340477 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73e92e-0946-4b74-b49d-c5cba9f4741e None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:40.341063 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73e92e-0946-4b74-b49d-c5cba9f4741e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:40.341485 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73e92e-0946-4b74-b49d-c5cba9f4741e None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:40.342317 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b73e92e-0946-4b74-b49d-c5cba9f4741e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:40.343951 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b73e92e-0946-4b74-b49d-c5cba9f4741e None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:40.425386 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007a750-9c8b-4b89-b063-7904bb1c560a None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:40.456909 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 50/103] 10.222.0.33 () {60 vars in 1141 bytes} [Fri Sep 16 03:26:40 2022] POST /identity/v3/projects => generated 302 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:26:40.463321 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:40.476504 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ffaad-b77f-4375-b3cb-20bcf209fa8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:40.480821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ffaad-b77f-4375-b3cb-20bcf209fa8e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:40.480821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ffaad-b77f-4375-b3cb-20bcf209fa8e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:40.480821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ffaad-b77f-4375-b3cb-20bcf209fa8e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:40.498365 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ffaad-b77f-4375-b3cb-20bcf209fa8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:26:40.504365 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-e03ffaad-b77f-4375-b3cb-20bcf209fa8e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 03:26:40.504365 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:26:40.504365 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:26:40.504365 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:26:40.504365 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:26:40.504365 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:26:40.504365 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:26:40.504365 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:26:40.504365 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:26:40.504365 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:26:40.504365 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:26:40.504365 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:26:40.504365 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:26:40.504365 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:26:40.504365 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:26:40.504365 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:26:40.505490 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:26:40.505490 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:26:40.505490 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:26:40.505490 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:26:40.505490 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:26:40.505490 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:26:40.505490 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:26:40.505490 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:26:40.505490 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:26:40.505490 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:26:40.505490 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:26:40.505490 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:26:40.505490 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:26:40.505490 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:26:40.505490 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:26:40.505490 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:26:40.506436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:26:40.506436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:26:40.506436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:26:40.506436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:26:40.506436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:26:40.506436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:26:40.506436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:26:40.506436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:26:40.506436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:26:40.506436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:26:40.506436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 03:26:40.506436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:26:40.511259 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 54/104] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:26:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:26:40.517419 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73e92e-0946-4b74-b49d-c5cba9f4741e None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:40.631860 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:40.655685 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73e92e-0946-4b74-b49d-c5cba9f4741e None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:40.707495 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad35e8e-9817-4424-a314-c12d68c23f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:40.708078 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad35e8e-9817-4424-a314-c12d68c23f96 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:40.708364 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad35e8e-9817-4424-a314-c12d68c23f96 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:40.708638 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad35e8e-9817-4424-a314-c12d68c23f96 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:40.709338 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad35e8e-9817-4424-a314-c12d68c23f96 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:26:40.709659 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad35e8e-9817-4424-a314-c12d68c23f96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:40.711080 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad35e8e-9817-4424-a314-c12d68c23f96 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:40.723939 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 51/105] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 03:26:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:40.726327 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ffaad-b77f-4375-b3cb-20bcf209fa8e None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:40.882649 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ffaad-b77f-4375-b3cb-20bcf209fa8e None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:40.924132 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e6340-1589-45b8-b225-c2f7f90cde54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:40.924778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e6340-1589-45b8-b225-c2f7f90cde54 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:40.925066 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e6340-1589-45b8-b225-c2f7f90cde54 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:40.925351 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e6340-1589-45b8-b225-c2f7f90cde54 None admin] PATH_INFO: `/v3/users/1644481571e5426f870870bbf4682548` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:40.944501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e6340-1589-45b8-b225-c2f7f90cde54 None admin] RBAC: Authorizing `identity:get_user(user_id=1644481571e5426f870870bbf4682548)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:40.946020 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e6340-1589-45b8-b225-c2f7f90cde54 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:40.947817 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 55/106] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:26:40 2022] GET /identity/v3/users/1644481571e5426f870870bbf4682548 => generated 289 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:40.949874 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa3c82-a6df-49b9-8744-15eaeb4e67a6 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:40.950383 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa3c82-a6df-49b9-8744-15eaeb4e67a6 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:40.950876 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa3c82-a6df-49b9-8744-15eaeb4e67a6 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:40.952322 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 52/107] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:26:40.953273 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e6340-1589-45b8-b225-c2f7f90cde54 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:40.959394 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37799a72-f01c-443a-8507-b773872a9922 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:40.959394 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37799a72-f01c-443a-8507-b773872a9922 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:40.959593 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37799a72-f01c-443a-8507-b773872a9922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:40.980230 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-37799a72-f01c-443a-8507-b773872a9922 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:26:40.981454 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-37799a72-f01c-443a-8507-b773872a9922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:26:41.046260 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:41.108586 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 53/108] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:26:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:26:41.113596 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88f247-ad56-4cfe-ba1f-25361e16070e None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:41.113918 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88f247-ad56-4cfe-ba1f-25361e16070e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:41.114201 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88f247-ad56-4cfe-ba1f-25361e16070e None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:41.116665 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 54/109] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:26:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:26:41.122620 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfffb463-8eb8-415a-960f-afbab0780e8b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:41.122912 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfffb463-8eb8-415a-960f-afbab0780e8b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:41.123193 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfffb463-8eb8-415a-960f-afbab0780e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:41.141681 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-cfffb463-8eb8-415a-960f-afbab0780e8b None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:26:41.142900 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cfffb463-8eb8-415a-960f-afbab0780e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:26:41.150017 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e6340-1589-45b8-b225-c2f7f90cde54 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:41.214960 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 55/110] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:26:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 03:26:41.215267 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8cb2dd-583d-482f-aea8-0aa265d4862a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:41.215896 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8cb2dd-583d-482f-aea8-0aa265d4862a None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:41.216183 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8cb2dd-583d-482f-aea8-0aa265d4862a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:41.216464 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8cb2dd-583d-482f-aea8-0aa265d4862a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:41.325698 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8cb2dd-583d-482f-aea8-0aa265d4862a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:41.327208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8cb2dd-583d-482f-aea8-0aa265d4862a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:41.401789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:41.515646 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 56/111] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:26:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 03:26:41.516312 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfffb463-8eb8-415a-960f-afbab0780e8b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:41.516312 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:41.549836 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8cb2dd-583d-482f-aea8-0aa265d4862a None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:41.620655 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfffb463-8eb8-415a-960f-afbab0780e8b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:41.658843 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a79bfa-3a69-4475-84ed-edcff9dfb80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:41.659542 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a79bfa-3a69-4475-84ed-edcff9dfb80f None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:41.659840 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a79bfa-3a69-4475-84ed-edcff9dfb80f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:41.660179 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a79bfa-3a69-4475-84ed-edcff9dfb80f None admin] PATH_INFO: `/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:41.661343 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a79bfa-3a69-4475-84ed-edcff9dfb80f None admin] RBAC: Authorizing `identity:get_project(project_id=e01bdca6ef9f47b192f68f70ff0bbdad)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:41.662862 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a79bfa-3a69-4475-84ed-edcff9dfb80f None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:41.665541 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 56/112] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:26:41 2022] GET /identity/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:41.666493 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a79bfa-3a69-4475-84ed-edcff9dfb80f None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:41.768277 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8cb2dd-583d-482f-aea8-0aa265d4862a None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:41.782025 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:41.790870 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a79bfa-3a69-4475-84ed-edcff9dfb80f None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:41.838064 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609d895-8b71-4a0a-83af-8a3575f9aec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:41.838720 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609d895-8b71-4a0a-83af-8a3575f9aec5 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:41.839170 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609d895-8b71-4a0a-83af-8a3575f9aec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:41.839458 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609d895-8b71-4a0a-83af-8a3575f9aec5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:41.849926 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea192fd5-07a1-406e-bada-b17458adf398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:41.850642 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea192fd5-07a1-406e-bada-b17458adf398 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:41.851025 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea192fd5-07a1-406e-bada-b17458adf398 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:41.851380 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea192fd5-07a1-406e-bada-b17458adf398 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:41.852428 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5609d895-8b71-4a0a-83af-8a3575f9aec5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:26:41.858174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-5609d895-8b71-4a0a-83af-8a3575f9aec5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 03:26:41.858174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:26:41.858174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:26:41.858174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:26:41.858174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:26:41.858174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:26:41.858174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:26:41.858174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:26:41.858174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:26:41.858174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:26:41.858174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:26:41.858174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:26:41.858174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:26:41.858174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:26:41.858174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:26:41.858174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:26:41.859048 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:26:41.859048 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:26:41.859048 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:26:41.859048 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:26:41.859048 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:26:41.859048 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:26:41.859048 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:26:41.859048 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:26:41.859048 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:26:41.859048 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:26:41.859048 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:26:41.859048 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:26:41.859048 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:26:41.859048 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:26:41.859048 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:26:41.859048 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:26:41.859890 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:26:41.859890 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:26:41.859890 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:26:41.859890 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:26:41.859890 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:26:41.859890 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:26:41.859890 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:26:41.859890 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:26:41.859890 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:26:41.859890 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:26:41.859890 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 03:26:41.859890 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:26:41.859890 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 57/113] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 03:26:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:26:41.860897 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609d895-8b71-4a0a-83af-8a3575f9aec5 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:41.863127 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea192fd5-07a1-406e-bada-b17458adf398 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:26:41.865384 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:41.870315 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-ea192fd5-07a1-406e-bada-b17458adf398 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 03:26:41.870315 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:26:41.870315 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:26:41.870315 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:26:41.870315 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:26:41.870315 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:26:41.870315 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:26:41.870315 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:26:41.870315 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:26:41.870315 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:26:41.870315 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:26:41.870315 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:26:41.870315 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:26:41.870315 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:26:41.870315 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:26:41.870315 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:26:41.871161 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:26:41.871161 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:26:41.871161 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:26:41.871161 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:26:41.871161 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:26:41.871161 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:26:41.871161 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:26:41.871161 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:26:41.871161 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:26:41.871161 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:26:41.871161 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:26:41.871161 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:26:41.871161 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:26:41.871161 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:26:41.871161 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:26:41.871161 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:26:41.871919 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:26:41.871919 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:26:41.871919 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:26:41.871919 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:26:41.871919 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:26:41.871919 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:26:41.871919 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:26:41.871919 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:26:41.871919 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:26:41.871919 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:26:41.871919 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 03:26:41.871919 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:26:41.871919 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 57/114] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:26:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:26:41.873121 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b1519-8726-4352-93c2-a4edafd7a0b7 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:41.875688 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b1519-8726-4352-93c2-a4edafd7a0b7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:41.875688 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b1519-8726-4352-93c2-a4edafd7a0b7 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:41.875688 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 58/115] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:26:41.882187 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b1519-8726-4352-93c2-a4edafd7a0b7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:41.978625 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609d895-8b71-4a0a-83af-8a3575f9aec5 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:42.014208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9966e3-ce77-4ad5-8cb5-bfcff72405b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:42.014920 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9966e3-ce77-4ad5-8cb5-bfcff72405b2 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:42.015429 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9966e3-ce77-4ad5-8cb5-bfcff72405b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:42.015781 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9966e3-ce77-4ad5-8cb5-bfcff72405b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:42.016602 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9966e3-ce77-4ad5-8cb5-bfcff72405b2 None admin] RBAC: Adding query filter params (role.id=35fd8044264e4590a6dcfeabaf194c78, scope.project.id=e01bdca6ef9f47b192f68f70ff0bbdad, user.id=1644481571e5426f870870bbf4682548) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:26:42.017060 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9966e3-ce77-4ad5-8cb5-bfcff72405b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:42.018682 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9966e3-ce77-4ad5-8cb5-bfcff72405b2 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:42.022719 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b1519-8726-4352-93c2-a4edafd7a0b7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:42.029972 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 58/116] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:26:41 2022] GET /identity/v3/role_assignments?user.id=1644481571e5426f870870bbf4682548&scope.project.id=e01bdca6ef9f47b192f68f70ff0bbdad&role.id=35fd8044264e4590a6dcfeabaf194c78 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:42.031007 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9966e3-ce77-4ad5-8cb5-bfcff72405b2 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:42.065452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec9571-bd66-4fb8-a588-a1301d63a9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:42.066277 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec9571-bd66-4fb8-a588-a1301d63a9c4 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:42.066572 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec9571-bd66-4fb8-a588-a1301d63a9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:42.066852 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec9571-bd66-4fb8-a588-a1301d63a9c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:42.067537 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec9571-bd66-4fb8-a588-a1301d63a9c4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:26:42.067848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec9571-bd66-4fb8-a588-a1301d63a9c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:42.069296 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec9571-bd66-4fb8-a588-a1301d63a9c4 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:42.072396 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:42.081059 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 59/117] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:26:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:42.082790 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f611e85-7bd1-45da-a467-6c4e11c6e550 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:42.087578 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f611e85-7bd1-45da-a467-6c4e11c6e550 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:42.087578 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f611e85-7bd1-45da-a467-6c4e11c6e550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:42.108559 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-5f611e85-7bd1-45da-a467-6c4e11c6e550 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:26:42.110081 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5f611e85-7bd1-45da-a467-6c4e11c6e550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:26:42.136852 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:42.175841 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9966e3-ce77-4ad5-8cb5-bfcff72405b2 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:42.208588 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 60/118] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:26:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:26:42.210242 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d391a7-09e8-4c44-95af-ada360517501 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:42.210544 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d391a7-09e8-4c44-95af-ada360517501 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:42.210823 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d391a7-09e8-4c44-95af-ada360517501 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:42.216712 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 61/119] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:26:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:26:42.216712 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d391a7-09e8-4c44-95af-ada360517501 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:42.220520 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f2bfcf-d38c-41b3-ba67-d7daf2a4a4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:42.221414 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2bfcf-d38c-41b3-ba67-d7daf2a4a4c8 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:42.221925 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2bfcf-d38c-41b3-ba67-d7daf2a4a4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:42.222405 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2bfcf-d38c-41b3-ba67-d7daf2a4a4c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:42.223335 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f2bfcf-d38c-41b3-ba67-d7daf2a4a4c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:26:42.223834 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f2bfcf-d38c-41b3-ba67-d7daf2a4a4c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:42.225660 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f2bfcf-d38c-41b3-ba67-d7daf2a4a4c8 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:42.236689 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 59/120] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 03:26:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:42.242750 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40b277-f4d2-4003-af10-2e4f7180a882 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:42.243414 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40b277-f4d2-4003-af10-2e4f7180a882 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:42.244026 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40b277-f4d2-4003-af10-2e4f7180a882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:42.264227 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ca40b277-f4d2-4003-af10-2e4f7180a882 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:26:42.265906 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ca40b277-f4d2-4003-af10-2e4f7180a882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:26:42.338396 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d391a7-09e8-4c44-95af-ada360517501 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:42.344648 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 60/121] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:26:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:26:42.345533 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca40b277-f4d2-4003-af10-2e4f7180a882 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:42.393304 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:42.413289 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2192a9a-c0b2-428e-9592-3709b9eecff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:42.414230 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2192a9a-c0b2-428e-9592-3709b9eecff7 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:42.419130 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2192a9a-c0b2-428e-9592-3709b9eecff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:42.419130 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2192a9a-c0b2-428e-9592-3709b9eecff7 None admin] PATH_INFO: `/v3/users/8b1624609cc944cd86ca9c71ee9d61d0` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:42.419130 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2192a9a-c0b2-428e-9592-3709b9eecff7 None admin] RBAC: Authorizing `identity:get_user(user_id=8b1624609cc944cd86ca9c71ee9d61d0)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:42.420502 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2192a9a-c0b2-428e-9592-3709b9eecff7 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:42.422529 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 62/122] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:26:42 2022] GET /identity/v3/users/8b1624609cc944cd86ca9c71ee9d61d0 => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:42.427951 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2192a9a-c0b2-428e-9592-3709b9eecff7 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:42.434959 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:42.531582 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca40b277-f4d2-4003-af10-2e4f7180a882 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:42.574085 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2192a9a-c0b2-428e-9592-3709b9eecff7 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:42.597491 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab35541b-bb7b-4d54-a5d0-22f694b07c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:42.598552 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35541b-bb7b-4d54-a5d0-22f694b07c1b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:42.599042 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35541b-bb7b-4d54-a5d0-22f694b07c1b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:42.599511 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35541b-bb7b-4d54-a5d0-22f694b07c1b None admin] PATH_INFO: `/v3/users/8b1624609cc944cd86ca9c71ee9d61d0` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:42.601865 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab35541b-bb7b-4d54-a5d0-22f694b07c1b None admin] RBAC: Authorizing `identity:get_user(user_id=8b1624609cc944cd86ca9c71ee9d61d0)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:42.603637 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab35541b-bb7b-4d54-a5d0-22f694b07c1b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:42.605509 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 61/123] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:26:42 2022] GET /identity/v3/users/8b1624609cc944cd86ca9c71ee9d61d0 => generated 275 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:42.606553 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab35541b-bb7b-4d54-a5d0-22f694b07c1b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:42.617009 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca5375-52ef-4e88-a8a4-1a73f92ac061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:42.617682 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca5375-52ef-4e88-a8a4-1a73f92ac061 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:42.618488 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca5375-52ef-4e88-a8a4-1a73f92ac061 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:42.618782 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca5375-52ef-4e88-a8a4-1a73f92ac061 None admin] PATH_INFO: `/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:42.620050 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ca5375-52ef-4e88-a8a4-1a73f92ac061 None admin] RBAC: Authorizing `identity:get_project(project_id=e01bdca6ef9f47b192f68f70ff0bbdad)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:42.621514 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ca5375-52ef-4e88-a8a4-1a73f92ac061 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:42.628490 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 63/124] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:26:42 2022] GET /identity/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:42.629122 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca5375-52ef-4e88-a8a4-1a73f92ac061 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:42.754130 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:42.793300 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca5375-52ef-4e88-a8a4-1a73f92ac061 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:42.804889 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab35541b-bb7b-4d54-a5d0-22f694b07c1b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:42.834926 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:42.835266 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe84d47-930d-453f-83a5-bf92e090e569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:42.836782 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe84d47-930d-453f-83a5-bf92e090e569 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:42.838148 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe84d47-930d-453f-83a5-bf92e090e569 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:42.838922 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe84d47-930d-453f-83a5-bf92e090e569 None admin] PATH_INFO: `/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:42.840524 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe84d47-930d-453f-83a5-bf92e090e569 None admin] RBAC: Authorizing `identity:get_project(project_id=e01bdca6ef9f47b192f68f70ff0bbdad)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:42.842262 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe84d47-930d-453f-83a5-bf92e090e569 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:42.843267 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac04328-364a-4541-9490-f9e96e17d7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:42.843911 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac04328-364a-4541-9490-f9e96e17d7d0 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:42.844201 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac04328-364a-4541-9490-f9e96e17d7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:42.844479 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac04328-364a-4541-9490-f9e96e17d7d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:42.844924 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 64/125] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:26:42 2022] GET /identity/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:42.845875 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe84d47-930d-453f-83a5-bf92e090e569 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:42.856263 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac04328-364a-4541-9490-f9e96e17d7d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:26:42.861432 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-aac04328-364a-4541-9490-f9e96e17d7d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:26:42.861432 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:26:42.861432 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:26:42.861432 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:26:42.861432 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:26:42.861432 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:26:42.861432 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:26:42.861432 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:26:42.861432 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:26:42.861432 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:26:42.861432 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:26:42.861432 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:26:42.861432 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:26:42.861432 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:26:42.861432 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:26:42.861432 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:26:42.862472 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:26:42.862472 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:26:42.862472 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:26:42.862472 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:26:42.862472 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:26:42.862472 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:26:42.862472 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:26:42.862472 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:26:42.862472 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:26:42.862472 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:26:42.862472 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:26:42.862472 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:26:42.862472 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:26:42.862472 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:26:42.862472 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:26:42.862472 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:26:42.863220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:26:42.863220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:26:42.863220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:26:42.863220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:26:42.863220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:26:42.863220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:26:42.863220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:26:42.863220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:26:42.863220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:26:42.863220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:26:42.863220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:26:42.863220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:26:42.863220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 62/126] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 03:26:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:26:42.863982 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac04328-364a-4541-9490-f9e96e17d7d0 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:42.974371 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe84d47-930d-453f-83a5-bf92e090e569 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:42.975538 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac04328-364a-4541-9490-f9e96e17d7d0 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:43.012333 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:43.017374 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d3ab5-9e02-4913-bee0-8ffcdd7e3be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:43.018269 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d3ab5-9e02-4913-bee0-8ffcdd7e3be4 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:43.018802 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d3ab5-9e02-4913-bee0-8ffcdd7e3be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:43.019040 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3673020-eb02-4647-b05d-58a65d94f249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:43.019395 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d3ab5-9e02-4913-bee0-8ffcdd7e3be4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:43.019741 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3673020-eb02-4647-b05d-58a65d94f249 None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:43.020080 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3673020-eb02-4647-b05d-58a65d94f249 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:43.020704 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3673020-eb02-4647-b05d-58a65d94f249 None admin] PATH_INFO: `/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad/users/8b1624609cc944cd86ca9c71ee9d61d0/roles/fcb362c8a9fd47fbbb6b14397cae171c` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:43.023285 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3673020-eb02-4647-b05d-58a65d94f249 None admin] RBAC: Authorizing `identity:create_grant(project_id=e01bdca6ef9f47b192f68f70ff0bbdad, user_id=8b1624609cc944cd86ca9c71ee9d61d0, role_id=fcb362c8a9fd47fbbb6b14397cae171c)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:43.024883 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3673020-eb02-4647-b05d-58a65d94f249 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:43.032298 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20d3ab5-9e02-4913-bee0-8ffcdd7e3be4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:26:43.037247 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-e20d3ab5-9e02-4913-bee0-8ffcdd7e3be4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 03:26:43.037247 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:26:43.037247 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:26:43.037247 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:26:43.037247 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:26:43.037247 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:26:43.037247 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:26:43.037247 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:26:43.037247 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:26:43.037247 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:26:43.037247 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:26:43.037247 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:26:43.037247 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:26:43.037247 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:26:43.037247 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:26:43.037247 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:26:43.038346 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:26:43.038346 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:26:43.038346 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:26:43.038346 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:26:43.038346 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:26:43.038346 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:26:43.038346 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:26:43.038346 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:26:43.038346 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:26:43.038346 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:26:43.038346 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:26:43.038346 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:26:43.038346 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:26:43.038346 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:26:43.038346 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:26:43.038346 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:26:43.039311 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:26:43.039311 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:26:43.039311 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:26:43.039311 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:26:43.039311 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:26:43.039311 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:26:43.039311 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:26:43.039311 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:26:43.039311 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:26:43.039311 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:26:43.039311 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 03:26:43.039311 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:26:43.039311 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 63/127] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:26:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:26:43.039311 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d3ab5-9e02-4913-bee0-8ffcdd7e3be4 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:43.092363 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:43.114436 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 65/128] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 03:26:42 2022] PUT /identity/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad/users/8b1624609cc944cd86ca9c71ee9d61d0/roles/fcb362c8a9fd47fbbb6b14397cae171c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:26:43.115599 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3673020-eb02-4647-b05d-58a65d94f249 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:43.160592 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d3ab5-9e02-4913-bee0-8ffcdd7e3be4 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:43.207167 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fe93b-f1c5-42e0-bdd9-6b6b748bbc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:43.208069 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fe93b-f1c5-42e0-bdd9-6b6b748bbc7a None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:43.208275 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fe93b-f1c5-42e0-bdd9-6b6b748bbc7a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:43.208558 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fe93b-f1c5-42e0-bdd9-6b6b748bbc7a None admin] PATH_INFO: `/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad/users/8b1624609cc944cd86ca9c71ee9d61d0/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:43.210799 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2fe93b-f1c5-42e0-bdd9-6b6b748bbc7a None admin] RBAC: Authorizing `identity:create_grant(project_id=e01bdca6ef9f47b192f68f70ff0bbdad, user_id=8b1624609cc944cd86ca9c71ee9d61d0, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:43.213215 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2fe93b-f1c5-42e0-bdd9-6b6b748bbc7a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:43.259439 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3673020-eb02-4647-b05d-58a65d94f249 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:43.298444 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa27b9b-0758-42d4-83bb-88ef29afb19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:43.299251 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa27b9b-0758-42d4-83bb-88ef29afb19a None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:43.299642 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa27b9b-0758-42d4-83bb-88ef29afb19a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:43.300026 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa27b9b-0758-42d4-83bb-88ef29afb19a None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:43.300949 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa27b9b-0758-42d4-83bb-88ef29afb19a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:26:43.301368 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa27b9b-0758-42d4-83bb-88ef29afb19a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:43.302981 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa27b9b-0758-42d4-83bb-88ef29afb19a None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:43.314300 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 64/129] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 03:26:43 2022] PUT /identity/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad/users/8b1624609cc944cd86ca9c71ee9d61d0/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:26:43.322020 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 66/130] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:26:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:43.322020 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa27b9b-0758-42d4-83bb-88ef29afb19a None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:43.326163 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59a5c0-0045-4d3b-8546-97309a919c3e None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:43.326981 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59a5c0-0045-4d3b-8546-97309a919c3e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:43.328236 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59a5c0-0045-4d3b-8546-97309a919c3e None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:43.331877 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 65/131] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:26:43 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:26:43.333857 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59a5c0-0045-4d3b-8546-97309a919c3e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:43.410015 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:43.470857 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59a5c0-0045-4d3b-8546-97309a919c3e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:43.476629 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa27b9b-0758-42d4-83bb-88ef29afb19a None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:43.482783 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:43.511417 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b672cd0-5023-4452-8738-c0131d2d9e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:43.512069 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b672cd0-5023-4452-8738-c0131d2d9e52 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:43.512350 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b672cd0-5023-4452-8738-c0131d2d9e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:43.512680 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b672cd0-5023-4452-8738-c0131d2d9e52 None admin] PATH_INFO: `/v3/users/a6d47188867a4d9384390f05eba70a8c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:43.513993 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b672cd0-5023-4452-8738-c0131d2d9e52 None admin] RBAC: Authorizing `identity:get_user(user_id=a6d47188867a4d9384390f05eba70a8c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:43.515542 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b672cd0-5023-4452-8738-c0131d2d9e52 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:43.521673 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 66/132] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:26:43 2022] GET /identity/v3/users/a6d47188867a4d9384390f05eba70a8c => generated 247 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:43.521673 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85342af7-084c-4066-82ed-8a5ece3c8588 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:43.521673 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85342af7-084c-4066-82ed-8a5ece3c8588 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:43.521673 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85342af7-084c-4066-82ed-8a5ece3c8588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:43.534478 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00404e-22ae-4d6f-a08d-aed2b1e9cb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:43.538428 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00404e-22ae-4d6f-a08d-aed2b1e9cb7b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:43.538428 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00404e-22ae-4d6f-a08d-aed2b1e9cb7b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:43.538428 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00404e-22ae-4d6f-a08d-aed2b1e9cb7b None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:43.538428 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00404e-22ae-4d6f-a08d-aed2b1e9cb7b None admin] RBAC: Adding query filter params (name=member) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:26:43.538428 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00404e-22ae-4d6f-a08d-aed2b1e9cb7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:43.538428 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00404e-22ae-4d6f-a08d-aed2b1e9cb7b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:43.547330 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-85342af7-084c-4066-82ed-8a5ece3c8588 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:26:43.548487 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 67/133] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 03:26:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:43.549496 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00404e-22ae-4d6f-a08d-aed2b1e9cb7b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:43.549612 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-85342af7-084c-4066-82ed-8a5ece3c8588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:26:43.676669 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 67/134] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:26:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:26:43.677269 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85342af7-084c-4066-82ed-8a5ece3c8588 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:43.679226 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00404e-22ae-4d6f-a08d-aed2b1e9cb7b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:43.726102 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:43.787183 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5570d-961c-4946-8c0a-ce4b6a8e3c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:43.788245 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5570d-961c-4946-8c0a-ce4b6a8e3c43 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:43.788760 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5570d-961c-4946-8c0a-ce4b6a8e3c43 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:43.789251 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5570d-961c-4946-8c0a-ce4b6a8e3c43 None admin] PATH_INFO: `/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:43.794343 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac5570d-961c-4946-8c0a-ce4b6a8e3c43 None admin] RBAC: Authorizing `identity:get_project(project_id=e01bdca6ef9f47b192f68f70ff0bbdad)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:43.796086 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac5570d-961c-4946-8c0a-ce4b6a8e3c43 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:43.798097 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 68/135] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:26:43 2022] GET /identity/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:43.805848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5570d-961c-4946-8c0a-ce4b6a8e3c43 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:43.935696 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85342af7-084c-4066-82ed-8a5ece3c8588 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:43.943502 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5570d-961c-4946-8c0a-ce4b6a8e3c43 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:43.959703 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:44.003145 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a1ecb-88c2-4037-953d-58df5b85578c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:44.004138 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a1ecb-88c2-4037-953d-58df5b85578c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:44.004712 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a1ecb-88c2-4037-953d-58df5b85578c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:44.005269 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a1ecb-88c2-4037-953d-58df5b85578c None admin] PATH_INFO: `/v3/users/8b1624609cc944cd86ca9c71ee9d61d0` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:44.009392 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a1ecb-88c2-4037-953d-58df5b85578c None admin] RBAC: Authorizing `identity:get_user(user_id=8b1624609cc944cd86ca9c71ee9d61d0)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:44.011314 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a1ecb-88c2-4037-953d-58df5b85578c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:44.013145 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 68/136] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:26:43 2022] GET /identity/v3/users/8b1624609cc944cd86ca9c71ee9d61d0 => generated 275 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:44.015470 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a143f94-2c2a-4312-9226-9fe496e5c04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:44.016149 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a143f94-2c2a-4312-9226-9fe496e5c04f None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:44.016431 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a143f94-2c2a-4312-9226-9fe496e5c04f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:44.016709 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a143f94-2c2a-4312-9226-9fe496e5c04f None admin] PATH_INFO: `/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad/users/a6d47188867a4d9384390f05eba70a8c/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:44.019076 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a1ecb-88c2-4037-953d-58df5b85578c None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:44.023125 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a143f94-2c2a-4312-9226-9fe496e5c04f None admin] RBAC: Authorizing `identity:create_grant(project_id=e01bdca6ef9f47b192f68f70ff0bbdad, user_id=a6d47188867a4d9384390f05eba70a8c, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:44.026125 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a143f94-2c2a-4312-9226-9fe496e5c04f None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:44.100440 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 69/137] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 03:26:43 2022] PUT /identity/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad/users/a6d47188867a4d9384390f05eba70a8c/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:26:44.101189 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a143f94-2c2a-4312-9226-9fe496e5c04f None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:44.179536 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:44.190908 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a1ecb-88c2-4037-953d-58df5b85578c None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:44.268875 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f67812-0503-4cf1-978f-955788e55aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:44.269593 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f67812-0503-4cf1-978f-955788e55aa1 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:44.269906 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f67812-0503-4cf1-978f-955788e55aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:44.270195 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f67812-0503-4cf1-978f-955788e55aa1 None admin] PATH_INFO: `/v3/projects/e4619c468b984829b2b07ecd02f668d2` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:44.274951 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f67812-0503-4cf1-978f-955788e55aa1 None admin] RBAC: Authorizing `identity:get_project(project_id=e4619c468b984829b2b07ecd02f668d2)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:44.276480 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f67812-0503-4cf1-978f-955788e55aa1 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:44.278342 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 69/138] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:26:44 2022] GET /identity/v3/projects/e4619c468b984829b2b07ecd02f668d2 => generated 312 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:26:44.281727 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a143f94-2c2a-4312-9226-9fe496e5c04f None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:44.286897 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f67812-0503-4cf1-978f-955788e55aa1 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:44.349586 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3ec21-3bff-4601-b82f-bb52eb30f795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:44.351758 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3ec21-3bff-4601-b82f-bb52eb30f795 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:44.352079 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3ec21-3bff-4601-b82f-bb52eb30f795 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:44.353114 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3ec21-3bff-4601-b82f-bb52eb30f795 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:44.358293 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f3ec21-3bff-4601-b82f-bb52eb30f795 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:44.360060 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f3ec21-3bff-4601-b82f-bb52eb30f795 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:44.362095 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 70/139] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:26:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:44.367907 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3ec21-3bff-4601-b82f-bb52eb30f795 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:44.394594 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:44.534420 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f67812-0503-4cf1-978f-955788e55aa1 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:44.550861 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3ec21-3bff-4601-b82f-bb52eb30f795 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:44.574788 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:44.582502 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b35e5-5da9-462a-af7c-3afe4fb60503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:44.583863 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b35e5-5da9-462a-af7c-3afe4fb60503 None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:44.585101 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b35e5-5da9-462a-af7c-3afe4fb60503 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:44.585549 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b35e5-5da9-462a-af7c-3afe4fb60503 None admin] PATH_INFO: `/v3/projects/e4619c468b984829b2b07ecd02f668d2/users/8b1624609cc944cd86ca9c71ee9d61d0/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:44.589342 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b35e5-5da9-462a-af7c-3afe4fb60503 None admin] RBAC: Authorizing `identity:create_grant(project_id=e4619c468b984829b2b07ecd02f668d2, user_id=8b1624609cc944cd86ca9c71ee9d61d0, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:44.591906 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b35e5-5da9-462a-af7c-3afe4fb60503 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:44.613972 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae675792-d1a3-45e3-adc6-4510219463f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:44.614995 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae675792-d1a3-45e3-adc6-4510219463f5 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:44.615475 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae675792-d1a3-45e3-adc6-4510219463f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:44.621908 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae675792-d1a3-45e3-adc6-4510219463f5 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:44.621908 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae675792-d1a3-45e3-adc6-4510219463f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:44.621908 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae675792-d1a3-45e3-adc6-4510219463f5 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:44.703753 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 70/140] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 03:26:44 2022] PUT /identity/v3/projects/e4619c468b984829b2b07ecd02f668d2/users/8b1624609cc944cd86ca9c71ee9d61d0/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:26:44.728383 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 71/141] 10.222.0.33 () {60 vars in 1132 bytes} [Fri Sep 16 03:26:44 2022] POST /identity/v3/users => generated 283 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:26:44.859273 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f2e2a-7184-498f-af86-f25224aeed70 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:44.859561 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f2e2a-7184-498f-af86-f25224aeed70 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:44.859770 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f2e2a-7184-498f-af86-f25224aeed70 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:44.861126 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 71/142] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:26:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:26:44.867039 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf93a19-fb13-48e4-a64e-7561d005a1a8 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:44.867366 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf93a19-fb13-48e4-a64e-7561d005a1a8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:44.867603 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf93a19-fb13-48e4-a64e-7561d005a1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:44.888030 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1bf93a19-fb13-48e4-a64e-7561d005a1a8 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:26:44.889270 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1bf93a19-fb13-48e4-a64e-7561d005a1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:26:44.971188 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 72/143] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:26:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:26:45.289302 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f2e2a-7184-498f-af86-f25224aeed70 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:45.403872 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f2e2a-7184-498f-af86-f25224aeed70 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:45.406016 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:45.443987 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd66bd-4d90-49f9-b20f-a41dfd775688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:45.444629 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd66bd-4d90-49f9-b20f-a41dfd775688 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:45.444905 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd66bd-4d90-49f9-b20f-a41dfd775688 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:45.445178 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd66bd-4d90-49f9-b20f-a41dfd775688 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:45.458727 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd66bd-4d90-49f9-b20f-a41dfd775688 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:26:45.464618 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-f2fd66bd-4d90-49f9-b20f-a41dfd775688 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 03:26:45.464618 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:26:45.464618 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:26:45.464618 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:26:45.464618 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:26:45.464618 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:26:45.464618 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:26:45.464618 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:26:45.464618 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:26:45.464618 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:26:45.464618 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:26:45.464618 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:26:45.464618 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:26:45.464618 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:26:45.464618 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:26:45.464618 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:26:45.465498 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:26:45.465498 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:26:45.465498 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:26:45.465498 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:26:45.465498 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:26:45.465498 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:26:45.465498 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:26:45.465498 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:26:45.465498 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:26:45.465498 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:26:45.465498 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:26:45.465498 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:26:45.465498 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:26:45.465498 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:26:45.465498 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:26:45.465498 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:26:45.467081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:26:45.467081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:26:45.467081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:26:45.467081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:26:45.467081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:26:45.467081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:26:45.467081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:26:45.467081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:26:45.467081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:26:45.467081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:26:45.467081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 03:26:45.467081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:26:45.467081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 72/144] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:26:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:26:45.471942 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf93a19-fb13-48e4-a64e-7561d005a1a8 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:45.584431 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:45.592665 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf93a19-fb13-48e4-a64e-7561d005a1a8 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:45.630121 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0023a-1ab0-4b6e-bcd5-55c5c9a2beb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:45.630743 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0023a-1ab0-4b6e-bcd5-55c5c9a2beb3 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:45.631020 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0023a-1ab0-4b6e-bcd5-55c5c9a2beb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:45.631293 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0023a-1ab0-4b6e-bcd5-55c5c9a2beb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:45.631961 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd0023a-1ab0-4b6e-bcd5-55c5c9a2beb3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:26:45.632274 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd0023a-1ab0-4b6e-bcd5-55c5c9a2beb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:45.636550 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd0023a-1ab0-4b6e-bcd5-55c5c9a2beb3 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:45.645966 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 73/145] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 03:26:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:45.654735 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd66bd-4d90-49f9-b20f-a41dfd775688 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:45.776709 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd66bd-4d90-49f9-b20f-a41dfd775688 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:45.812929 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd075aa-159b-4bcf-b4d6-37539eb666e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:45.813571 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd075aa-159b-4bcf-b4d6-37539eb666e2 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:45.813886 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd075aa-159b-4bcf-b4d6-37539eb666e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:45.814156 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd075aa-159b-4bcf-b4d6-37539eb666e2 None admin] PATH_INFO: `/v3/users/1644481571e5426f870870bbf4682548` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:45.815297 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd075aa-159b-4bcf-b4d6-37539eb666e2 None admin] RBAC: Authorizing `identity:get_user(user_id=1644481571e5426f870870bbf4682548)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:45.816814 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd075aa-159b-4bcf-b4d6-37539eb666e2 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:45.818701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 73/146] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:26:45 2022] GET /identity/v3/users/1644481571e5426f870870bbf4682548 => generated 289 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:45.824995 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0023a-1ab0-4b6e-bcd5-55c5c9a2beb3 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:45.935009 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0023a-1ab0-4b6e-bcd5-55c5c9a2beb3 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:45.971498 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27c1a4-a47f-48bb-8328-3741497626ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:45.972145 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27c1a4-a47f-48bb-8328-3741497626ce None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:45.972422 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27c1a4-a47f-48bb-8328-3741497626ce None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:45.972691 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27c1a4-a47f-48bb-8328-3741497626ce None admin] PATH_INFO: `/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:45.974268 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27c1a4-a47f-48bb-8328-3741497626ce None admin] RBAC: Authorizing `identity:get_project(project_id=e01bdca6ef9f47b192f68f70ff0bbdad)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:45.975828 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27c1a4-a47f-48bb-8328-3741497626ce None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:45.978277 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 74/147] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:26:45 2022] GET /identity/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:45.983815 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd075aa-159b-4bcf-b4d6-37539eb666e2 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:46.019485 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:46.118154 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd075aa-159b-4bcf-b4d6-37539eb666e2 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:46.162889 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402de417-a46f-4741-a092-f052fadedea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:46.163570 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402de417-a46f-4741-a092-f052fadedea7 None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:46.163851 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402de417-a46f-4741-a092-f052fadedea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:46.164124 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402de417-a46f-4741-a092-f052fadedea7 None admin] PATH_INFO: `/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad/users/1644481571e5426f870870bbf4682548/roles/35fd8044264e4590a6dcfeabaf194c78` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:46.166814 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402de417-a46f-4741-a092-f052fadedea7 None admin] RBAC: Authorizing `identity:create_grant(project_id=e01bdca6ef9f47b192f68f70ff0bbdad, user_id=1644481571e5426f870870bbf4682548, role_id=35fd8044264e4590a6dcfeabaf194c78)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:46.168338 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402de417-a46f-4741-a092-f052fadedea7 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:46.198061 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85814bd0-6d6f-4e15-9841-6e81b8a482c3 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:46.198348 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85814bd0-6d6f-4e15-9841-6e81b8a482c3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:46.198537 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85814bd0-6d6f-4e15-9841-6e81b8a482c3 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:46.200087 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 75/148] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 03:26:46.205257 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da10e8-0093-49ae-af6d-fd898f3cddcb None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:46.205640 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da10e8-0093-49ae-af6d-fd898f3cddcb None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:46.205982 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da10e8-0093-49ae-af6d-fd898f3cddcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:46.226077 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-86da10e8-0093-49ae-af6d-fd898f3cddcb None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:26:46.227283 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-86da10e8-0093-49ae-af6d-fd898f3cddcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:26:46.243584 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 74/149] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 03:26:45 2022] PUT /identity/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad/users/1644481571e5426f870870bbf4682548/roles/35fd8044264e4590a6dcfeabaf194c78 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:26:46.258346 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:46.318414 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 76/150] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:26:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 03:26:46.572159 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04de957-d351-4eec-90e3-fe26b75d5e1e None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:46.572527 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04de957-d351-4eec-90e3-fe26b75d5e1e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:46.572735 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04de957-d351-4eec-90e3-fe26b75d5e1e None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:46.574241 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 75/151] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:26:46.581936 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249d9d6-3eef-41ba-acbe-e7f1a46b346a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:46.582644 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249d9d6-3eef-41ba-acbe-e7f1a46b346a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:46.583122 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249d9d6-3eef-41ba-acbe-e7f1a46b346a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:46.603747 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-5249d9d6-3eef-41ba-acbe-e7f1a46b346a None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:26:46.605272 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5249d9d6-3eef-41ba-acbe-e7f1a46b346a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:26:46.684502 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 77/152] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:26:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:26:46.793202 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04de957-d351-4eec-90e3-fe26b75d5e1e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:46.918185 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:46.929901 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04de957-d351-4eec-90e3-fe26b75d5e1e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:46.968684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57fbae0-0948-4708-930d-8823f39fcd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:46.976364 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57fbae0-0948-4708-930d-8823f39fcd46 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:46.976364 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57fbae0-0948-4708-930d-8823f39fcd46 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:46.976364 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57fbae0-0948-4708-930d-8823f39fcd46 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:46.980910 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57fbae0-0948-4708-930d-8823f39fcd46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:26:46.985907 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-b57fbae0-0948-4708-930d-8823f39fcd46 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 03:26:46.985907 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:26:46.985907 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:26:46.985907 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:26:46.985907 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:26:46.985907 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:26:46.985907 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:26:46.985907 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:26:46.985907 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:26:46.985907 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:26:46.985907 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:26:46.985907 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:26:46.985907 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:26:46.985907 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:26:46.985907 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:26:46.985907 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:26:46.986737 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:26:46.986737 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:26:46.986737 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:26:46.986737 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:26:46.986737 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:26:46.986737 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:26:46.986737 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:26:46.986737 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:26:46.986737 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:26:46.986737 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:26:46.986737 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:26:46.986737 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:26:46.986737 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:26:46.986737 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:26:46.986737 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:26:46.986737 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:26:46.987473 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:26:46.987473 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:26:46.987473 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:26:46.987473 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:26:46.987473 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:26:46.987473 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:26:46.987473 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:26:46.987473 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:26:46.987473 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:26:46.987473 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:26:46.987473 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 03:26:46.987473 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:26:46.987473 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 76/153] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:26:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:26:46.993779 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249d9d6-3eef-41ba-acbe-e7f1a46b346a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:47.102201 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:47.118882 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249d9d6-3eef-41ba-acbe-e7f1a46b346a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:47.160375 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143cfb8-a828-4c07-ac66-40cec856cd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:47.160997 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143cfb8-a828-4c07-ac66-40cec856cd1a None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:47.161285 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143cfb8-a828-4c07-ac66-40cec856cd1a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:47.161558 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143cfb8-a828-4c07-ac66-40cec856cd1a None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:47.162253 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143cfb8-a828-4c07-ac66-40cec856cd1a None admin] RBAC: Adding query filter params (name=member) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:26:47.162559 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143cfb8-a828-4c07-ac66-40cec856cd1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:47.163963 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143cfb8-a828-4c07-ac66-40cec856cd1a None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:47.177104 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 78/154] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 03:26:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:47.183507 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57fbae0-0948-4708-930d-8823f39fcd46 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:47.347548 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57fbae0-0948-4708-930d-8823f39fcd46 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:47.348598 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143cfb8-a828-4c07-ac66-40cec856cd1a None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:47.400149 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29022f58-4cfe-4276-9b0d-864460a33589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:47.400798 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29022f58-4cfe-4276-9b0d-864460a33589 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:47.401084 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29022f58-4cfe-4276-9b0d-864460a33589 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:47.401364 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29022f58-4cfe-4276-9b0d-864460a33589 None admin] PATH_INFO: `/v3/users/8b1624609cc944cd86ca9c71ee9d61d0` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:47.405725 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29022f58-4cfe-4276-9b0d-864460a33589 None admin] RBAC: Authorizing `identity:get_user(user_id=8b1624609cc944cd86ca9c71ee9d61d0)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:47.405725 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29022f58-4cfe-4276-9b0d-864460a33589 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:47.406365 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 77/155] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:26:47 2022] GET /identity/v3/users/8b1624609cc944cd86ca9c71ee9d61d0 => generated 275 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:47.411820 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29022f58-4cfe-4276-9b0d-864460a33589 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:47.435896 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:47.570880 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29022f58-4cfe-4276-9b0d-864460a33589 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:47.572097 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143cfb8-a828-4c07-ac66-40cec856cd1a None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:47.610022 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9de011-e138-4b35-86e4-3c68cfdf6fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:47.611007 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9de011-e138-4b35-86e4-3c68cfdf6fc0 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:47.611492 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9de011-e138-4b35-86e4-3c68cfdf6fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:47.611996 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9de011-e138-4b35-86e4-3c68cfdf6fc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:47.638277 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdcf8c8-e2fa-4426-b1cc-d5d710bc6797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:47.639275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdcf8c8-e2fa-4426-b1cc-d5d710bc6797 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:47.639814 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdcf8c8-e2fa-4426-b1cc-d5d710bc6797 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:47.640335 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdcf8c8-e2fa-4426-b1cc-d5d710bc6797 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:47.664617 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdcf8c8-e2fa-4426-b1cc-d5d710bc6797 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:26:47.677585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-2fdcf8c8-e2fa-4426-b1cc-d5d710bc6797 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 03:26:47.677585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:26:47.677585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:26:47.677585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:26:47.677585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:26:47.677585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:26:47.677585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:26:47.677585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:26:47.677585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:26:47.677585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:26:47.677585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:26:47.677585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:26:47.677585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:26:47.677585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:26:47.677585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:26:47.677585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:26:47.678581 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:26:47.678581 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:26:47.678581 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:26:47.678581 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:26:47.678581 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:26:47.678581 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:26:47.678581 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:26:47.678581 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:26:47.678581 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:26:47.678581 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:26:47.678581 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:26:47.678581 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:26:47.678581 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:26:47.678581 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:26:47.678581 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:26:47.678581 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:26:47.679339 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:26:47.679339 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:26:47.679339 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:26:47.679339 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:26:47.679339 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:26:47.679339 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:26:47.679339 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:26:47.679339 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:26:47.679339 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:26:47.679339 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:26:47.679339 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 03:26:47.679339 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:26:47.686076 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 79/156] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 03:26:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:26:47.691815 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdcf8c8-e2fa-4426-b1cc-d5d710bc6797 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:47.710001 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:47.730351 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9de011-e138-4b35-86e4-3c68cfdf6fc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:47.731836 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9de011-e138-4b35-86e4-3c68cfdf6fc0 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:47.760166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:47.887927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 78/157] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:26:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 16 03:26:47.890019 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae6e87-47b2-436d-9114-04e94170a3cf None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:47.890542 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae6e87-47b2-436d-9114-04e94170a3cf None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:47.891053 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae6e87-47b2-436d-9114-04e94170a3cf None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:47.892485 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 79/158] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:26:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:26:47.896528 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae6e87-47b2-436d-9114-04e94170a3cf None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:47.916892 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdcf8c8-e2fa-4426-b1cc-d5d710bc6797 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:47.965484 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea117fdd-3b5a-43d4-a85c-1b88799525cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:47.966396 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea117fdd-3b5a-43d4-a85c-1b88799525cd None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:47.966825 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea117fdd-3b5a-43d4-a85c-1b88799525cd None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:47.967284 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea117fdd-3b5a-43d4-a85c-1b88799525cd None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:47.968123 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea117fdd-3b5a-43d4-a85c-1b88799525cd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:26:47.968605 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea117fdd-3b5a-43d4-a85c-1b88799525cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:47.970527 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea117fdd-3b5a-43d4-a85c-1b88799525cd None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:47.988230 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 80/159] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:26:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:26:47.990114 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e55eac-eba3-417b-9196-114f81828377 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:47.990647 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e55eac-eba3-417b-9196-114f81828377 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:47.991258 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e55eac-eba3-417b-9196-114f81828377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:48.022649 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-41e55eac-eba3-417b-9196-114f81828377 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:26:48.025069 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-41e55eac-eba3-417b-9196-114f81828377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:26:48.136999 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:48.148801 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae6e87-47b2-436d-9114-04e94170a3cf None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:48.154431 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 81/160] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:26:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:26:48.154431 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e55eac-eba3-417b-9196-114f81828377 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:48.194015 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:48.237550 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c738b01-33ef-491f-a8b4-7bdb755a0898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:48.238133 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c738b01-33ef-491f-a8b4-7bdb755a0898 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:48.238406 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c738b01-33ef-491f-a8b4-7bdb755a0898 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:48.238675 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c738b01-33ef-491f-a8b4-7bdb755a0898 None admin] PATH_INFO: `/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:48.239802 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c738b01-33ef-491f-a8b4-7bdb755a0898 None admin] RBAC: Authorizing `identity:get_project(project_id=e01bdca6ef9f47b192f68f70ff0bbdad)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:48.241257 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c738b01-33ef-491f-a8b4-7bdb755a0898 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:48.242988 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 80/161] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:26:47 2022] GET /identity/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad => generated 298 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:48.249024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c738b01-33ef-491f-a8b4-7bdb755a0898 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:48.308353 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e55eac-eba3-417b-9196-114f81828377 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:48.367288 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2b47b-fc94-4aa7-ba01-003a4b689d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:48.368004 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2b47b-fc94-4aa7-ba01-003a4b689d5d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:48.368293 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2b47b-fc94-4aa7-ba01-003a4b689d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:48.368571 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2b47b-fc94-4aa7-ba01-003a4b689d5d None admin] PATH_INFO: `/v3/users/8b1624609cc944cd86ca9c71ee9d61d0` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:48.374315 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2b47b-fc94-4aa7-ba01-003a4b689d5d None admin] RBAC: Authorizing `identity:get_user(user_id=8b1624609cc944cd86ca9c71ee9d61d0)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:48.375800 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2b47b-fc94-4aa7-ba01-003a4b689d5d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:48.377396 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 82/162] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:26:48 2022] GET /identity/v3/users/8b1624609cc944cd86ca9c71ee9d61d0 => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:48.386179 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2b47b-fc94-4aa7-ba01-003a4b689d5d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:48.487372 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:48.512029 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c738b01-33ef-491f-a8b4-7bdb755a0898 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:48.523323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2b47b-fc94-4aa7-ba01-003a4b689d5d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:48.565616 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12538dc-6346-40dd-b780-36bbc1bf2aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:48.566261 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12538dc-6346-40dd-b780-36bbc1bf2aa1 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:48.566545 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12538dc-6346-40dd-b780-36bbc1bf2aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:48.566817 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12538dc-6346-40dd-b780-36bbc1bf2aa1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:48.601010 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50d967-c277-4b36-993d-69d38221432a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:48.601620 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50d967-c277-4b36-993d-69d38221432a None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:48.601947 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50d967-c277-4b36-993d-69d38221432a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:48.602255 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50d967-c277-4b36-993d-69d38221432a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:48.602966 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a50d967-c277-4b36-993d-69d38221432a None admin] RBAC: Adding query filter params (role.id=7591562cf9564b288c108609d8e334b3, scope.project.id=e01bdca6ef9f47b192f68f70ff0bbdad, user.id=8b1624609cc944cd86ca9c71ee9d61d0) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:26:48.603271 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a50d967-c277-4b36-993d-69d38221432a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:48.604697 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a50d967-c277-4b36-993d-69d38221432a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:48.615801 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 81/163] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:26:48 2022] GET /identity/v3/role_assignments?user.id=8b1624609cc944cd86ca9c71ee9d61d0&scope.project.id=e01bdca6ef9f47b192f68f70ff0bbdad&role.id=7591562cf9564b288c108609d8e334b3 => generated 608 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:26:48.645057 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12538dc-6346-40dd-b780-36bbc1bf2aa1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:48.646910 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12538dc-6346-40dd-b780-36bbc1bf2aa1 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:48.722987 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:48.760389 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 83/164] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:26:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 16 03:26:48.766350 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50d967-c277-4b36-993d-69d38221432a None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:48.787401 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12538dc-6346-40dd-b780-36bbc1bf2aa1 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:48.893988 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:48.938705 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12538dc-6346-40dd-b780-36bbc1bf2aa1 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:48.991521 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd904249-ef3e-4d82-b9f8-73f75281b1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:48.992180 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd904249-ef3e-4d82-b9f8-73f75281b1c6 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:48.992467 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd904249-ef3e-4d82-b9f8-73f75281b1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:48.992741 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd904249-ef3e-4d82-b9f8-73f75281b1c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:49.003186 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50d967-c277-4b36-993d-69d38221432a None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:49.011316 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd904249-ef3e-4d82-b9f8-73f75281b1c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:26:49.016250 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-fd904249-ef3e-4d82-b9f8-73f75281b1c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:26:49.016250 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:26:49.016250 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:26:49.016250 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:26:49.016250 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:26:49.016250 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:26:49.016250 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:26:49.016250 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:26:49.016250 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:26:49.016250 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:26:49.016250 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:26:49.016250 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:26:49.016250 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:26:49.016250 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:26:49.016250 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:26:49.016250 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:26:49.017340 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:26:49.017340 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:26:49.017340 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:26:49.017340 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:26:49.017340 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:26:49.017340 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:26:49.017340 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:26:49.017340 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:26:49.017340 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:26:49.017340 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:26:49.017340 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:26:49.017340 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:26:49.017340 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:26:49.017340 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:26:49.017340 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:26:49.017340 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:26:49.018420 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:26:49.018420 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:26:49.018420 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:26:49.018420 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:26:49.018420 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:26:49.018420 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:26:49.018420 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:26:49.018420 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:26:49.018420 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:26:49.018420 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:26:49.018420 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:26:49.018420 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:26:49.018420 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 84/165] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 03:26:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:26:49.030792 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd904249-ef3e-4d82-b9f8-73f75281b1c6 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:49.071995 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d058d3e-7bbd-4994-bf51-dcc23324cd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:49.072651 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d058d3e-7bbd-4994-bf51-dcc23324cd83 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:49.072927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d058d3e-7bbd-4994-bf51-dcc23324cd83 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:49.073198 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d058d3e-7bbd-4994-bf51-dcc23324cd83 None admin] PATH_INFO: `/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:49.074360 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d058d3e-7bbd-4994-bf51-dcc23324cd83 None admin] RBAC: Authorizing `identity:get_project(project_id=e01bdca6ef9f47b192f68f70ff0bbdad)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:49.075817 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d058d3e-7bbd-4994-bf51-dcc23324cd83 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:49.078039 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:49.082074 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 82/166] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:26:48 2022] GET /identity/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad => generated 298 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:49.088018 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d058d3e-7bbd-4994-bf51-dcc23324cd83 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:49.184304 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd904249-ef3e-4d82-b9f8-73f75281b1c6 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:49.232338 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15a946-516e-4685-bcc3-fdfe2757ce1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:49.232964 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15a946-516e-4685-bcc3-fdfe2757ce1f None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:49.233249 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15a946-516e-4685-bcc3-fdfe2757ce1f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:49.233526 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15a946-516e-4685-bcc3-fdfe2757ce1f None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:49.234252 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15a946-516e-4685-bcc3-fdfe2757ce1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:26:49.234558 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15a946-516e-4685-bcc3-fdfe2757ce1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:49.235968 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15a946-516e-4685-bcc3-fdfe2757ce1f None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:49.245388 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 85/167] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:26:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:49.251890 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15a946-516e-4685-bcc3-fdfe2757ce1f None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:49.275732 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d058d3e-7bbd-4994-bf51-dcc23324cd83 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:49.314044 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:49.341321 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f075d92-bbb6-40f8-96a9-7d3fb477f3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:49.342190 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f075d92-bbb6-40f8-96a9-7d3fb477f3c1 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:49.342484 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f075d92-bbb6-40f8-96a9-7d3fb477f3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:49.342757 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f075d92-bbb6-40f8-96a9-7d3fb477f3c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:49.343500 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f075d92-bbb6-40f8-96a9-7d3fb477f3c1 None admin] RBAC: Adding query filter params (role.id=fcb362c8a9fd47fbbb6b14397cae171c, scope.project.id=e01bdca6ef9f47b192f68f70ff0bbdad, user.id=8b1624609cc944cd86ca9c71ee9d61d0) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:26:49.343806 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f075d92-bbb6-40f8-96a9-7d3fb477f3c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:49.350646 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f075d92-bbb6-40f8-96a9-7d3fb477f3c1 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:49.362009 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 83/168] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:26:49 2022] GET /identity/v3/role_assignments?user.id=8b1624609cc944cd86ca9c71ee9d61d0&scope.project.id=e01bdca6ef9f47b192f68f70ff0bbdad&role.id=fcb362c8a9fd47fbbb6b14397cae171c => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:26:49.380227 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:49.391666 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15a946-516e-4685-bcc3-fdfe2757ce1f None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:49.439837 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632b518-b11e-4c27-9d15-7f130812c9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:49.440503 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632b518-b11e-4c27-9d15-7f130812c9e2 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:49.440788 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632b518-b11e-4c27-9d15-7f130812c9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:49.441065 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632b518-b11e-4c27-9d15-7f130812c9e2 None admin] PATH_INFO: `/v3/users/a6d47188867a4d9384390f05eba70a8c` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:49.442426 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632b518-b11e-4c27-9d15-7f130812c9e2 None admin] RBAC: Authorizing `identity:get_user(user_id=a6d47188867a4d9384390f05eba70a8c)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:49.443952 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632b518-b11e-4c27-9d15-7f130812c9e2 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:49.445932 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 86/169] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:26:49 2022] GET /identity/v3/users/a6d47188867a4d9384390f05eba70a8c => generated 247 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:26:49.452684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f075d92-bbb6-40f8-96a9-7d3fb477f3c1 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:49.613928 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f075d92-bbb6-40f8-96a9-7d3fb477f3c1 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:49.615227 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b810c-adae-4663-8d86-93e3022b143d None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:49.615520 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b810c-adae-4663-8d86-93e3022b143d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:49.615815 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b810c-adae-4663-8d86-93e3022b143d None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:49.617158 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 87/170] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 03:26:49.622881 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943779fe-4504-41d2-a615-e89a57d3aab6 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:49.623170 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943779fe-4504-41d2-a615-e89a57d3aab6 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:49.623452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943779fe-4504-41d2-a615-e89a57d3aab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:49.662714 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-943779fe-4504-41d2-a615-e89a57d3aab6 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:26:49.663928 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-943779fe-4504-41d2-a615-e89a57d3aab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:26:49.675264 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525800c-dbeb-49b0-8f85-3d1da927f6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:49.675953 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525800c-dbeb-49b0-8f85-3d1da927f6db None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:49.676240 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525800c-dbeb-49b0-8f85-3d1da927f6db None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:49.676850 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525800c-dbeb-49b0-8f85-3d1da927f6db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:49.775552 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:49.794623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 88/171] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:26:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 03:26:49.801069 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525800c-dbeb-49b0-8f85-3d1da927f6db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:49.802595 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525800c-dbeb-49b0-8f85-3d1da927f6db None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:49.938918 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 84/172] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:26:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 03:26:49.945146 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943779fe-4504-41d2-a615-e89a57d3aab6 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:50.085546 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:50.097265 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943779fe-4504-41d2-a615-e89a57d3aab6 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:50.135153 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b451b-f4af-407d-9ab2-a95425deda06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:50.135801 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b451b-f4af-407d-9ab2-a95425deda06 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:50.136082 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b451b-f4af-407d-9ab2-a95425deda06 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:50.136363 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b451b-f4af-407d-9ab2-a95425deda06 None admin] PATH_INFO: `/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:50.137495 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b451b-f4af-407d-9ab2-a95425deda06 None admin] RBAC: Authorizing `identity:get_project(project_id=e01bdca6ef9f47b192f68f70ff0bbdad)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:50.138995 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b451b-f4af-407d-9ab2-a95425deda06 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:50.140804 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 89/173] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:26:49 2022] GET /identity/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:50.146732 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525800c-dbeb-49b0-8f85-3d1da927f6db None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:50.167557 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760348c5-8460-4a42-8848-30b755b0df88 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:50.167867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760348c5-8460-4a42-8848-30b755b0df88 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:50.168118 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760348c5-8460-4a42-8848-30b755b0df88 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:50.169817 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 90/174] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 03:26:50.175824 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb00b5-99ed-4767-93ed-e95a150f2225 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:50.176112 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb00b5-99ed-4767-93ed-e95a150f2225 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:50.176391 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb00b5-99ed-4767-93ed-e95a150f2225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:50.199768 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8cbb00b5-99ed-4767-93ed-e95a150f2225 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:26:50.200895 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8cbb00b5-99ed-4767-93ed-e95a150f2225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:26:50.248246 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:50.269290 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525800c-dbeb-49b0-8f85-3d1da927f6db None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:50.310028 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70586070-68b8-4d1e-b0bb-b70b77b9cde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:50.311000 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70586070-68b8-4d1e-b0bb-b70b77b9cde3 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:50.311498 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70586070-68b8-4d1e-b0bb-b70b77b9cde3 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:50.311960 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70586070-68b8-4d1e-b0bb-b70b77b9cde3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:50.312916 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70586070-68b8-4d1e-b0bb-b70b77b9cde3 None admin] RBAC: Adding query filter params (role.id=4ffac54101e248479bcdc0e54890020f, scope.project.id=e01bdca6ef9f47b192f68f70ff0bbdad, user.id=a6d47188867a4d9384390f05eba70a8c) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:26:50.313416 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70586070-68b8-4d1e-b0bb-b70b77b9cde3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:50.315196 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70586070-68b8-4d1e-b0bb-b70b77b9cde3 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:50.322703 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 85/175] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:26:50 2022] GET /identity/v3/role_assignments?user.id=a6d47188867a4d9384390f05eba70a8c&scope.project.id=e01bdca6ef9f47b192f68f70ff0bbdad&role.id=4ffac54101e248479bcdc0e54890020f => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:50.323729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70586070-68b8-4d1e-b0bb-b70b77b9cde3 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:50.331223 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 91/176] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:26:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 03:26:50.475296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70586070-68b8-4d1e-b0bb-b70b77b9cde3 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:50.526431 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b80d9-e7b5-45ce-9f1b-3494f211b35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:50.527095 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b80d9-e7b5-45ce-9f1b-3494f211b35b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:50.527384 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b80d9-e7b5-45ce-9f1b-3494f211b35b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:50.527664 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b80d9-e7b5-45ce-9f1b-3494f211b35b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:50.542625 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b80d9-e7b5-45ce-9f1b-3494f211b35b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:26:50.548267 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-2c2b80d9-e7b5-45ce-9f1b-3494f211b35b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 03:26:50.548267 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:26:50.548267 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:26:50.548267 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:26:50.548267 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:26:50.548267 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:26:50.548267 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:26:50.548267 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:26:50.548267 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:26:50.548267 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:26:50.548267 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:26:50.548267 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:26:50.548267 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:26:50.548267 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:26:50.548267 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:26:50.548267 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:26:50.549166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:26:50.549166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:26:50.549166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:26:50.549166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:26:50.549166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:26:50.549166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:26:50.549166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:26:50.549166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:26:50.549166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:26:50.549166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:26:50.549166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:26:50.549166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:26:50.549166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:26:50.549166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:26:50.549166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:26:50.549166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:26:50.549992 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:26:50.549992 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:26:50.549992 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:26:50.549992 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:26:50.549992 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:26:50.549992 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:26:50.549992 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:26:50.549992 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:26:50.549992 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:26:50.549992 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:26:50.549992 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 03:26:50.549992 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:26:50.549992 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 86/177] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:26:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:26:50.555536 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb00b5-99ed-4767-93ed-e95a150f2225 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:50.580558 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b7038-69e4-4095-8275-4eebee007108 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:50.580870 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b7038-69e4-4095-8275-4eebee007108 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:50.581102 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b7038-69e4-4095-8275-4eebee007108 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:50.582686 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 87/178] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 03:26:50.591073 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eadf35-7a40-42ab-87ea-5f66191e3985 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:50.591363 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eadf35-7a40-42ab-87ea-5f66191e3985 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:50.591641 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eadf35-7a40-42ab-87ea-5f66191e3985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:50.614134 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:50.617237 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-26eadf35-7a40-42ab-87ea-5f66191e3985 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:26:50.618609 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-26eadf35-7a40-42ab-87ea-5f66191e3985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:26:50.727253 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:50.742476 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 88/179] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:26:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:26:50.748680 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb00b5-99ed-4767-93ed-e95a150f2225 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:50.769662 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58796ad-d42c-42d9-974f-703e6d04478f None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:50.769967 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58796ad-d42c-42d9-974f-703e6d04478f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:50.770226 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58796ad-d42c-42d9-974f-703e6d04478f None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:50.772123 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 89/180] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 03:26:50.784191 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3aa8e-2f12-449a-bab2-c0c92cd90c43 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:50.784628 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3aa8e-2f12-449a-bab2-c0c92cd90c43 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:50.785019 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3aa8e-2f12-449a-bab2-c0c92cd90c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:50.800772 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc0ce1-f82f-4453-8987-0d374b762484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:50.801396 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc0ce1-f82f-4453-8987-0d374b762484 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:50.801711 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc0ce1-f82f-4453-8987-0d374b762484 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:50.801994 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc0ce1-f82f-4453-8987-0d374b762484 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:50.802675 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc0ce1-f82f-4453-8987-0d374b762484 None admin] RBAC: Adding query filter params (name=member) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:26:50.802979 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc0ce1-f82f-4453-8987-0d374b762484 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:50.804366 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc0ce1-f82f-4453-8987-0d374b762484 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:50.806098 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-fec3aa8e-2f12-449a-bab2-c0c92cd90c43 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:26:50.807507 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fec3aa8e-2f12-449a-bab2-c0c92cd90c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:26:50.822636 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 92/181] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 03:26:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:50.828238 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc0ce1-f82f-4453-8987-0d374b762484 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:50.884042 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 90/182] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:26:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 03:26:50.885022 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3aa8e-2f12-449a-bab2-c0c92cd90c43 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:50.962071 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc0ce1-f82f-4453-8987-0d374b762484 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:51.237748 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:51.238252 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc800ce6-3eae-4ef6-a48c-e52e96a69179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:51.238252 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc800ce6-3eae-4ef6-a48c-e52e96a69179 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:51.238252 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc800ce6-3eae-4ef6-a48c-e52e96a69179 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:51.238252 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc800ce6-3eae-4ef6-a48c-e52e96a69179 None admin] PATH_INFO: `/v3/users/8b1624609cc944cd86ca9c71ee9d61d0` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:51.238830 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc800ce6-3eae-4ef6-a48c-e52e96a69179 None admin] RBAC: Authorizing `identity:get_user(user_id=8b1624609cc944cd86ca9c71ee9d61d0)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:51.238830 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc800ce6-3eae-4ef6-a48c-e52e96a69179 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:51.238830 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 93/183] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:26:50 2022] GET /identity/v3/users/8b1624609cc944cd86ca9c71ee9d61d0 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:51.238830 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523af73-e748-435f-bb6b-2202550d3022 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:51.238830 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523af73-e748-435f-bb6b-2202550d3022 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:51.238830 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523af73-e748-435f-bb6b-2202550d3022 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:51.239196 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 94/184] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:26:51.239266 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3aa8e-2f12-449a-bab2-c0c92cd90c43 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:51.239338 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9778568-aa86-4f1c-955f-e6227a5cfcb6 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:51.239338 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9778568-aa86-4f1c-955f-e6227a5cfcb6 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:51.239338 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9778568-aa86-4f1c-955f-e6227a5cfcb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:51.239338 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a9778568-aa86-4f1c-955f-e6227a5cfcb6 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:26:51.239338 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a9778568-aa86-4f1c-955f-e6227a5cfcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:26:51.239642 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaca8ea-5af6-4045-95a0-3d41c67039a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:51.239642 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaca8ea-5af6-4045-95a0-3d41c67039a2 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:51.239789 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:51.239862 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaca8ea-5af6-4045-95a0-3d41c67039a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:51.239862 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaca8ea-5af6-4045-95a0-3d41c67039a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:51.239862 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaca8ea-5af6-4045-95a0-3d41c67039a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:26:51.239862 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-edaca8ea-5af6-4045-95a0-3d41c67039a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:26:51.239862 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:26:51.239862 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:26:51.239862 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:26:51.239862 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:26:51.239862 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:26:51.239862 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:26:51.240404 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:26:51.240404 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:26:51.240404 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:26:51.240404 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:26:51.240404 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:26:51.240404 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:26:51.240404 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:26:51.240404 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:26:51.240404 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:26:51.240404 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:26:51.240404 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:26:51.240404 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:26:51.240404 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:26:51.240404 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:26:51.240404 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:26:51.240404 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:26:51.240404 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:26:51.241273 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:26:51.241273 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:26:51.241273 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:26:51.241273 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:26:51.241273 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:26:51.241273 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:26:51.241273 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:26:51.241273 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:26:51.241273 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:26:51.241273 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:26:51.241273 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:26:51.241273 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:26:51.241273 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:26:51.241273 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:26:51.241273 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:26:51.241273 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:26:51.241273 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:26:51.242250 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:26:51.242250 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:26:51.242250 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:26:51.242250 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 91/185] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 03:26:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:26:51.242250 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaca8ea-5af6-4045-95a0-3d41c67039a2 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:51.242540 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 95/186] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:26:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:26:51.242540 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9778568-aa86-4f1c-955f-e6227a5cfcb6 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:51.242677 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaca8ea-5af6-4045-95a0-3d41c67039a2 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:51.242677 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84767f-2d5e-4fb2-a31e-98776a1c558b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:51.242677 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84767f-2d5e-4fb2-a31e-98776a1c558b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:51.242677 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84767f-2d5e-4fb2-a31e-98776a1c558b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:51.242961 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84767f-2d5e-4fb2-a31e-98776a1c558b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:51.243036 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9778568-aa86-4f1c-955f-e6227a5cfcb6 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:51.255118 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:51.266850 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6e346-b119-450e-b0e7-ce48f601b31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:51.267479 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6e346-b119-450e-b0e7-ce48f601b31d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:51.267812 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6e346-b119-450e-b0e7-ce48f601b31d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:51.268092 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6e346-b119-450e-b0e7-ce48f601b31d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:51.269275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad6e346-b119-450e-b0e7-ce48f601b31d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:51.271113 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad6e346-b119-450e-b0e7-ce48f601b31d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:51.272664 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 96/187] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:26:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:51.277337 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6e346-b119-450e-b0e7-ce48f601b31d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:51.294133 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:51.309210 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d84767f-2d5e-4fb2-a31e-98776a1c558b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:51.310798 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d84767f-2d5e-4fb2-a31e-98776a1c558b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:51.378881 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6e346-b119-450e-b0e7-ce48f601b31d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:51.413951 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 92/188] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:26:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 03:26:51.414546 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7e056-cda9-40a1-8c3d-c8fca6b7357d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:51.415293 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84767f-2d5e-4fb2-a31e-98776a1c558b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:51.415725 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7e056-cda9-40a1-8c3d-c8fca6b7357d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:51.415958 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7e056-cda9-40a1-8c3d-c8fca6b7357d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:51.416230 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7e056-cda9-40a1-8c3d-c8fca6b7357d None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:51.416896 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7e056-cda9-40a1-8c3d-c8fca6b7357d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:26:51.417194 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7e056-cda9-40a1-8c3d-c8fca6b7357d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:51.418602 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7e056-cda9-40a1-8c3d-c8fca6b7357d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:51.428010 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 97/189] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:26:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:51.429070 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7e056-cda9-40a1-8c3d-c8fca6b7357d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:51.443159 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:51.507003 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:51.513868 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84767f-2d5e-4fb2-a31e-98776a1c558b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:51.529478 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7e056-cda9-40a1-8c3d-c8fca6b7357d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:51.548140 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b77d3e-c6b7-46b2-9dfc-7f2cac995273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:51.548769 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b77d3e-c6b7-46b2-9dfc-7f2cac995273 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:51.549051 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b77d3e-c6b7-46b2-9dfc-7f2cac995273 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:51.549335 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b77d3e-c6b7-46b2-9dfc-7f2cac995273 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:51.559159 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b77d3e-c6b7-46b2-9dfc-7f2cac995273 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:26:51.562350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc708825-e1c4-413b-8e96-a28b821ed216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:51.562956 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc708825-e1c4-413b-8e96-a28b821ed216 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:51.563235 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc708825-e1c4-413b-8e96-a28b821ed216 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:51.563508 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc708825-e1c4-413b-8e96-a28b821ed216 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:51.564029 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-07b77d3e-c6b7-46b2-9dfc-7f2cac995273 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 03:26:51.564029 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:26:51.564029 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:26:51.564029 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:26:51.564029 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:26:51.564029 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:26:51.564029 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:26:51.564029 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:26:51.564029 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:26:51.564029 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:26:51.564029 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:26:51.564029 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:26:51.564029 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:26:51.564029 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:26:51.564029 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:26:51.564029 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:26:51.565051 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:26:51.565051 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:26:51.565051 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:26:51.565051 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:26:51.565051 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:26:51.565051 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:26:51.565051 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:26:51.565051 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:26:51.565051 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:26:51.565051 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:26:51.565051 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:26:51.565051 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:26:51.565051 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:26:51.565051 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:26:51.565051 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:26:51.565051 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:26:51.565886 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:26:51.565886 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:26:51.565886 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:26:51.565886 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:26:51.565886 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:26:51.565886 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:26:51.565886 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:26:51.565886 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:26:51.565886 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:26:51.565886 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:26:51.565886 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 03:26:51.565886 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:26:51.566494 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc708825-e1c4-413b-8e96-a28b821ed216 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:51.566572 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 93/190] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 03:26:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:26:51.566572 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b77d3e-c6b7-46b2-9dfc-7f2cac995273 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:51.567287 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc708825-e1c4-413b-8e96-a28b821ed216 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:51.650626 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:51.664657 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b77d3e-c6b7-46b2-9dfc-7f2cac995273 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:51.693257 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 98/191] 10.222.0.33 () {60 vars in 1132 bytes} [Fri Sep 16 03:26:51 2022] POST /identity/v3/users => generated 297 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:26:51.693257 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc708825-e1c4-413b-8e96-a28b821ed216 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:51.705348 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a82a07-590b-4b53-bac3-53d5afc76d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:51.706285 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a82a07-590b-4b53-bac3-53d5afc76d25 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:51.710325 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a82a07-590b-4b53-bac3-53d5afc76d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:51.710325 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a82a07-590b-4b53-bac3-53d5afc76d25 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:51.722449 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a82a07-590b-4b53-bac3-53d5afc76d25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:26:51.729100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-a3a82a07-590b-4b53-bac3-53d5afc76d25 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 03:26:51.729100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:26:51.729100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:26:51.729100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:26:51.729100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:26:51.729100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:26:51.729100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:26:51.729100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:26:51.729100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:26:51.729100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:26:51.729100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:26:51.729100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:26:51.729100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:26:51.729100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:26:51.729100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:26:51.729100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:26:51.730131 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:26:51.730131 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:26:51.730131 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:26:51.730131 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:26:51.730131 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:26:51.730131 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:26:51.730131 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:26:51.730131 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:26:51.730131 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:26:51.730131 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:26:51.730131 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:26:51.730131 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:26:51.730131 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:26:51.730131 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:26:51.730131 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:26:51.730131 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:26:51.730949 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:26:51.730949 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:26:51.730949 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:26:51.730949 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:26:51.730949 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:26:51.730949 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:26:51.730949 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:26:51.730949 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:26:51.730949 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:26:51.730949 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:26:51.730949 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 03:26:51.730949 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:26:51.730949 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 94/192] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:26:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:26:51.731638 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a82a07-590b-4b53-bac3-53d5afc76d25 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:51.822061 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc708825-e1c4-413b-8e96-a28b821ed216 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:51.847892 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a82a07-590b-4b53-bac3-53d5afc76d25 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:51.855518 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:51.861313 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de92b2-084a-4346-a527-4a3723eb2f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:51.862075 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de92b2-084a-4346-a527-4a3723eb2f76 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:51.862354 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de92b2-084a-4346-a527-4a3723eb2f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:51.862625 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de92b2-084a-4346-a527-4a3723eb2f76 None admin] PATH_INFO: `/v3/projects/e4619c468b984829b2b07ecd02f668d2` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:51.863979 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de92b2-084a-4346-a527-4a3723eb2f76 None admin] RBAC: Authorizing `identity:get_project(project_id=e4619c468b984829b2b07ecd02f668d2)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:51.865530 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de92b2-084a-4346-a527-4a3723eb2f76 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:51.870043 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 99/193] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:26:51 2022] GET /identity/v3/projects/e4619c468b984829b2b07ecd02f668d2 => generated 312 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:51.870043 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de92b2-084a-4346-a527-4a3723eb2f76 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:51.891389 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca402d-a2eb-4189-8a24-ee542c0440f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:51.891705 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca402d-a2eb-4189-8a24-ee542c0440f1 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:51.891990 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca402d-a2eb-4189-8a24-ee542c0440f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:51.892265 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca402d-a2eb-4189-8a24-ee542c0440f1 None admin] PATH_INFO: `/v3/users/9a90b2ade3ae420ab8b71ea111494ebb` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:51.909397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cca402d-a2eb-4189-8a24-ee542c0440f1 None admin] RBAC: Authorizing `identity:get_user(user_id=9a90b2ade3ae420ab8b71ea111494ebb)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:51.910957 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cca402d-a2eb-4189-8a24-ee542c0440f1 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:51.912793 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 95/194] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:26:51 2022] GET /identity/v3/users/9a90b2ade3ae420ab8b71ea111494ebb => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:51.913409 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca402d-a2eb-4189-8a24-ee542c0440f1 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:51.922807 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:51.992725 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de92b2-084a-4346-a527-4a3723eb2f76 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:52.039294 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca402d-a2eb-4189-8a24-ee542c0440f1 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:52.040538 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2d35e-2156-403b-b603-23f33f7f66bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:52.041156 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2d35e-2156-403b-b603-23f33f7f66bf None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:52.041587 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2d35e-2156-403b-b603-23f33f7f66bf None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:52.041781 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2d35e-2156-403b-b603-23f33f7f66bf None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:52.042413 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e2d35e-2156-403b-b603-23f33f7f66bf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:26:52.042691 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e2d35e-2156-403b-b603-23f33f7f66bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:52.044437 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e2d35e-2156-403b-b603-23f33f7f66bf None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:52.053007 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 100/195] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:26:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:52.053896 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2d35e-2156-403b-b603-23f33f7f66bf None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:52.086014 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb6934-1a30-4b91-ad15-16aa12945c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:52.086292 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb6934-1a30-4b91-ad15-16aa12945c2e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:52.087114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb6934-1a30-4b91-ad15-16aa12945c2e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:52.087400 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb6934-1a30-4b91-ad15-16aa12945c2e None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:52.088122 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb6934-1a30-4b91-ad15-16aa12945c2e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:26:52.088448 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb6934-1a30-4b91-ad15-16aa12945c2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:52.089861 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb6934-1a30-4b91-ad15-16aa12945c2e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:52.099428 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 96/196] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 03:26:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:52.101439 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb6934-1a30-4b91-ad15-16aa12945c2e None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:52.136582 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:52.173427 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:52.185338 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2d35e-2156-403b-b603-23f33f7f66bf None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:52.215064 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb6934-1a30-4b91-ad15-16aa12945c2e None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:52.225507 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ddcfb4-05bc-43a3-93ff-69365fe4e73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:52.226689 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddcfb4-05bc-43a3-93ff-69365fe4e73f None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:52.227341 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddcfb4-05bc-43a3-93ff-69365fe4e73f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:52.227897 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddcfb4-05bc-43a3-93ff-69365fe4e73f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:52.228769 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ddcfb4-05bc-43a3-93ff-69365fe4e73f None admin] RBAC: Adding query filter params (role.id=7591562cf9564b288c108609d8e334b3, scope.project.id=e4619c468b984829b2b07ecd02f668d2, user.id=8b1624609cc944cd86ca9c71ee9d61d0) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:26:52.229224 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ddcfb4-05bc-43a3-93ff-69365fe4e73f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:52.230852 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ddcfb4-05bc-43a3-93ff-69365fe4e73f None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:52.237817 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 101/197] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:26:52 2022] GET /identity/v3/role_assignments?user.id=8b1624609cc944cd86ca9c71ee9d61d0&scope.project.id=e4619c468b984829b2b07ecd02f668d2&role.id=7591562cf9564b288c108609d8e334b3 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:52.239193 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ddcfb4-05bc-43a3-93ff-69365fe4e73f None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:52.254036 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ced906-2e13-477d-83ea-26eccb8c5a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:52.254875 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ced906-2e13-477d-83ea-26eccb8c5a2d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:52.255595 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ced906-2e13-477d-83ea-26eccb8c5a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:52.255763 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ced906-2e13-477d-83ea-26eccb8c5a2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:52.333823 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ced906-2e13-477d-83ea-26eccb8c5a2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:52.335446 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ced906-2e13-477d-83ea-26eccb8c5a2d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:52.367442 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ddcfb4-05bc-43a3-93ff-69365fe4e73f None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:52.398329 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:52.405540 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:52.409041 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a70f16-451a-40d8-9de1-c00c68c169e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:52.409868 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a70f16-451a-40d8-9de1-c00c68c169e3 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:52.416207 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a70f16-451a-40d8-9de1-c00c68c169e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:52.416207 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a70f16-451a-40d8-9de1-c00c68c169e3 None admin] PATH_INFO: `/v3/users/9a90b2ade3ae420ab8b71ea111494ebb` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:52.416207 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a70f16-451a-40d8-9de1-c00c68c169e3 None admin] RBAC: Authorizing `identity:get_user(user_id=9a90b2ade3ae420ab8b71ea111494ebb)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:52.416207 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a70f16-451a-40d8-9de1-c00c68c169e3 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:52.416642 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 102/198] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:26:52 2022] GET /identity/v3/users/9a90b2ade3ae420ab8b71ea111494ebb => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:52.418122 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a70f16-451a-40d8-9de1-c00c68c169e3 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:52.470130 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 97/199] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:26:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 03:26:52.471045 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ced906-2e13-477d-83ea-26eccb8c5a2d None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:52.534273 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a70f16-451a-40d8-9de1-c00c68c169e3 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:52.572552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54faa88c-0c2e-429b-a514-2cd475937843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:52.573189 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54faa88c-0c2e-429b-a514-2cd475937843 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:52.573468 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54faa88c-0c2e-429b-a514-2cd475937843 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:52.573765 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54faa88c-0c2e-429b-a514-2cd475937843 None admin] PATH_INFO: `/v3/users/1644481571e5426f870870bbf4682548` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:52.575081 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54faa88c-0c2e-429b-a514-2cd475937843 None admin] RBAC: Authorizing `identity:get_user(user_id=1644481571e5426f870870bbf4682548)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:52.577325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54faa88c-0c2e-429b-a514-2cd475937843 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:52.579107 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 103/200] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:26:52 2022] GET /identity/v3/users/1644481571e5426f870870bbf4682548 => generated 289 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:52.579764 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54faa88c-0c2e-429b-a514-2cd475937843 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:52.614162 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ced906-2e13-477d-83ea-26eccb8c5a2d None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:52.646199 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:52.656292 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3649c-ae80-48f5-867e-8b36b96aadc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:52.657174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3649c-ae80-48f5-867e-8b36b96aadc4 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:52.665488 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3649c-ae80-48f5-867e-8b36b96aadc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:52.665488 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3649c-ae80-48f5-867e-8b36b96aadc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:52.687399 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54faa88c-0c2e-429b-a514-2cd475937843 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:52.707336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:52.728016 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768e5f0-9890-40f5-9eee-6b7913c74339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:52.728245 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768e5f0-9890-40f5-9eee-6b7913c74339 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:52.728410 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768e5f0-9890-40f5-9eee-6b7913c74339 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:52.728638 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768e5f0-9890-40f5-9eee-6b7913c74339 None admin] PATH_INFO: `/v3/projects/f14af8f557914f4291de2295e89b8249` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:52.731691 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768e5f0-9890-40f5-9eee-6b7913c74339 None admin] RBAC: Authorizing `identity:get_project(project_id=f14af8f557914f4291de2295e89b8249)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:52.733147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768e5f0-9890-40f5-9eee-6b7913c74339 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:52.737761 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 104/201] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:26:52 2022] GET /identity/v3/projects/f14af8f557914f4291de2295e89b8249 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:52.737761 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768e5f0-9890-40f5-9eee-6b7913c74339 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:52.762825 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf3649c-ae80-48f5-867e-8b36b96aadc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:52.764974 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf3649c-ae80-48f5-867e-8b36b96aadc4 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:52.870284 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768e5f0-9890-40f5-9eee-6b7913c74339 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:52.898297 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 98/202] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:26:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 03:26:52.899745 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3649c-ae80-48f5-867e-8b36b96aadc4 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:52.906234 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:52.912002 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42170990-13b3-4f44-acf1-562c9fb8e0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:52.912776 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42170990-13b3-4f44-acf1-562c9fb8e0ba None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:52.912977 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42170990-13b3-4f44-acf1-562c9fb8e0ba None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:52.913251 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42170990-13b3-4f44-acf1-562c9fb8e0ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:52.975384 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:52.994444 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42170990-13b3-4f44-acf1-562c9fb8e0ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:52.996061 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42170990-13b3-4f44-acf1-562c9fb8e0ba None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:53.011774 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3649c-ae80-48f5-867e-8b36b96aadc4 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:53.050700 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9dad5-a49b-4a7e-a6f1-bddc71a5d7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:53.051307 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9dad5-a49b-4a7e-a6f1-bddc71a5d7c0 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:53.051636 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9dad5-a49b-4a7e-a6f1-bddc71a5d7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:53.051958 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9dad5-a49b-4a7e-a6f1-bddc71a5d7c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:53.052776 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f9dad5-a49b-4a7e-a6f1-bddc71a5d7c0 None admin] RBAC: Adding query filter params (role.id=4ffac54101e248479bcdc0e54890020f, scope.project.id=f14af8f557914f4291de2295e89b8249, user.id=9a90b2ade3ae420ab8b71ea111494ebb) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:26:53.053085 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f9dad5-a49b-4a7e-a6f1-bddc71a5d7c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:53.054641 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f9dad5-a49b-4a7e-a6f1-bddc71a5d7c0 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:53.069677 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 99/203] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:26:52 2022] GET /identity/v3/role_assignments?user.id=9a90b2ade3ae420ab8b71ea111494ebb&scope.project.id=f14af8f557914f4291de2295e89b8249&role.id=4ffac54101e248479bcdc0e54890020f => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:53.069677 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9dad5-a49b-4a7e-a6f1-bddc71a5d7c0 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:53.174323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 105/204] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:26:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 03:26:53.179799 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42170990-13b3-4f44-acf1-562c9fb8e0ba None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:53.242472 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:53.269433 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9dad5-a49b-4a7e-a6f1-bddc71a5d7c0 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:53.306292 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:53.317670 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6dee4-7db5-4c28-a710-eca4bd3599f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:53.317670 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6dee4-7db5-4c28-a710-eca4bd3599f5 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:53.317670 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6dee4-7db5-4c28-a710-eca4bd3599f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:53.317670 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6dee4-7db5-4c28-a710-eca4bd3599f5 None admin] PATH_INFO: `/v3/projects/f14af8f557914f4291de2295e89b8249` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:53.327649 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc6dee4-7db5-4c28-a710-eca4bd3599f5 None admin] RBAC: Authorizing `identity:get_project(project_id=f14af8f557914f4291de2295e89b8249)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:53.327649 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc6dee4-7db5-4c28-a710-eca4bd3599f5 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:53.327649 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 100/205] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:26:53 2022] GET /identity/v3/projects/f14af8f557914f4291de2295e89b8249 => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:53.328074 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6dee4-7db5-4c28-a710-eca4bd3599f5 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:53.382432 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42170990-13b3-4f44-acf1-562c9fb8e0ba None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:53.421746 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b1467d-238d-41c6-ae21-ffff0cf7ac18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:53.422384 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1467d-238d-41c6-ae21-ffff0cf7ac18 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:53.422668 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1467d-238d-41c6-ae21-ffff0cf7ac18 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:53.422939 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1467d-238d-41c6-ae21-ffff0cf7ac18 None admin] PATH_INFO: `/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:53.424062 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b1467d-238d-41c6-ae21-ffff0cf7ac18 None admin] RBAC: Authorizing `identity:get_project(project_id=e01bdca6ef9f47b192f68f70ff0bbdad)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:53.425563 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b1467d-238d-41c6-ae21-ffff0cf7ac18 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:53.427763 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 106/206] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:26:53 2022] GET /identity/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:26:53.435456 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b1467d-238d-41c6-ae21-ffff0cf7ac18 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:53.553142 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:53.556406 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b1467d-238d-41c6-ae21-ffff0cf7ac18 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:53.574661 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6dee4-7db5-4c28-a710-eca4bd3599f5 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:53.616924 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305e3f6-b5e9-4bc5-8bad-58a565c4754f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:53.617523 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305e3f6-b5e9-4bc5-8bad-58a565c4754f None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:53.617889 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305e3f6-b5e9-4bc5-8bad-58a565c4754f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:53.618166 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305e3f6-b5e9-4bc5-8bad-58a565c4754f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:53.618899 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305e3f6-b5e9-4bc5-8bad-58a565c4754f None admin] RBAC: Adding query filter params (role.id=35fd8044264e4590a6dcfeabaf194c78, scope.project.id=e01bdca6ef9f47b192f68f70ff0bbdad, user.id=1644481571e5426f870870bbf4682548) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:26:53.619209 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305e3f6-b5e9-4bc5-8bad-58a565c4754f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:53.620657 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305e3f6-b5e9-4bc5-8bad-58a565c4754f None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:53.634371 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 107/207] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:26:53 2022] GET /identity/v3/role_assignments?user.id=1644481571e5426f870870bbf4682548&scope.project.id=e01bdca6ef9f47b192f68f70ff0bbdad&role.id=35fd8044264e4590a6dcfeabaf194c78 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:53.636339 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7321c-1ff9-49a1-8710-8f6088c0d48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:53.636948 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7321c-1ff9-49a1-8710-8f6088c0d48b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:53.637230 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7321c-1ff9-49a1-8710-8f6088c0d48b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:53.637500 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7321c-1ff9-49a1-8710-8f6088c0d48b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:53.638270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7321c-1ff9-49a1-8710-8f6088c0d48b None admin] RBAC: Adding query filter params (role.id=fcb362c8a9fd47fbbb6b14397cae171c, scope.project.id=f14af8f557914f4291de2295e89b8249, user.id=9a90b2ade3ae420ab8b71ea111494ebb) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:26:53.638577 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7321c-1ff9-49a1-8710-8f6088c0d48b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:53.640085 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7321c-1ff9-49a1-8710-8f6088c0d48b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:53.647132 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 101/208] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:26:53 2022] GET /identity/v3/role_assignments?user.id=9a90b2ade3ae420ab8b71ea111494ebb&scope.project.id=f14af8f557914f4291de2295e89b8249&role.id=fcb362c8a9fd47fbbb6b14397cae171c => generated 259 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:26:54.302201 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66185fb2-bca1-45c3-8073-a281732004f7 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:54.302704 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66185fb2-bca1-45c3-8073-a281732004f7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:54.302778 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66185fb2-bca1-45c3-8073-a281732004f7 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:54.304401 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 108/209] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:26:54.309706 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51271990-4794-43c1-bf04-efdd4fe5f760 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:54.310120 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51271990-4794-43c1-bf04-efdd4fe5f760 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:54.310263 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51271990-4794-43c1-bf04-efdd4fe5f760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:54.334125 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-51271990-4794-43c1-bf04-efdd4fe5f760 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:26:54.335327 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-51271990-4794-43c1-bf04-efdd4fe5f760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:26:54.368758 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c17e9b-40d8-489c-baea-e74a50a91e3b None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:54.369496 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c17e9b-40d8-489c-baea-e74a50a91e3b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:54.370022 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c17e9b-40d8-489c-baea-e74a50a91e3b None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:54.371705 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 109/210] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:26:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:26:54.377228 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12eeeb-6315-4a8a-b430-98c773f06835 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:54.377800 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12eeeb-6315-4a8a-b430-98c773f06835 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:54.378308 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12eeeb-6315-4a8a-b430-98c773f06835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:54.397363 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8b12eeeb-6315-4a8a-b430-98c773f06835 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:26:54.398136 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:54.399257 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8b12eeeb-6315-4a8a-b430-98c773f06835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:26:54.410249 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 102/211] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:26:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:26:54.474847 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 110/212] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:26:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 03:26:54.687017 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51271990-4794-43c1-bf04-efdd4fe5f760 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:54.746610 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12eeeb-6315-4a8a-b430-98c773f06835 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:54.808532 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51271990-4794-43c1-bf04-efdd4fe5f760 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:54.851884 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71291c8-77be-44d0-b51f-ff825f8e66da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:54.854240 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:54.854492 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71291c8-77be-44d0-b51f-ff825f8e66da None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:54.855909 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71291c8-77be-44d0-b51f-ff825f8e66da None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:54.856393 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71291c8-77be-44d0-b51f-ff825f8e66da None admin] PATH_INFO: `/v3/roles/member` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:54.865606 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12eeeb-6315-4a8a-b430-98c773f06835 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:54.873968 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71291c8-77be-44d0-b51f-ff825f8e66da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:26:54.874085 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-f71291c8-77be-44d0-b51f-ff825f8e66da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 03:26:54.874085 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:26:54.874085 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:26:54.874085 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:26:54.874085 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:26:54.874085 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:26:54.874085 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:26:54.874085 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:26:54.874085 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:26:54.874085 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:26:54.874085 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:26:54.874085 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:26:54.874085 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:26:54.874085 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:26:54.874085 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:26:54.874085 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:26:54.874902 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:26:54.874902 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:26:54.874902 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:26:54.874902 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:26:54.874902 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:26:54.874902 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:26:54.874902 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:26:54.874902 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:26:54.874902 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:26:54.874902 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:26:54.874902 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:26:54.874902 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:26:54.874902 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:26:54.874902 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:26:54.874902 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:26:54.874902 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:26:54.875686 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:26:54.875686 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:26:54.875686 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:26:54.875686 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:26:54.875686 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:26:54.875686 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:26:54.875686 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:26:54.875686 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:26:54.875686 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:26:54.875686 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:26:54.875686 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 03:26:54.875686 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:26:54.875686 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 103/213] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:26:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:26:54.881096 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71291c8-77be-44d0-b51f-ff825f8e66da None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:54.910255 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23358a30-1843-429e-9aec-49a1f7f793fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:54.911223 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23358a30-1843-429e-9aec-49a1f7f793fd None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:54.911691 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23358a30-1843-429e-9aec-49a1f7f793fd None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:54.912104 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23358a30-1843-429e-9aec-49a1f7f793fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:54.913370 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23358a30-1843-429e-9aec-49a1f7f793fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:54.916696 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23358a30-1843-429e-9aec-49a1f7f793fd None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:54.918524 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 111/214] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:26:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:26:54.929655 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23358a30-1843-429e-9aec-49a1f7f793fd None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:54.939109 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:54.988289 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71291c8-77be-44d0-b51f-ff825f8e66da None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:55.024169 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30762c-981d-465b-a54a-b8d82445cad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:55.025000 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30762c-981d-465b-a54a-b8d82445cad4 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:55.025385 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30762c-981d-465b-a54a-b8d82445cad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:55.025798 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30762c-981d-465b-a54a-b8d82445cad4 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:55.026605 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef30762c-981d-465b-a54a-b8d82445cad4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:26:55.027017 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef30762c-981d-465b-a54a-b8d82445cad4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:55.028525 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef30762c-981d-465b-a54a-b8d82445cad4 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:55.030479 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23358a30-1843-429e-9aec-49a1f7f793fd None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:55.042632 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 104/215] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 03:26:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:55.044108 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30762c-981d-465b-a54a-b8d82445cad4 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:55.065251 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9af040-03e5-4a74-b5b0-543ebc444016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:55.065899 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9af040-03e5-4a74-b5b0-543ebc444016 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:55.066179 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9af040-03e5-4a74-b5b0-543ebc444016 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:55.066447 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9af040-03e5-4a74-b5b0-543ebc444016 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:55.067107 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9af040-03e5-4a74-b5b0-543ebc444016 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:55.069002 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9af040-03e5-4a74-b5b0-543ebc444016 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:55.153587 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 112/216] 10.222.0.33 () {60 vars in 1132 bytes} [Fri Sep 16 03:26:54 2022] POST /identity/v3/users => generated 297 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:26:55.160210 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30762c-981d-465b-a54a-b8d82445cad4 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:55.178071 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:55.201528 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819efb08-7875-4bb0-8b81-7abbc028f576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:55.202167 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819efb08-7875-4bb0-8b81-7abbc028f576 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:55.202452 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819efb08-7875-4bb0-8b81-7abbc028f576 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:55.202772 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819efb08-7875-4bb0-8b81-7abbc028f576 None admin] PATH_INFO: `/v3/users/a7c3e9c0353a4efaab5ddd634194706c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:55.220305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819efb08-7875-4bb0-8b81-7abbc028f576 None admin] RBAC: Authorizing `identity:get_user(user_id=a7c3e9c0353a4efaab5ddd634194706c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:55.221892 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819efb08-7875-4bb0-8b81-7abbc028f576 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:55.228755 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 105/217] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:26:55 2022] GET /identity/v3/users/a7c3e9c0353a4efaab5ddd634194706c => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:26:55.230233 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9af040-03e5-4a74-b5b0-543ebc444016 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:55.258100 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:55.344695 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9af040-03e5-4a74-b5b0-543ebc444016 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:55.380460 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476fca0-6fd1-4afb-a006-200633b4bd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:55.381136 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476fca0-6fd1-4afb-a006-200633b4bd86 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:55.381503 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476fca0-6fd1-4afb-a006-200633b4bd86 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:55.381813 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476fca0-6fd1-4afb-a006-200633b4bd86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:55.461165 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476fca0-6fd1-4afb-a006-200633b4bd86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:55.463235 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476fca0-6fd1-4afb-a006-200633b4bd86 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:55.482484 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:55.521488 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9edef-7386-45db-8a0c-61bac4e4218b None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:55.522373 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9edef-7386-45db-8a0c-61bac4e4218b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:55.522805 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9edef-7386-45db-8a0c-61bac4e4218b None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:55.525179 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 106/218] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:26:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:26:55.531809 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae29ac-87ab-4437-be26-43d266740b4c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:55.532088 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae29ac-87ab-4437-be26-43d266740b4c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:55.532364 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae29ac-87ab-4437-be26-43d266740b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:55.557205 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f1ae29ac-87ab-4437-be26-43d266740b4c None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:26:55.558503 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f1ae29ac-87ab-4437-be26-43d266740b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:26:55.575038 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 113/219] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:26:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 03:26:55.582037 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476fca0-6fd1-4afb-a006-200633b4bd86 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:55.662998 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 107/220] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:26:55.748504 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476fca0-6fd1-4afb-a006-200633b4bd86 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:55.768880 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:55.795691 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca5de1-ea0e-4fea-a869-dc965b7e9ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:55.796380 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca5de1-ea0e-4fea-a869-dc965b7e9ed2 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:55.796656 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca5de1-ea0e-4fea-a869-dc965b7e9ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:55.796925 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca5de1-ea0e-4fea-a869-dc965b7e9ed2 None admin] PATH_INFO: `/v3/projects/f14af8f557914f4291de2295e89b8249` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:55.798157 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca5de1-ea0e-4fea-a869-dc965b7e9ed2 None admin] RBAC: Authorizing `identity:get_project(project_id=f14af8f557914f4291de2295e89b8249)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:55.799616 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca5de1-ea0e-4fea-a869-dc965b7e9ed2 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:55.801317 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 114/221] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:26:55 2022] GET /identity/v3/projects/f14af8f557914f4291de2295e89b8249 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:26:55.807536 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae29ac-87ab-4437-be26-43d266740b4c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:55.940031 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae29ac-87ab-4437-be26-43d266740b4c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:55.942122 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:55.995281 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b594d4-ad47-468b-b747-1b86b8c9ed7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:55.996576 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b594d4-ad47-468b-b747-1b86b8c9ed7e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:55.997282 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b594d4-ad47-468b-b747-1b86b8c9ed7e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:55.997576 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca5de1-ea0e-4fea-a869-dc965b7e9ed2 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:55.997869 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b594d4-ad47-468b-b747-1b86b8c9ed7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:55.999145 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b594d4-ad47-468b-b747-1b86b8c9ed7e None admin] RBAC: Adding query filter params (role.id=7591562cf9564b288c108609d8e334b3, scope.project.id=f14af8f557914f4291de2295e89b8249, user.id=a7c3e9c0353a4efaab5ddd634194706c) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:26:55.999411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b594d4-ad47-468b-b747-1b86b8c9ed7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:56.001110 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b594d4-ad47-468b-b747-1b86b8c9ed7e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:56.008120 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 108/222] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:26:55 2022] GET /identity/v3/role_assignments?user.id=a7c3e9c0353a4efaab5ddd634194706c&scope.project.id=f14af8f557914f4291de2295e89b8249&role.id=7591562cf9564b288c108609d8e334b3 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:56.061152 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef780c-06af-49b3-be4c-efec3cf2d6fc None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:56.061598 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef780c-06af-49b3-be4c-efec3cf2d6fc None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:56.062017 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef780c-06af-49b3-be4c-efec3cf2d6fc None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:56.063917 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 109/223] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:26:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 03:26:56.070293 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd2dd5-8bf1-41f0-95a0-ebfd079e0d85 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:56.071023 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd2dd5-8bf1-41f0-95a0-ebfd079e0d85 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:56.071405 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd2dd5-8bf1-41f0-95a0-ebfd079e0d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:56.094179 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5cdd2dd5-8bf1-41f0-95a0-ebfd079e0d85 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:26:56.095587 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5cdd2dd5-8bf1-41f0-95a0-ebfd079e0d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:26:56.207977 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 110/224] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:26:56.209306 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca5de1-ea0e-4fea-a869-dc965b7e9ed2 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:56.254388 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46aa09-9d03-4b66-aa26-2735e43defc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:56.254944 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46aa09-9d03-4b66-aa26-2735e43defc9 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:56.255225 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46aa09-9d03-4b66-aa26-2735e43defc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:56.255501 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46aa09-9d03-4b66-aa26-2735e43defc9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:56.266513 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b46aa09-9d03-4b66-aa26-2735e43defc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:26:56.272328 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-4b46aa09-9d03-4b66-aa26-2735e43defc9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:26:56.272328 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:26:56.272328 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:26:56.272328 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:26:56.272328 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:26:56.272328 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:26:56.272328 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:26:56.272328 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:26:56.272328 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:26:56.272328 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:26:56.272328 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:26:56.272328 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:26:56.272328 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:26:56.272328 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:26:56.272328 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:26:56.272328 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:26:56.273214 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:26:56.273214 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:26:56.273214 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:26:56.273214 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:26:56.273214 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:26:56.273214 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:26:56.273214 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:26:56.273214 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:26:56.273214 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:26:56.273214 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:26:56.273214 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:26:56.273214 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:26:56.273214 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:26:56.273214 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:26:56.273214 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:26:56.273214 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:26:56.274573 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:26:56.274573 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:26:56.274573 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:26:56.274573 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:26:56.274573 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:26:56.274573 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:26:56.274573 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:26:56.274573 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:26:56.274573 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:26:56.274573 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:26:56.274573 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:26:56.274573 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:26:56.274573 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 115/225] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 03:26:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:26:56.279725 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd2dd5-8bf1-41f0-95a0-ebfd079e0d85 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:56.412331 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:56.420605 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd2dd5-8bf1-41f0-95a0-ebfd079e0d85 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:56.470589 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebbe6fb-bf53-42d1-a183-22bb0967db90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:56.471228 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbe6fb-bf53-42d1-a183-22bb0967db90 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:56.471506 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbe6fb-bf53-42d1-a183-22bb0967db90 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:56.471776 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbe6fb-bf53-42d1-a183-22bb0967db90 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:56.472471 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebbe6fb-bf53-42d1-a183-22bb0967db90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:26:56.472843 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebbe6fb-bf53-42d1-a183-22bb0967db90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:56.474352 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebbe6fb-bf53-42d1-a183-22bb0967db90 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:56.486788 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 111/226] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:26:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:56.492497 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46aa09-9d03-4b66-aa26-2735e43defc9 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:56.551750 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:56.621546 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46aa09-9d03-4b66-aa26-2735e43defc9 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:56.662182 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ce1e8-f4cb-43f3-8eac-3dd46ce41033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:56.662817 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ce1e8-f4cb-43f3-8eac-3dd46ce41033 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:56.663094 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ce1e8-f4cb-43f3-8eac-3dd46ce41033 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:56.663365 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ce1e8-f4cb-43f3-8eac-3dd46ce41033 None admin] PATH_INFO: `/v3/users/9a90b2ade3ae420ab8b71ea111494ebb` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:56.670361 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ce1e8-f4cb-43f3-8eac-3dd46ce41033 None admin] RBAC: Authorizing `identity:get_user(user_id=9a90b2ade3ae420ab8b71ea111494ebb)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:56.671809 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ce1e8-f4cb-43f3-8eac-3dd46ce41033 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:56.673387 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 116/227] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:26:56 2022] GET /identity/v3/users/9a90b2ade3ae420ab8b71ea111494ebb => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:56.678395 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebbe6fb-bf53-42d1-a183-22bb0967db90 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:56.687699 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ce1e8-f4cb-43f3-8eac-3dd46ce41033 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:56.820713 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ce1e8-f4cb-43f3-8eac-3dd46ce41033 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:56.837359 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:56.861213 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf464c-f2e5-45cd-8034-9e86b67d62ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:56.862146 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf464c-f2e5-45cd-8034-9e86b67d62ce None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:56.862604 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf464c-f2e5-45cd-8034-9e86b67d62ce None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:56.863008 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf464c-f2e5-45cd-8034-9e86b67d62ce None admin] PATH_INFO: `/v3/projects/f14af8f557914f4291de2295e89b8249` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:56.864268 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf464c-f2e5-45cd-8034-9e86b67d62ce None admin] RBAC: Authorizing `identity:get_project(project_id=f14af8f557914f4291de2295e89b8249)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:56.866760 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf464c-f2e5-45cd-8034-9e86b67d62ce None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:56.878039 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 117/228] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:26:56 2022] GET /identity/v3/projects/f14af8f557914f4291de2295e89b8249 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:26:56.882265 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf464c-f2e5-45cd-8034-9e86b67d62ce None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:56.897229 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebbe6fb-bf53-42d1-a183-22bb0967db90 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:56.935420 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c60cf6-7fe2-48ab-9de3-98a38206beb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:56.936453 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c60cf6-7fe2-48ab-9de3-98a38206beb6 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:56.937372 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c60cf6-7fe2-48ab-9de3-98a38206beb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:56.937877 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c60cf6-7fe2-48ab-9de3-98a38206beb6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:56.949421 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c60cf6-7fe2-48ab-9de3-98a38206beb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:26:56.955929 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-13c60cf6-7fe2-48ab-9de3-98a38206beb6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 03:26:56.955929 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:26:56.955929 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:26:56.955929 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:26:56.955929 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:26:56.955929 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:26:56.955929 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:26:56.955929 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:26:56.955929 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:26:56.955929 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:26:56.955929 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:26:56.955929 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:26:56.955929 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:26:56.955929 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:26:56.955929 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:26:56.955929 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:26:56.956795 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:26:56.956795 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:26:56.956795 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:26:56.956795 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:26:56.956795 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:26:56.956795 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:26:56.956795 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:26:56.956795 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:26:56.956795 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:26:56.956795 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:26:56.956795 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:26:56.956795 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:26:56.956795 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:26:56.956795 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:26:56.956795 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:26:56.956795 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:26:56.957586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:26:56.957586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:26:56.957586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:26:56.957586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:26:56.957586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:26:56.957586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:26:56.957586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:26:56.957586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:26:56.957586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:26:56.957586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:26:56.957586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 03:26:56.957586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:26:56.960427 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 112/229] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 03:26:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:26:56.967034 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c60cf6-7fe2-48ab-9de3-98a38206beb6 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:56.988795 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:57.081901 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c60cf6-7fe2-48ab-9de3-98a38206beb6 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:57.123872 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba1e39-751d-4c32-8b3e-3ec9838db267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:57.125259 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba1e39-751d-4c32-8b3e-3ec9838db267 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:57.125775 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba1e39-751d-4c32-8b3e-3ec9838db267 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:57.126262 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba1e39-751d-4c32-8b3e-3ec9838db267 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:57.127132 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba1e39-751d-4c32-8b3e-3ec9838db267 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:26:57.127739 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba1e39-751d-4c32-8b3e-3ec9838db267 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:57.130128 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba1e39-751d-4c32-8b3e-3ec9838db267 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:57.140769 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 113/230] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:26:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:26:57.146836 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba1e39-751d-4c32-8b3e-3ec9838db267 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:57.147942 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf464c-f2e5-45cd-8034-9e86b67d62ce None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:57.218456 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29ddfa-70b2-47bb-9e6f-dea1c29cad0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:57.220681 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29ddfa-70b2-47bb-9e6f-dea1c29cad0a None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:57.221175 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29ddfa-70b2-47bb-9e6f-dea1c29cad0a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:57.222570 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29ddfa-70b2-47bb-9e6f-dea1c29cad0a None admin] PATH_INFO: `/v3/projects/f14af8f557914f4291de2295e89b8249/users/9a90b2ade3ae420ab8b71ea111494ebb/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:57.227862 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29ddfa-70b2-47bb-9e6f-dea1c29cad0a None admin] RBAC: Authorizing `identity:create_grant(project_id=f14af8f557914f4291de2295e89b8249, user_id=9a90b2ade3ae420ab8b71ea111494ebb, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:57.230051 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29ddfa-70b2-47bb-9e6f-dea1c29cad0a None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:57.263741 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:57.283717 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba1e39-751d-4c32-8b3e-3ec9838db267 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:57.319140 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 118/231] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 03:26:56 2022] PUT /identity/v3/projects/f14af8f557914f4291de2295e89b8249/users/9a90b2ade3ae420ab8b71ea111494ebb/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:26:57.329507 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1abed0a-0a5d-41d9-ab82-28a954b8d2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:57.330597 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abed0a-0a5d-41d9-ab82-28a954b8d2ee None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:57.331110 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abed0a-0a5d-41d9-ab82-28a954b8d2ee None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:57.331565 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abed0a-0a5d-41d9-ab82-28a954b8d2ee None admin] PATH_INFO: `/v3/users/9a90b2ade3ae420ab8b71ea111494ebb` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:57.333173 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1abed0a-0a5d-41d9-ab82-28a954b8d2ee None admin] RBAC: Authorizing `identity:get_user(user_id=9a90b2ade3ae420ab8b71ea111494ebb)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:57.334945 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1abed0a-0a5d-41d9-ab82-28a954b8d2ee None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:57.341517 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 114/232] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:26:57 2022] GET /identity/v3/users/9a90b2ade3ae420ab8b71ea111494ebb => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:57.342971 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29ddfa-70b2-47bb-9e6f-dea1c29cad0a None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:57.404045 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:57.474161 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29ddfa-70b2-47bb-9e6f-dea1c29cad0a None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:57.527213 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a0df4-af4c-4622-b111-e2581d99b89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:57.527872 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a0df4-af4c-4622-b111-e2581d99b89d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:57.528132 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a0df4-af4c-4622-b111-e2581d99b89d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:57.528402 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a0df4-af4c-4622-b111-e2581d99b89d None admin] PATH_INFO: `/v3/projects/f14af8f557914f4291de2295e89b8249` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:57.530305 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a0df4-af4c-4622-b111-e2581d99b89d None admin] RBAC: Authorizing `identity:get_project(project_id=f14af8f557914f4291de2295e89b8249)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:57.531932 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a0df4-af4c-4622-b111-e2581d99b89d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:57.534172 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 119/233] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:26:57 2022] GET /identity/v3/projects/f14af8f557914f4291de2295e89b8249 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:57.540420 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1abed0a-0a5d-41d9-ab82-28a954b8d2ee None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:57.676425 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1abed0a-0a5d-41d9-ab82-28a954b8d2ee None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:57.725315 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a6744-d86a-4820-bcbe-29df4ca2274a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:57.726105 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a6744-d86a-4820-bcbe-29df4ca2274a None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:57.726305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a6744-d86a-4820-bcbe-29df4ca2274a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:57.726580 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a6744-d86a-4820-bcbe-29df4ca2274a None admin] PATH_INFO: `/v3/projects/f14af8f557914f4291de2295e89b8249/users/9a90b2ade3ae420ab8b71ea111494ebb/roles/fcb362c8a9fd47fbbb6b14397cae171c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:57.728942 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571a6744-d86a-4820-bcbe-29df4ca2274a None admin] RBAC: Authorizing `identity:create_grant(project_id=f14af8f557914f4291de2295e89b8249, user_id=9a90b2ade3ae420ab8b71ea111494ebb, role_id=fcb362c8a9fd47fbbb6b14397cae171c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:57.730494 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571a6744-d86a-4820-bcbe-29df4ca2274a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:57.841808 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 115/234] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 03:26:57 2022] PUT /identity/v3/projects/f14af8f557914f4291de2295e89b8249/users/9a90b2ade3ae420ab8b71ea111494ebb/roles/fcb362c8a9fd47fbbb6b14397cae171c => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:26:57.862758 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552eb7f7-6418-4122-b218-335734288672 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:57.863089 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552eb7f7-6418-4122-b218-335734288672 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:57.863365 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552eb7f7-6418-4122-b218-335734288672 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:57.865040 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 120/235] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:26:57.871411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca4152-e7c2-4d01-b3af-59ea0506dcae None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:57.871718 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca4152-e7c2-4d01-b3af-59ea0506dcae None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:57.871970 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca4152-e7c2-4d01-b3af-59ea0506dcae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:57.903061 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2bca4152-e7c2-4d01-b3af-59ea0506dcae None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:26:57.904269 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2bca4152-e7c2-4d01-b3af-59ea0506dcae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:26:57.906550 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:57.988962 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe8d0c-161d-4905-8e85-0e5e777f2839 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:57.989609 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe8d0c-161d-4905-8e85-0e5e777f2839 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:57.990120 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe8d0c-161d-4905-8e85-0e5e777f2839 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:57.991762 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 121/236] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:26:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 03:26:57.997994 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899a5f1-d0fd-4baf-b138-540b50407289 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:57.998633 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899a5f1-d0fd-4baf-b138-540b50407289 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:57.999101 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899a5f1-d0fd-4baf-b138-540b50407289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:58.010482 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 116/237] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:26:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:26:58.032066 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b899a5f1-d0fd-4baf-b138-540b50407289 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:26:58.033794 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b899a5f1-d0fd-4baf-b138-540b50407289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:26:58.119070 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 122/238] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:26:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 03:26:58.301773 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca4152-e7c2-4d01-b3af-59ea0506dcae None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:58.407260 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899a5f1-d0fd-4baf-b138-540b50407289 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:58.454064 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca4152-e7c2-4d01-b3af-59ea0506dcae None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:58.475784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:58.494612 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8c0d4-4f0e-45ef-90c8-4f0c94cd54d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:58.495257 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8c0d4-4f0e-45ef-90c8-4f0c94cd54d6 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:58.495702 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8c0d4-4f0e-45ef-90c8-4f0c94cd54d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:58.496129 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8c0d4-4f0e-45ef-90c8-4f0c94cd54d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:58.497482 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf8c0d4-4f0e-45ef-90c8-4f0c94cd54d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:58.499172 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf8c0d4-4f0e-45ef-90c8-4f0c94cd54d6 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:58.501013 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 117/239] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:26:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:58.510596 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8c0d4-4f0e-45ef-90c8-4f0c94cd54d6 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:58.524866 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:58.591993 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899a5f1-d0fd-4baf-b138-540b50407289 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:58.626328 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c84fa-d810-436a-8c26-172a4d66e9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:58.627228 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c84fa-d810-436a-8c26-172a4d66e9e3 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:58.627660 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c84fa-d810-436a-8c26-172a4d66e9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:58.628080 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c84fa-d810-436a-8c26-172a4d66e9e3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:58.639588 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c84fa-d810-436a-8c26-172a4d66e9e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:26:58.643513 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8c0d4-4f0e-45ef-90c8-4f0c94cd54d6 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:58.644722 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-c66c84fa-d810-436a-8c26-172a4d66e9e3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 03:26:58.644722 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:26:58.644722 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:26:58.644722 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:26:58.644722 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:26:58.644722 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:26:58.644722 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:26:58.644722 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:26:58.644722 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:26:58.644722 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:26:58.644722 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:26:58.644722 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:26:58.644722 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:26:58.644722 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:26:58.644722 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:26:58.644722 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:26:58.646100 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:26:58.646100 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:26:58.646100 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:26:58.646100 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:26:58.646100 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:26:58.646100 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:26:58.646100 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:26:58.646100 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:26:58.646100 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:26:58.646100 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:26:58.646100 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:26:58.646100 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:26:58.646100 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:26:58.646100 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:26:58.646100 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:26:58.646100 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:26:58.647086 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:26:58.647086 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:26:58.647086 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:26:58.647086 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:26:58.647086 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:26:58.647086 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:26:58.647086 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:26:58.647086 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:26:58.647086 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:26:58.647086 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:26:58.647086 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 03:26:58.647086 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:26:58.648369 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 123/240] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:26:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:26:58.653683 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16b2c6-40eb-4232-8bd2-37ab00e4c259 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:58.653683 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16b2c6-40eb-4232-8bd2-37ab00e4c259 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:58.653683 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16b2c6-40eb-4232-8bd2-37ab00e4c259 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:58.653683 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 124/241] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:26:58.654600 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16b2c6-40eb-4232-8bd2-37ab00e4c259 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:58.688662 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed2dbb-8535-41ce-a312-967f52a86bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:58.689618 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed2dbb-8535-41ce-a312-967f52a86bfd None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:58.690213 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed2dbb-8535-41ce-a312-967f52a86bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:58.690649 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed2dbb-8535-41ce-a312-967f52a86bfd None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:58.691638 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed2dbb-8535-41ce-a312-967f52a86bfd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:58.693319 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed2dbb-8535-41ce-a312-967f52a86bfd None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:58.756078 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:58.761044 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16b2c6-40eb-4232-8bd2-37ab00e4c259 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:58.781319 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 118/242] 10.222.0.33 () {60 vars in 1132 bytes} [Fri Sep 16 03:26:58 2022] POST /identity/v3/users => generated 293 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:26:58.787051 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e80c2-d281-4505-bf31-cabf23747c71 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:58.787607 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e80c2-d281-4505-bf31-cabf23747c71 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:58.788074 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e80c2-d281-4505-bf31-cabf23747c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:58.801433 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073590b0-d28b-42b2-ae69-a895c1bc9235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:58.802135 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073590b0-d28b-42b2-ae69-a895c1bc9235 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:58.802417 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073590b0-d28b-42b2-ae69-a895c1bc9235 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:58.802689 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073590b0-d28b-42b2-ae69-a895c1bc9235 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:58.803365 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073590b0-d28b-42b2-ae69-a895c1bc9235 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:26:58.805463 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073590b0-d28b-42b2-ae69-a895c1bc9235 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:58.811854 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073590b0-d28b-42b2-ae69-a895c1bc9235 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:58.830994 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 125/243] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 03:26:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:58.831180 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7c5e80c2-d281-4505-bf31-cabf23747c71 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:26:58.832291 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7c5e80c2-d281-4505-bf31-cabf23747c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:26:58.837852 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073590b0-d28b-42b2-ae69-a895c1bc9235 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:58.958083 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:58.980556 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 119/244] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:26:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:26:59.015866 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073590b0-d28b-42b2-ae69-a895c1bc9235 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:59.050724 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c47d32-5c12-4d1a-bd76-fe2f2a8f39e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:59.051357 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c47d32-5c12-4d1a-bd76-fe2f2a8f39e0 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:59.051635 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c47d32-5c12-4d1a-bd76-fe2f2a8f39e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:59.051907 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c47d32-5c12-4d1a-bd76-fe2f2a8f39e0 None admin] PATH_INFO: `/v3/users/56becb9745c3480fae1109525220c569` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:59.066591 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c47d32-5c12-4d1a-bd76-fe2f2a8f39e0 None admin] RBAC: Authorizing `identity:get_user(user_id=56becb9745c3480fae1109525220c569)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:59.068074 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c47d32-5c12-4d1a-bd76-fe2f2a8f39e0 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:59.069795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 126/245] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:26:58 2022] GET /identity/v3/users/56becb9745c3480fae1109525220c569 => generated 297 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:26:59.076339 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e80c2-d281-4505-bf31-cabf23747c71 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:59.186092 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e80c2-d281-4505-bf31-cabf23747c71 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:59.229326 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4593b-ea60-4696-87bb-e67752151b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:59.229924 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4593b-ea60-4696-87bb-e67752151b01 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:59.230205 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4593b-ea60-4696-87bb-e67752151b01 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:59.230479 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4593b-ea60-4696-87bb-e67752151b01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:59.298876 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:59.308952 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e4593b-ea60-4696-87bb-e67752151b01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:59.310596 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e4593b-ea60-4696-87bb-e67752151b01 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:59.316013 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c47d32-5c12-4d1a-bd76-fe2f2a8f39e0 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:59.350474 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:59.449497 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 120/246] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:26:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 03:26:59.455412 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4593b-ea60-4696-87bb-e67752151b01 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:59.461612 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c47d32-5c12-4d1a-bd76-fe2f2a8f39e0 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:59.504416 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e99e9d-bda7-400b-8ba0-3b3cad010cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:59.504994 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e99e9d-bda7-400b-8ba0-3b3cad010cdb None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:59.505276 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e99e9d-bda7-400b-8ba0-3b3cad010cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:59.505546 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e99e9d-bda7-400b-8ba0-3b3cad010cdb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:59.521851 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e99e9d-bda7-400b-8ba0-3b3cad010cdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:26:59.527762 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-82e99e9d-bda7-400b-8ba0-3b3cad010cdb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 03:26:59.527762 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:26:59.527762 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:26:59.527762 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:26:59.527762 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:26:59.527762 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:26:59.527762 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:26:59.527762 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:26:59.527762 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:26:59.527762 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:26:59.527762 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:26:59.527762 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:26:59.527762 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:26:59.527762 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:26:59.527762 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:26:59.527762 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:26:59.528761 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:26:59.528761 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:26:59.528761 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:26:59.528761 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:26:59.528761 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:26:59.528761 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:26:59.528761 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:26:59.528761 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:26:59.528761 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:26:59.528761 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:26:59.528761 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:26:59.528761 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:26:59.528761 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:26:59.528761 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:26:59.528761 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:26:59.528761 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:26:59.529552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:26:59.529552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:26:59.529552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:26:59.529552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:26:59.529552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:26:59.529552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:26:59.529552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:26:59.529552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:26:59.529552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:26:59.529552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:26:59.529552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 03:26:59.529552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:26:59.532209 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 127/247] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:26:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:26:59.539001 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e99e9d-bda7-400b-8ba0-3b3cad010cdb None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:59.581662 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:59.588059 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4593b-ea60-4696-87bb-e67752151b01 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:59.662148 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b55fc-d43d-49a9-ab00-98d9d3ad278d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:59.663763 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b55fc-d43d-49a9-ab00-98d9d3ad278d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:59.664049 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b55fc-d43d-49a9-ab00-98d9d3ad278d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:59.664842 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b55fc-d43d-49a9-ab00-98d9d3ad278d None admin] PATH_INFO: `/v3/projects/f14af8f557914f4291de2295e89b8249` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:59.666183 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b55fc-d43d-49a9-ab00-98d9d3ad278d None admin] RBAC: Authorizing `identity:get_project(project_id=f14af8f557914f4291de2295e89b8249)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:59.667672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b55fc-d43d-49a9-ab00-98d9d3ad278d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:59.670210 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 121/248] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:26:59 2022] GET /identity/v3/projects/f14af8f557914f4291de2295e89b8249 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:26:59.675671 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b55fc-d43d-49a9-ab00-98d9d3ad278d None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:59.676358 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:26:59.720282 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e99e9d-bda7-400b-8ba0-3b3cad010cdb None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:59.793773 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85930a50-1e46-4196-b8f8-7e6b979ec83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:59.794359 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85930a50-1e46-4196-b8f8-7e6b979ec83b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:59.794646 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85930a50-1e46-4196-b8f8-7e6b979ec83b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:59.794919 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85930a50-1e46-4196-b8f8-7e6b979ec83b None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:59.795580 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85930a50-1e46-4196-b8f8-7e6b979ec83b None admin] RBAC: Adding query filter params (name=member) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:26:59.795881 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85930a50-1e46-4196-b8f8-7e6b979ec83b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:59.797270 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85930a50-1e46-4196-b8f8-7e6b979ec83b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:59.807140 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 128/249] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 03:26:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:26:59.812991 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85930a50-1e46-4196-b8f8-7e6b979ec83b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:26:59.904631 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b55fc-d43d-49a9-ab00-98d9d3ad278d None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:26:59.969883 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba211a3-3642-4dce-843e-cf0dbd82a4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:26:59.970547 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba211a3-3642-4dce-843e-cf0dbd82a4ec None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:26:59.970832 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba211a3-3642-4dce-843e-cf0dbd82a4ec None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:26:59.971109 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba211a3-3642-4dce-843e-cf0dbd82a4ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:26:59.971851 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba211a3-3642-4dce-843e-cf0dbd82a4ec None admin] RBAC: Adding query filter params (role.id=35fd8044264e4590a6dcfeabaf194c78, scope.project.id=f14af8f557914f4291de2295e89b8249, user.id=56becb9745c3480fae1109525220c569) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:26:59.972187 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba211a3-3642-4dce-843e-cf0dbd82a4ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:26:59.975424 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba211a3-3642-4dce-843e-cf0dbd82a4ec None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:26:59.987867 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 122/250] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:26:59 2022] GET /identity/v3/role_assignments?user.id=56becb9745c3480fae1109525220c569&scope.project.id=f14af8f557914f4291de2295e89b8249&role.id=35fd8044264e4590a6dcfeabaf194c78 => generated 259 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:00.008038 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85930a50-1e46-4196-b8f8-7e6b979ec83b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:00.050401 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf5fdf-a065-4c00-9326-4de0ef236860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:00.051635 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf5fdf-a065-4c00-9326-4de0ef236860 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:00.051919 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf5fdf-a065-4c00-9326-4de0ef236860 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:00.052194 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf5fdf-a065-4c00-9326-4de0ef236860 None admin] PATH_INFO: `/v3/users/a7c3e9c0353a4efaab5ddd634194706c` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:00.053531 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf5fdf-a065-4c00-9326-4de0ef236860 None admin] RBAC: Authorizing `identity:get_user(user_id=a7c3e9c0353a4efaab5ddd634194706c)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:00.055236 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf5fdf-a065-4c00-9326-4de0ef236860 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:00.057224 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 129/251] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:26:59 2022] GET /identity/v3/users/a7c3e9c0353a4efaab5ddd634194706c => generated 297 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:00.065347 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba211a3-3642-4dce-843e-cf0dbd82a4ec None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:00.101602 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:00.181361 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f7960-ca3e-4285-9b50-ee63b4ed0828 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:00.181727 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f7960-ca3e-4285-9b50-ee63b4ed0828 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:00.181941 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f7960-ca3e-4285-9b50-ee63b4ed0828 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:00.183331 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 130/252] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:00.197207 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd1696-b107-4f3c-91f1-a19f432a1043 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:00.197488 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd1696-b107-4f3c-91f1-a19f432a1043 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:00.197794 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd1696-b107-4f3c-91f1-a19f432a1043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:00.228629 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba211a3-3642-4dce-843e-cf0dbd82a4ec None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:00.233661 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a8fd1696-b107-4f3c-91f1-a19f432a1043 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:00.233661 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a8fd1696-b107-4f3c-91f1-a19f432a1043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:00.235056 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:00.337045 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 131/253] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 03:27:00.338732 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a9822-5940-4b17-a534-c56c95f3a2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:00.339562 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a9822-5940-4b17-a534-c56c95f3a2f1 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:00.339980 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a9822-5940-4b17-a534-c56c95f3a2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:00.340387 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a9822-5940-4b17-a534-c56c95f3a2f1 None admin] PATH_INFO: `/v3/projects/f14af8f557914f4291de2295e89b8249` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:00.346309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a9822-5940-4b17-a534-c56c95f3a2f1 None admin] RBAC: Authorizing `identity:get_project(project_id=f14af8f557914f4291de2295e89b8249)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:00.347943 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a9822-5940-4b17-a534-c56c95f3a2f1 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:00.349743 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 123/254] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:27:00 2022] GET /identity/v3/projects/f14af8f557914f4291de2295e89b8249 => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:00.356059 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd1696-b107-4f3c-91f1-a19f432a1043 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:00.496030 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd1696-b107-4f3c-91f1-a19f432a1043 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:00.544546 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448bfdec-1978-4194-8a7e-635d95344338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:00.545218 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448bfdec-1978-4194-8a7e-635d95344338 None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:00.545547 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448bfdec-1978-4194-8a7e-635d95344338 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:00.545859 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448bfdec-1978-4194-8a7e-635d95344338 None admin] PATH_INFO: `/v3/projects/f14af8f557914f4291de2295e89b8249/users/a7c3e9c0353a4efaab5ddd634194706c/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:00.550900 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448bfdec-1978-4194-8a7e-635d95344338 None admin] RBAC: Authorizing `identity:create_grant(project_id=f14af8f557914f4291de2295e89b8249, user_id=a7c3e9c0353a4efaab5ddd634194706c, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:00.552467 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448bfdec-1978-4194-8a7e-635d95344338 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:00.603658 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c880da-a148-43df-8a00-dff03b3b6a3d None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:00.604245 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c880da-a148-43df-8a00-dff03b3b6a3d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:00.604815 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c880da-a148-43df-8a00-dff03b3b6a3d None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:00.606376 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 124/255] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 03:27:00.613329 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b748c66-4efa-4fd6-abdb-7e1b9d40dc4c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:00.615551 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b748c66-4efa-4fd6-abdb-7e1b9d40dc4c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:00.615551 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b748c66-4efa-4fd6-abdb-7e1b9d40dc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:00.636028 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:00.642462 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0b748c66-4efa-4fd6-abdb-7e1b9d40dc4c None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:00.643159 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 132/256] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 03:27:00 2022] PUT /identity/v3/projects/f14af8f557914f4291de2295e89b8249/users/a7c3e9c0353a4efaab5ddd634194706c/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:27:00.644054 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0b748c66-4efa-4fd6-abdb-7e1b9d40dc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:00.760027 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 125/257] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 03:27:01.000487 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448bfdec-1978-4194-8a7e-635d95344338 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:01.118926 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448bfdec-1978-4194-8a7e-635d95344338 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:01.165681 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32672d60-3a6c-4be9-ad33-17bd865f134b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:01.166327 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32672d60-3a6c-4be9-ad33-17bd865f134b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:01.166607 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32672d60-3a6c-4be9-ad33-17bd865f134b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:01.166881 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32672d60-3a6c-4be9-ad33-17bd865f134b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:01.180020 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32672d60-3a6c-4be9-ad33-17bd865f134b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:01.184929 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-32672d60-3a6c-4be9-ad33-17bd865f134b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:27:01.184929 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:01.184929 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:01.184929 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:01.184929 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:01.184929 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:01.184929 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:01.184929 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:01.184929 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:01.184929 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:01.184929 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:01.184929 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:01.184929 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:01.184929 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:01.184929 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:01.184929 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:01.185799 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:01.185799 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:01.185799 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:01.185799 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:01.185799 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:01.185799 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:01.185799 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:01.185799 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:01.185799 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:01.185799 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:01.185799 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:01.185799 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:01.185799 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:01.185799 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:01.185799 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:01.185799 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:01.186577 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:01.186577 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:01.186577 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:01.186577 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:01.186577 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:01.186577 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:01.186577 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:01.186577 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:01.186577 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:01.186577 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:01.186577 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:27:01.186577 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:01.186577 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 133/258] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 03:27:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:01.194730 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b748c66-4efa-4fd6-abdb-7e1b9d40dc4c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:01.238994 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:01.262149 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32672d60-3a6c-4be9-ad33-17bd865f134b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:01.357271 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:01.409349 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32672d60-3a6c-4be9-ad33-17bd865f134b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:01.420492 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b748c66-4efa-4fd6-abdb-7e1b9d40dc4c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:01.448841 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b97f9-fdf4-439b-a0a0-eb23fd6359f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:01.449482 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b97f9-fdf4-439b-a0a0-eb23fd6359f9 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:01.449843 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b97f9-fdf4-439b-a0a0-eb23fd6359f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:01.450122 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b97f9-fdf4-439b-a0a0-eb23fd6359f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:01.462674 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b97f9-fdf4-439b-a0a0-eb23fd6359f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:01.468105 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-ed9b97f9-fdf4-439b-a0a0-eb23fd6359f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 03:27:01.468105 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:01.468105 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:01.468105 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:01.468105 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:01.468105 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:01.468105 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:01.468105 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:01.468105 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:01.468105 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:01.468105 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:01.468105 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:01.468105 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:01.468105 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:01.468105 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:01.468105 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:01.468987 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:01.468987 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:01.468987 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:01.468987 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:01.468987 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:01.468987 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:01.468987 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:01.468987 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:01.468987 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:01.468987 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:01.468987 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:01.468987 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:01.468987 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:01.468987 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:01.468987 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:01.468987 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:01.469794 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:01.469794 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:01.469794 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:01.469794 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:01.469794 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:01.469794 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:01.469794 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:01.469794 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:01.469794 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:01.469794 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:01.469794 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 03:27:01.469794 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:01.469794 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 134/259] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 03:27:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:01.477015 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b97f9-fdf4-439b-a0a0-eb23fd6359f9 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:01.486257 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea13ea-46fd-4fbb-a90f-73e75073a5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:01.487148 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea13ea-46fd-4fbb-a90f-73e75073a5bd None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:01.487619 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea13ea-46fd-4fbb-a90f-73e75073a5bd None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:01.488081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea13ea-46fd-4fbb-a90f-73e75073a5bd None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:01.488949 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea13ea-46fd-4fbb-a90f-73e75073a5bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:01.489474 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea13ea-46fd-4fbb-a90f-73e75073a5bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:01.491105 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea13ea-46fd-4fbb-a90f-73e75073a5bd None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:01.500390 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 126/260] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:27:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:01.505915 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea13ea-46fd-4fbb-a90f-73e75073a5bd None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:01.639488 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b97f9-fdf4-439b-a0a0-eb23fd6359f9 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:01.689996 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:01.732325 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:01.734753 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5aba9a-8d6f-4562-b808-189a714ec9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:01.735371 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5aba9a-8d6f-4562-b808-189a714ec9e8 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:01.735646 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5aba9a-8d6f-4562-b808-189a714ec9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:01.735912 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5aba9a-8d6f-4562-b808-189a714ec9e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:01.736578 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5aba9a-8d6f-4562-b808-189a714ec9e8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:01.736878 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5aba9a-8d6f-4562-b808-189a714ec9e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:01.738412 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5aba9a-8d6f-4562-b808-189a714ec9e8 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:01.756961 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 135/261] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:27:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:27:01.763099 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5aba9a-8d6f-4562-b808-189a714ec9e8 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:01.764803 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea13ea-46fd-4fbb-a90f-73e75073a5bd None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:01.835818 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccee346-a601-4b17-81a9-6a3cbce7f98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:01.836961 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccee346-a601-4b17-81a9-6a3cbce7f98e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:01.837472 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccee346-a601-4b17-81a9-6a3cbce7f98e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:01.837976 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccee346-a601-4b17-81a9-6a3cbce7f98e None admin] PATH_INFO: `/v3/users/9a90b2ade3ae420ab8b71ea111494ebb` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:01.840837 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccee346-a601-4b17-81a9-6a3cbce7f98e None admin] RBAC: Authorizing `identity:get_user(user_id=9a90b2ade3ae420ab8b71ea111494ebb)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:01.842696 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccee346-a601-4b17-81a9-6a3cbce7f98e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:01.844517 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 127/262] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:27:01 2022] GET /identity/v3/users/9a90b2ade3ae420ab8b71ea111494ebb => generated 283 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:01.849951 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccee346-a601-4b17-81a9-6a3cbce7f98e None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:01.994929 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5aba9a-8d6f-4562-b808-189a714ec9e8 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:02.042726 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccee346-a601-4b17-81a9-6a3cbce7f98e None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:02.066392 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b6dd8-0b99-4101-964a-787524c97943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:02.067039 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b6dd8-0b99-4101-964a-787524c97943 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:02.067300 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b6dd8-0b99-4101-964a-787524c97943 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:02.067573 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b6dd8-0b99-4101-964a-787524c97943 None admin] PATH_INFO: `/v3/users/9a90b2ade3ae420ab8b71ea111494ebb` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:02.072225 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b6dd8-0b99-4101-964a-787524c97943 None admin] RBAC: Authorizing `identity:get_user(user_id=9a90b2ade3ae420ab8b71ea111494ebb)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:02.073721 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b6dd8-0b99-4101-964a-787524c97943 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:02.075705 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 136/263] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:27:01 2022] GET /identity/v3/users/9a90b2ade3ae420ab8b71ea111494ebb => generated 283 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:02.081430 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b6dd8-0b99-4101-964a-787524c97943 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:02.119526 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9507ab2-d0f7-4a66-afb4-c821e4217582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:02.120201 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9507ab2-d0f7-4a66-afb4-c821e4217582 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:02.120487 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9507ab2-d0f7-4a66-afb4-c821e4217582 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:02.120762 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9507ab2-d0f7-4a66-afb4-c821e4217582 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:02.162504 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:02.172115 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:02.254974 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9507ab2-d0f7-4a66-afb4-c821e4217582 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:02.257143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9507ab2-d0f7-4a66-afb4-c821e4217582 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:02.300669 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b6dd8-0b99-4101-964a-787524c97943 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:02.393888 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283cb14-2c2d-4dc6-8b37-13df12df1145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:02.394809 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283cb14-2c2d-4dc6-8b37-13df12df1145 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:02.395089 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283cb14-2c2d-4dc6-8b37-13df12df1145 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:02.395363 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283cb14-2c2d-4dc6-8b37-13df12df1145 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:02.411586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 128/264] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:27:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 16 03:27:02.412867 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1146b-8799-4ddb-81d0-4f69a9549c0c None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:02.413150 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1146b-8799-4ddb-81d0-4f69a9549c0c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:02.413421 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1146b-8799-4ddb-81d0-4f69a9549c0c None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:02.415241 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 129/265] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:02.420779 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1146b-8799-4ddb-81d0-4f69a9549c0c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:02.493512 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:02.519346 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f283cb14-2c2d-4dc6-8b37-13df12df1145 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:02.521015 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f283cb14-2c2d-4dc6-8b37-13df12df1145 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:02.575886 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:02.585474 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1146b-8799-4ddb-81d0-4f69a9549c0c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:02.623138 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe1d3d-7f70-4e62-b6c8-e7c800631d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:02.623780 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe1d3d-7f70-4e62-b6c8-e7c800631d99 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:02.624206 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe1d3d-7f70-4e62-b6c8-e7c800631d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:02.624483 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe1d3d-7f70-4e62-b6c8-e7c800631d99 None admin] PATH_INFO: `/v3/projects/f14af8f557914f4291de2295e89b8249` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:02.625658 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe1d3d-7f70-4e62-b6c8-e7c800631d99 None admin] RBAC: Authorizing `identity:get_project(project_id=f14af8f557914f4291de2295e89b8249)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:02.627175 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe1d3d-7f70-4e62-b6c8-e7c800631d99 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:02.629012 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 130/266] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:27:02 2022] GET /identity/v3/projects/f14af8f557914f4291de2295e89b8249 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:02.630197 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144bfa3-8601-425c-872f-c2f44436e063 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:02.630390 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144bfa3-8601-425c-872f-c2f44436e063 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:02.630595 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144bfa3-8601-425c-872f-c2f44436e063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:02.650871 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f144bfa3-8601-425c-872f-c2f44436e063 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:02.652105 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f144bfa3-8601-425c-872f-c2f44436e063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:02.724872 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 131/267] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:27:02.726371 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144bfa3-8601-425c-872f-c2f44436e063 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:02.729187 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 137/268] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:27:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 648 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 03:27:02.734683 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283cb14-2c2d-4dc6-8b37-13df12df1145 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:02.787368 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:02.852905 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144bfa3-8601-425c-872f-c2f44436e063 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:02.899373 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478168e-5047-43ae-9f1c-4c003156d7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:02.900328 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478168e-5047-43ae-9f1c-4c003156d7a5 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:02.900798 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478168e-5047-43ae-9f1c-4c003156d7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:02.901237 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478168e-5047-43ae-9f1c-4c003156d7a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:02.902169 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6478168e-5047-43ae-9f1c-4c003156d7a5 None admin] RBAC: Adding query filter params (role.id=4ffac54101e248479bcdc0e54890020f, scope.project.id=f14af8f557914f4291de2295e89b8249, user.id=9a90b2ade3ae420ab8b71ea111494ebb) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:02.902684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6478168e-5047-43ae-9f1c-4c003156d7a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:02.904304 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6478168e-5047-43ae-9f1c-4c003156d7a5 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:02.915848 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 132/269] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:27:02 2022] GET /identity/v3/role_assignments?user.id=9a90b2ade3ae420ab8b71ea111494ebb&scope.project.id=f14af8f557914f4291de2295e89b8249&role.id=4ffac54101e248479bcdc0e54890020f => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:03.010581 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef9264-343c-4ee7-a9da-02b4fab8f77c None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:03.011639 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef9264-343c-4ee7-a9da-02b4fab8f77c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:03.012113 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef9264-343c-4ee7-a9da-02b4fab8f77c None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:03.014458 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 133/270] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 03:27:03.023095 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb804319-b65c-46d1-8c5d-b0eb91493382 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:03.024233 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb804319-b65c-46d1-8c5d-b0eb91493382 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:03.024713 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb804319-b65c-46d1-8c5d-b0eb91493382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:03.042005 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283cb14-2c2d-4dc6-8b37-13df12df1145 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:03.052396 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-eb804319-b65c-46d1-8c5d-b0eb91493382 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:03.053890 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-eb804319-b65c-46d1-8c5d-b0eb91493382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:03.080790 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa13dc-2ade-43b8-a8d0-2dea679619c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:03.082035 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa13dc-2ade-43b8-a8d0-2dea679619c6 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:03.082561 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa13dc-2ade-43b8-a8d0-2dea679619c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:03.082978 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa13dc-2ade-43b8-a8d0-2dea679619c6 None admin] PATH_INFO: `/v3/projects/f14af8f557914f4291de2295e89b8249` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:03.084411 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fa13dc-2ade-43b8-a8d0-2dea679619c6 None admin] RBAC: Authorizing `identity:get_project(project_id=f14af8f557914f4291de2295e89b8249)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:03.086082 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fa13dc-2ade-43b8-a8d0-2dea679619c6 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:03.088385 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 138/271] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:27:02 2022] GET /identity/v3/projects/f14af8f557914f4291de2295e89b8249 => generated 302 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:03.094161 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa13dc-2ade-43b8-a8d0-2dea679619c6 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:03.114564 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:03.168286 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 134/272] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:27:03.169533 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb804319-b65c-46d1-8c5d-b0eb91493382 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:03.222057 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:03.233034 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa13dc-2ade-43b8-a8d0-2dea679619c6 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:03.275187 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99967ba-d4e8-4f17-a19d-69431b513746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:03.276452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99967ba-d4e8-4f17-a19d-69431b513746 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:03.276989 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99967ba-d4e8-4f17-a19d-69431b513746 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:03.277615 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99967ba-d4e8-4f17-a19d-69431b513746 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:03.278598 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99967ba-d4e8-4f17-a19d-69431b513746 None admin] RBAC: Adding query filter params (role.id=fcb362c8a9fd47fbbb6b14397cae171c, scope.project.id=f14af8f557914f4291de2295e89b8249, user.id=9a90b2ade3ae420ab8b71ea111494ebb) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:03.279051 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99967ba-d4e8-4f17-a19d-69431b513746 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:03.280687 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99967ba-d4e8-4f17-a19d-69431b513746 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:03.282408 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb804319-b65c-46d1-8c5d-b0eb91493382 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:03.288293 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 139/273] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:27:03 2022] GET /identity/v3/role_assignments?user.id=9a90b2ade3ae420ab8b71ea111494ebb&scope.project.id=f14af8f557914f4291de2295e89b8249&role.id=fcb362c8a9fd47fbbb6b14397cae171c => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:03.293813 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ff920-24d5-4b94-8ed1-e2791a4e4c26 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:03.293813 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ff920-24d5-4b94-8ed1-e2791a4e4c26 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:03.293813 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ff920-24d5-4b94-8ed1-e2791a4e4c26 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:03.293813 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 140/274] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:03.298103 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b44ff-cbcf-4196-b093-d58b91c02019 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:03.298387 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b44ff-cbcf-4196-b093-d58b91c02019 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:03.298661 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b44ff-cbcf-4196-b093-d58b91c02019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:03.319989 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-887b44ff-cbcf-4196-b093-d58b91c02019 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:03.321787 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-887b44ff-cbcf-4196-b093-d58b91c02019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:03.342806 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f982cf-d318-4a35-bb97-eaaf1c2d3f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:03.343701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f982cf-d318-4a35-bb97-eaaf1c2d3f1c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:03.344127 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f982cf-d318-4a35-bb97-eaaf1c2d3f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:03.344585 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f982cf-d318-4a35-bb97-eaaf1c2d3f1c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:03.346295 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f982cf-d318-4a35-bb97-eaaf1c2d3f1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:03.347925 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f982cf-d318-4a35-bb97-eaaf1c2d3f1c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:03.350198 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 135/275] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:27:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:03.356434 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f982cf-d318-4a35-bb97-eaaf1c2d3f1c None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:03.400050 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 141/276] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:27:03.490011 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b44ff-cbcf-4196-b093-d58b91c02019 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:03.518052 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:03.538318 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f982cf-d318-4a35-bb97-eaaf1c2d3f1c None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:03.566046 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:03.615356 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df25d2-1080-4db2-af58-48884670aa3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:03.615561 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df25d2-1080-4db2-af58-48884670aa3b None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:03.615794 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df25d2-1080-4db2-af58-48884670aa3b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:03.615984 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df25d2-1080-4db2-af58-48884670aa3b None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:03.616627 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df25d2-1080-4db2-af58-48884670aa3b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:03.618639 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df25d2-1080-4db2-af58-48884670aa3b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:03.670194 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b44ff-cbcf-4196-b093-d58b91c02019 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:03.707310 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818ee7a-da90-4b62-b61b-549f6296457b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:03.707953 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818ee7a-da90-4b62-b61b-549f6296457b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:03.708234 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818ee7a-da90-4b62-b61b-549f6296457b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:03.708507 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818ee7a-da90-4b62-b61b-549f6296457b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:03.720018 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818ee7a-da90-4b62-b61b-549f6296457b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:03.725493 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-a818ee7a-da90-4b62-b61b-549f6296457b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 03:27:03.725493 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:03.725493 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:03.725493 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:03.725493 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:03.725493 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:03.725493 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:03.725493 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:03.725493 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:03.725493 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:03.725493 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:03.725493 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:03.725493 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:03.725493 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:03.725493 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:03.725493 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:03.726587 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:03.726587 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:03.726587 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:03.726587 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:03.726587 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:03.726587 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:03.726587 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:03.726587 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:03.726587 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:03.726587 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:03.726587 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:03.726587 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:03.726587 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:03.726587 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:03.726587 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:03.726587 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:03.727985 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:03.727985 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:03.727985 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:03.727985 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:03.727985 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:03.727985 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:03.727985 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:03.727985 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:03.727985 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:03.727985 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:03.727985 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 03:27:03.727985 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:03.728656 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 136/277] 10.222.0.33 () {60 vars in 1132 bytes} [Fri Sep 16 03:27:03 2022] POST /identity/v3/users => generated 293 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:27:03.728728 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 142/278] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:27:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:27:03.728799 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846dfaa-1dc7-4ed0-893c-c2e011fd6e73 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:03.729553 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846dfaa-1dc7-4ed0-893c-c2e011fd6e73 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:03.729553 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846dfaa-1dc7-4ed0-893c-c2e011fd6e73 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:03.733981 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 137/279] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:03.734763 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818ee7a-da90-4b62-b61b-549f6296457b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:03.741093 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846dfaa-1dc7-4ed0-893c-c2e011fd6e73 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:03.822034 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:03.855614 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818ee7a-da90-4b62-b61b-549f6296457b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:03.857227 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846dfaa-1dc7-4ed0-893c-c2e011fd6e73 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:03.892896 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a61364-7c73-4189-97bd-4f1c327b4211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:03.893514 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a61364-7c73-4189-97bd-4f1c327b4211 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:03.893823 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a61364-7c73-4189-97bd-4f1c327b4211 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:03.894092 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a61364-7c73-4189-97bd-4f1c327b4211 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:03.894758 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a61364-7c73-4189-97bd-4f1c327b4211 None admin] RBAC: Adding query filter params (name=member) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:03.894941 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde3fb65-efce-4775-b9bb-fd5e15bca904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:03.895064 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a61364-7c73-4189-97bd-4f1c327b4211 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:03.895838 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3fb65-efce-4775-b9bb-fd5e15bca904 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:03.896113 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3fb65-efce-4775-b9bb-fd5e15bca904 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:03.896380 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3fb65-efce-4775-b9bb-fd5e15bca904 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:03.896708 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a61364-7c73-4189-97bd-4f1c327b4211 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:03.908081 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 143/280] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 03:27:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:03.909060 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde3fb65-efce-4775-b9bb-fd5e15bca904 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:03.912677 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b71f74-c87f-4598-99e8-24acf8bdc5ef None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:03.912949 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b71f74-c87f-4598-99e8-24acf8bdc5ef None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:03.913374 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b71f74-c87f-4598-99e8-24acf8bdc5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:03.915386 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-cde3fb65-efce-4775-b9bb-fd5e15bca904 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 03:27:03.915386 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:03.915386 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:03.915386 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:03.915386 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:03.915386 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:03.915386 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:03.915386 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:03.915386 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:03.915386 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:03.915386 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:03.915386 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:03.915386 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:03.915386 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:03.915386 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:03.915386 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:03.916243 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:03.916243 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:03.916243 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:03.916243 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:03.916243 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:03.916243 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:03.916243 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:03.916243 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:03.916243 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:03.916243 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:03.916243 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:03.916243 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:03.916243 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:03.916243 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:03.916243 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:03.916243 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:03.917026 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:03.917026 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:03.917026 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:03.917026 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:03.917026 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:03.917026 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:03.917026 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:03.917026 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:03.917026 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:03.917026 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:03.917026 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 03:27:03.917026 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:03.917026 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 138/281] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:27:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:03.917703 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde3fb65-efce-4775-b9bb-fd5e15bca904 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:03.939233 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e8b71f74-c87f-4598-99e8-24acf8bdc5ef None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:03.940468 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e8b71f74-c87f-4598-99e8-24acf8bdc5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:03.952371 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:04.022818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 144/282] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:27:04.023823 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b71f74-c87f-4598-99e8-24acf8bdc5ef None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:04.041652 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde3fb65-efce-4775-b9bb-fd5e15bca904 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:04.088570 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227afd3-5732-4761-83d0-c024c7ce6aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:04.089481 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227afd3-5732-4761-83d0-c024c7ce6aea None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:04.089865 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227afd3-5732-4761-83d0-c024c7ce6aea None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:04.090208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227afd3-5732-4761-83d0-c024c7ce6aea None admin] PATH_INFO: `/v3/users/624ef795589a4556af89829661575328` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:04.098297 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:04.108830 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d227afd3-5732-4761-83d0-c024c7ce6aea None admin] RBAC: Authorizing `identity:get_user(user_id=624ef795589a4556af89829661575328)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:04.110988 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d227afd3-5732-4761-83d0-c024c7ce6aea None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:04.112852 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 139/283] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:27:03 2022] GET /identity/v3/users/624ef795589a4556af89829661575328 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:04.118166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227afd3-5732-4761-83d0-c024c7ce6aea None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:04.146673 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b71f74-c87f-4598-99e8-24acf8bdc5ef None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:04.185750 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038d50d-63a4-47e6-91df-74ca66d56e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:04.186743 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038d50d-63a4-47e6-91df-74ca66d56e27 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:04.187223 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038d50d-63a4-47e6-91df-74ca66d56e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:04.187691 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038d50d-63a4-47e6-91df-74ca66d56e27 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:04.188552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038d50d-63a4-47e6-91df-74ca66d56e27 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:04.189051 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038d50d-63a4-47e6-91df-74ca66d56e27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:04.190725 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038d50d-63a4-47e6-91df-74ca66d56e27 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:04.200169 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 145/284] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 03:27:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:04.205535 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038d50d-63a4-47e6-91df-74ca66d56e27 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:04.253112 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:04.285346 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227afd3-5732-4761-83d0-c024c7ce6aea None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:04.343918 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077d6b6-67d7-4197-ab40-7179f095a954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:04.344449 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077d6b6-67d7-4197-ab40-7179f095a954 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:04.344727 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077d6b6-67d7-4197-ab40-7179f095a954 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:04.345001 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077d6b6-67d7-4197-ab40-7179f095a954 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:04.345858 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077d6b6-67d7-4197-ab40-7179f095a954 None admin] RBAC: Adding query filter params (role.id=7591562cf9564b288c108609d8e334b3, user.id=624ef795589a4556af89829661575328, scope.system=all) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:04.346167 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077d6b6-67d7-4197-ab40-7179f095a954 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:04.347665 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077d6b6-67d7-4197-ab40-7179f095a954 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:04.354169 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 140/285] 10.222.0.33 () {56 vars in 1308 bytes} [Fri Sep 16 03:27:04 2022] GET /identity/v3/role_assignments?user.id=624ef795589a4556af89829661575328&scope.system=all&role.id=7591562cf9564b288c108609d8e334b3 => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:27:04.366533 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077d6b6-67d7-4197-ab40-7179f095a954 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:04.383461 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038d50d-63a4-47e6-91df-74ca66d56e27 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:04.426056 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:04.452366 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84f936-9e37-4f14-a04d-3e019f3dd3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:04.453028 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84f936-9e37-4f14-a04d-3e019f3dd3d0 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:04.453311 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84f936-9e37-4f14-a04d-3e019f3dd3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:04.453588 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84f936-9e37-4f14-a04d-3e019f3dd3d0 None admin] PATH_INFO: `/v3/users/56becb9745c3480fae1109525220c569` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:04.454818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84f936-9e37-4f14-a04d-3e019f3dd3d0 None admin] RBAC: Authorizing `identity:get_user(user_id=56becb9745c3480fae1109525220c569)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:04.456385 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84f936-9e37-4f14-a04d-3e019f3dd3d0 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:04.458063 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 146/286] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:27:04 2022] GET /identity/v3/users/56becb9745c3480fae1109525220c569 => generated 297 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:27:04.470804 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84f936-9e37-4f14-a04d-3e019f3dd3d0 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:04.559306 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077d6b6-67d7-4197-ab40-7179f095a954 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:04.596793 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99441794-6ced-4ee6-8b21-17244fed9551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:04.597400 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99441794-6ced-4ee6-8b21-17244fed9551 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:04.597724 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99441794-6ced-4ee6-8b21-17244fed9551 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:04.598106 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99441794-6ced-4ee6-8b21-17244fed9551 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:04.612223 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84f936-9e37-4f14-a04d-3e019f3dd3d0 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:04.623149 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99441794-6ced-4ee6-8b21-17244fed9551 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:04.635519 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-99441794-6ced-4ee6-8b21-17244fed9551 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 03:27:04.635519 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:04.635519 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:04.635519 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:04.635519 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:04.635519 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:04.635519 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:04.635519 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:04.635519 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:04.635519 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:04.635519 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:04.635519 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:04.635519 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:04.635519 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:04.635519 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:04.635519 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:04.636403 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:04.636403 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:04.636403 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:04.636403 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:04.636403 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:04.636403 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:04.636403 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:04.636403 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:04.636403 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:04.636403 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:04.636403 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:04.636403 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:04.636403 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:04.636403 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:04.636403 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:04.636403 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:04.637185 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:04.637185 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:04.637185 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:04.637185 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:04.637185 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:04.637185 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:04.637185 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:04.637185 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:04.637185 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:04.637185 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:04.637185 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 03:27:04.637185 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:04.637185 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 141/287] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:27:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:04.642949 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99441794-6ced-4ee6-8b21-17244fed9551 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:04.651143 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24336dce-bfd9-41b7-9196-a8f870f5590d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:04.652600 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24336dce-bfd9-41b7-9196-a8f870f5590d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:04.652881 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24336dce-bfd9-41b7-9196-a8f870f5590d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:04.653154 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24336dce-bfd9-41b7-9196-a8f870f5590d None admin] PATH_INFO: `/v3/projects/f14af8f557914f4291de2295e89b8249` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:04.654319 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24336dce-bfd9-41b7-9196-a8f870f5590d None admin] RBAC: Authorizing `identity:get_project(project_id=f14af8f557914f4291de2295e89b8249)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:04.655822 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24336dce-bfd9-41b7-9196-a8f870f5590d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:04.657892 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 147/288] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:27:04 2022] GET /identity/v3/projects/f14af8f557914f4291de2295e89b8249 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:04.663922 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24336dce-bfd9-41b7-9196-a8f870f5590d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:04.678001 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:04.764710 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:04.816591 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24336dce-bfd9-41b7-9196-a8f870f5590d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:04.848287 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99441794-6ced-4ee6-8b21-17244fed9551 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:04.895845 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36afd628-5c96-4095-865b-ea4e05f4e094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:04.896452 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36afd628-5c96-4095-865b-ea4e05f4e094 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:04.896729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36afd628-5c96-4095-865b-ea4e05f4e094 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:04.897000 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36afd628-5c96-4095-865b-ea4e05f4e094 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:04.897675 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36afd628-5c96-4095-865b-ea4e05f4e094 None admin] RBAC: Adding query filter params (name=member) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:04.897983 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36afd628-5c96-4095-865b-ea4e05f4e094 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:04.899436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36afd628-5c96-4095-865b-ea4e05f4e094 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:04.908164 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e95b5-4172-41a7-b219-615540efc524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:04.908826 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e95b5-4172-41a7-b219-615540efc524 None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:04.909103 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e95b5-4172-41a7-b219-615540efc524 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:04.909372 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e95b5-4172-41a7-b219-615540efc524 None admin] PATH_INFO: `/v3/projects/f14af8f557914f4291de2295e89b8249/users/56becb9745c3480fae1109525220c569/roles/35fd8044264e4590a6dcfeabaf194c78` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:04.913410 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e95b5-4172-41a7-b219-615540efc524 None admin] RBAC: Authorizing `identity:create_grant(project_id=f14af8f557914f4291de2295e89b8249, user_id=56becb9745c3480fae1109525220c569, role_id=35fd8044264e4590a6dcfeabaf194c78)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:04.915471 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e95b5-4172-41a7-b219-615540efc524 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:04.919848 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 142/289] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 03:27:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:27:04.925774 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36afd628-5c96-4095-865b-ea4e05f4e094 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:04.993173 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 148/290] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 03:27:04 2022] PUT /identity/v3/projects/f14af8f557914f4291de2295e89b8249/users/56becb9745c3480fae1109525220c569/roles/35fd8044264e4590a6dcfeabaf194c78 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:27:05.011362 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:05.051507 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36afd628-5c96-4095-865b-ea4e05f4e094 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:05.096456 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45649be-1e13-4022-bca7-e4b3a7bec481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:05.097088 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45649be-1e13-4022-bca7-e4b3a7bec481 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:05.097363 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45649be-1e13-4022-bca7-e4b3a7bec481 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:05.097711 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45649be-1e13-4022-bca7-e4b3a7bec481 None admin] PATH_INFO: `/v3/users/a7c3e9c0353a4efaab5ddd634194706c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:05.102578 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45649be-1e13-4022-bca7-e4b3a7bec481 None admin] RBAC: Authorizing `identity:get_user(user_id=a7c3e9c0353a4efaab5ddd634194706c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:05.103980 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45649be-1e13-4022-bca7-e4b3a7bec481 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:05.105615 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 143/291] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:27:04 2022] GET /identity/v3/users/a7c3e9c0353a4efaab5ddd634194706c => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:27:05.111519 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e95b5-4172-41a7-b219-615540efc524 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:05.241911 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e95b5-4172-41a7-b219-615540efc524 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:05.265920 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:05.286877 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d80167-b2eb-4466-95a1-8b629607b69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:05.288029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d80167-b2eb-4466-95a1-8b629607b69f None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:05.288029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d80167-b2eb-4466-95a1-8b629607b69f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:05.288389 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d80167-b2eb-4466-95a1-8b629607b69f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:05.382077 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d80167-b2eb-4466-95a1-8b629607b69f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:05.384009 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d80167-b2eb-4466-95a1-8b629607b69f None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:05.490052 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 149/292] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:27:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 03:27:05.495863 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45649be-1e13-4022-bca7-e4b3a7bec481 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:05.650798 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45649be-1e13-4022-bca7-e4b3a7bec481 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:05.698337 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478cf9ec-e635-429e-a32c-142c64c36578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:05.698979 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cf9ec-e635-429e-a32c-142c64c36578 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:05.699261 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cf9ec-e635-429e-a32c-142c64c36578 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:05.699533 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cf9ec-e635-429e-a32c-142c64c36578 None admin] PATH_INFO: `/v3/projects/f14af8f557914f4291de2295e89b8249` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:05.700705 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478cf9ec-e635-429e-a32c-142c64c36578 None admin] RBAC: Authorizing `identity:get_project(project_id=f14af8f557914f4291de2295e89b8249)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:05.702181 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478cf9ec-e635-429e-a32c-142c64c36578 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:05.704097 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 144/293] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:27:05 2022] GET /identity/v3/projects/f14af8f557914f4291de2295e89b8249 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:05.709749 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d80167-b2eb-4466-95a1-8b629607b69f None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:05.741521 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:05.829517 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d80167-b2eb-4466-95a1-8b629607b69f None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:05.864965 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f430f-5cca-4b26-a019-89c440298302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:05.865575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f430f-5cca-4b26-a019-89c440298302 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:05.865939 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f430f-5cca-4b26-a019-89c440298302 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:05.866219 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f430f-5cca-4b26-a019-89c440298302 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:05.866948 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25f430f-5cca-4b26-a019-89c440298302 None admin] RBAC: Adding query filter params (role.id=7591562cf9564b288c108609d8e334b3, scope.project.id=f14af8f557914f4291de2295e89b8249, user.id=a7c3e9c0353a4efaab5ddd634194706c) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:05.867257 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25f430f-5cca-4b26-a019-89c440298302 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:05.868714 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25f430f-5cca-4b26-a019-89c440298302 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:05.875130 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 150/294] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:27:05 2022] GET /identity/v3/role_assignments?user.id=a7c3e9c0353a4efaab5ddd634194706c&scope.project.id=f14af8f557914f4291de2295e89b8249&role.id=7591562cf9564b288c108609d8e334b3 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:06.326446 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2405f-1248-43ae-8d6d-8c1b9cabafe5 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:06.327053 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2405f-1248-43ae-8d6d-8c1b9cabafe5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:06.327328 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2405f-1248-43ae-8d6d-8c1b9cabafe5 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:06.328797 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 145/295] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:06.334261 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d555aa-7895-48d1-bf93-0e952e8c697e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:06.334699 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d555aa-7895-48d1-bf93-0e952e8c697e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:06.334886 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d555aa-7895-48d1-bf93-0e952e8c697e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:06.358681 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c8d555aa-7895-48d1-bf93-0e952e8c697e None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:06.359886 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c8d555aa-7895-48d1-bf93-0e952e8c697e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:06.443715 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 151/296] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:27:06.727578 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2405f-1248-43ae-8d6d-8c1b9cabafe5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:06.740661 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:06.766180 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8cafd-d540-4875-b7d3-3ad11fbb0f91 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:06.766773 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8cafd-d540-4875-b7d3-3ad11fbb0f91 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:06.767253 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8cafd-d540-4875-b7d3-3ad11fbb0f91 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:06.769015 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 152/297] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:06.775573 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e2dc7-fcbf-42f8-aa01-cf477c43fd69 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:06.776114 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e2dc7-fcbf-42f8-aa01-cf477c43fd69 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:06.776590 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e2dc7-fcbf-42f8-aa01-cf477c43fd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:06.796383 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-331e2dc7-fcbf-42f8-aa01-cf477c43fd69 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:06.797968 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-331e2dc7-fcbf-42f8-aa01-cf477c43fd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:06.809981 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:06.840701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2405f-1248-43ae-8d6d-8c1b9cabafe5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:06.869700 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 153/298] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 03:27:06.876138 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8be7d-2c54-4a7d-b8dc-6c483a917e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:06.877024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8be7d-2c54-4a7d-b8dc-6c483a917e36 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:06.877504 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8be7d-2c54-4a7d-b8dc-6c483a917e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:06.878020 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8be7d-2c54-4a7d-b8dc-6c483a917e36 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:06.878941 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec01e7-64d5-4430-958d-1f6b83f53511 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:06.879233 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec01e7-64d5-4430-958d-1f6b83f53511 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:06.879511 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec01e7-64d5-4430-958d-1f6b83f53511 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:06.880764 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 154/299] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:06 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:06.886448 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c9eb6-8e49-47c2-aaac-76ef23f5e160 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:06.887161 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c9eb6-8e49-47c2-aaac-76ef23f5e160 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:06.887601 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c9eb6-8e49-47c2-aaac-76ef23f5e160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:06.892325 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb8be7d-2c54-4a7d-b8dc-6c483a917e36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:06.898192 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-8eb8be7d-2c54-4a7d-b8dc-6c483a917e36 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 03:27:06.898192 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:06.898192 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:06.898192 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:06.898192 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:06.898192 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:06.898192 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:06.898192 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:06.898192 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:06.898192 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:06.898192 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:06.898192 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:06.898192 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:06.898192 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:06.898192 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:06.898192 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:06.899147 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:06.899147 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:06.899147 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:06.899147 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:06.899147 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:06.899147 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:06.899147 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:06.899147 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:06.899147 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:06.899147 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:06.899147 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:06.899147 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:06.899147 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:06.899147 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:06.899147 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:06.899147 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:06.899954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:06.899954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:06.899954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:06.899954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:06.899954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:06.899954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:06.899954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:06.899954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:06.899954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:06.899954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:06.899954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 03:27:06.899954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:06.902772 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 146/300] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:27:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:06.907709 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0d4c9eb6-8e49-47c2-aaac-76ef23f5e160 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:06.908078 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8be7d-2c54-4a7d-b8dc-6c483a917e36 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:06.908893 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0d4c9eb6-8e49-47c2-aaac-76ef23f5e160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:06.983737 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:06.993770 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 155/301] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:27:07.024994 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8be7d-2c54-4a7d-b8dc-6c483a917e36 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:07.060354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61819c1e-a8d9-4e03-8475-527301a081fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:07.061283 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61819c1e-a8d9-4e03-8475-527301a081fc None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:07.061789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61819c1e-a8d9-4e03-8475-527301a081fc None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:07.062261 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61819c1e-a8d9-4e03-8475-527301a081fc None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:07.063111 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61819c1e-a8d9-4e03-8475-527301a081fc None admin] RBAC: Adding query filter params (name=reader) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:07.063630 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61819c1e-a8d9-4e03-8475-527301a081fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:07.065338 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61819c1e-a8d9-4e03-8475-527301a081fc None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:07.075011 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 147/302] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 03:27:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:07.080280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c9eb6-8e49-47c2-aaac-76ef23f5e160 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:07.138727 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61819c1e-a8d9-4e03-8475-527301a081fc None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:07.165678 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:07.195742 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c9eb6-8e49-47c2-aaac-76ef23f5e160 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:07.239536 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d1b96-106d-47f4-ba12-9be1efe1b152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:07.240437 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d1b96-106d-47f4-ba12-9be1efe1b152 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:07.240764 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d1b96-106d-47f4-ba12-9be1efe1b152 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:07.241046 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d1b96-106d-47f4-ba12-9be1efe1b152 None admin] PATH_INFO: `/v3/users/f15fba3cddb64feca7dc14d606b716ea` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:07.260288 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61819c1e-a8d9-4e03-8475-527301a081fc None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:07.261201 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d1b96-106d-47f4-ba12-9be1efe1b152 None admin] RBAC: Authorizing `identity:get_user(user_id=f15fba3cddb64feca7dc14d606b716ea)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:07.262997 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d1b96-106d-47f4-ba12-9be1efe1b152 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:07.265522 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 156/303] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:27:07 2022] GET /identity/v3/users/f15fba3cddb64feca7dc14d606b716ea => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:27:07.271653 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d1b96-106d-47f4-ba12-9be1efe1b152 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:07.298781 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:07.305536 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeba0f6-5174-416e-89ab-73e11eb39f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:07.306196 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeba0f6-5174-416e-89ab-73e11eb39f46 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:07.306473 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeba0f6-5174-416e-89ab-73e11eb39f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:07.311278 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeba0f6-5174-416e-89ab-73e11eb39f46 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:07.311278 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeba0f6-5174-416e-89ab-73e11eb39f46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:07.311278 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeba0f6-5174-416e-89ab-73e11eb39f46 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:07.311278 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 148/304] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:27:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:27:07.316256 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeba0f6-5174-416e-89ab-73e11eb39f46 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:07.387576 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d1b96-106d-47f4-ba12-9be1efe1b152 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:07.418832 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:07.420076 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeba0f6-5174-416e-89ab-73e11eb39f46 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:07.423742 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd07138-7aec-41ec-a5e2-5c1cb12abf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:07.424349 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd07138-7aec-41ec-a5e2-5c1cb12abf4b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:07.424629 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd07138-7aec-41ec-a5e2-5c1cb12abf4b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:07.424901 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd07138-7aec-41ec-a5e2-5c1cb12abf4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:07.425622 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd07138-7aec-41ec-a5e2-5c1cb12abf4b None admin] RBAC: Adding query filter params (role.id=35fd8044264e4590a6dcfeabaf194c78, user.id=f15fba3cddb64feca7dc14d606b716ea, scope.system=all) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:07.425977 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd07138-7aec-41ec-a5e2-5c1cb12abf4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:07.427397 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd07138-7aec-41ec-a5e2-5c1cb12abf4b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:07.432316 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 157/305] 10.222.0.33 () {56 vars in 1308 bytes} [Fri Sep 16 03:27:07 2022] GET /identity/v3/role_assignments?user.id=f15fba3cddb64feca7dc14d606b716ea&scope.system=all&role.id=35fd8044264e4590a6dcfeabaf194c78 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:27:07.437099 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd07138-7aec-41ec-a5e2-5c1cb12abf4b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:07.476042 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fc1d2-9571-443e-8405-1e2b551a8a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:07.477093 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fc1d2-9571-443e-8405-1e2b551a8a3c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:07.477547 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fc1d2-9571-443e-8405-1e2b551a8a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:07.478055 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fc1d2-9571-443e-8405-1e2b551a8a3c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:07.495081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9fc1d2-9571-443e-8405-1e2b551a8a3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:07.503720 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-4d9fc1d2-9571-443e-8405-1e2b551a8a3c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 03:27:07.503720 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:07.503720 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:07.503720 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:07.503720 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:07.503720 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:07.503720 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:07.503720 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:07.503720 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:07.503720 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:07.503720 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:07.503720 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:07.503720 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:07.503720 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:07.503720 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:07.503720 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:07.504681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:07.504681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:07.504681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:07.504681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:07.504681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:07.504681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:07.504681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:07.504681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:07.504681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:07.504681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:07.504681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:07.504681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:07.504681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:07.504681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:07.504681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:07.504681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:07.505448 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:07.505448 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:07.505448 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:07.505448 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:07.505448 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:07.505448 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:07.505448 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:07.505448 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:07.505448 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:07.505448 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:07.505448 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 03:27:07.505448 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:07.506971 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 149/306] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:27:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:07.513609 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fc1d2-9571-443e-8405-1e2b551a8a3c None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:07.556746 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd07138-7aec-41ec-a5e2-5c1cb12abf4b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:07.582139 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:07.600318 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d8a42-cfec-4283-94d0-302a6c8d0a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:07.600950 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d8a42-cfec-4283-94d0-302a6c8d0a8b None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:07.601233 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d8a42-cfec-4283-94d0-302a6c8d0a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:07.602242 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d8a42-cfec-4283-94d0-302a6c8d0a8b None admin] PATH_INFO: `/v3/groups` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:07.602773 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d8a42-cfec-4283-94d0-302a6c8d0a8b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:07.604324 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d8a42-cfec-4283-94d0-302a6c8d0a8b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:07.631964 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fc1d2-9571-443e-8405-1e2b551a8a3c None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:07.666337 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c76b837-2e44-46d8-9781-fe778c1896fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:07.667040 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76b837-2e44-46d8-9781-fe778c1896fc None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:07.667389 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76b837-2e44-46d8-9781-fe778c1896fc None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:07.667727 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76b837-2e44-46d8-9781-fe778c1896fc None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:07.668453 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c76b837-2e44-46d8-9781-fe778c1896fc None admin] RBAC: Adding query filter params (name=member) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:07.668823 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c76b837-2e44-46d8-9781-fe778c1896fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:07.670284 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c76b837-2e44-46d8-9781-fe778c1896fc None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:07.681569 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 150/307] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 03:27:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:27:07.684577 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 158/308] 10.222.0.33 () {60 vars in 1134 bytes} [Fri Sep 16 03:27:07 2022] POST /identity/v3/groups => generated 229 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:27:07.691492 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c76b837-2e44-46d8-9781-fe778c1896fc None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:07.704024 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552c786-4091-4ead-b398-12c2876cbb80 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:07.704616 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552c786-4091-4ead-b398-12c2876cbb80 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:07.704973 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552c786-4091-4ead-b398-12c2876cbb80 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:07.709686 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 159/309] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 03:27:07.713167 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5fd32b-45e9-4119-838f-251b417776b9 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:07.715247 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5fd32b-45e9-4119-838f-251b417776b9 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:07.715247 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5fd32b-45e9-4119-838f-251b417776b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:07.753753 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-6e5fd32b-45e9-4119-838f-251b417776b9 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:07.753753 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6e5fd32b-45e9-4119-838f-251b417776b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:07.869659 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:07.897655 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 160/310] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 03:27:07.909676 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c76b837-2e44-46d8-9781-fe778c1896fc None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:07.937938 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:07.953217 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14447a90-bb51-441f-92b5-5e632c83a09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:07.953907 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14447a90-bb51-441f-92b5-5e632c83a09f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:07.954167 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14447a90-bb51-441f-92b5-5e632c83a09f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:07.954440 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14447a90-bb51-441f-92b5-5e632c83a09f None admin] PATH_INFO: `/v3/users/624ef795589a4556af89829661575328` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:07.955573 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14447a90-bb51-441f-92b5-5e632c83a09f None admin] RBAC: Authorizing `identity:get_user(user_id=624ef795589a4556af89829661575328)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:07.957072 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14447a90-bb51-441f-92b5-5e632c83a09f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:07.959749 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 151/311] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:27:07 2022] GET /identity/v3/users/624ef795589a4556af89829661575328 => generated 293 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:07.966221 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5fd32b-45e9-4119-838f-251b417776b9 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:08.098069 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5fd32b-45e9-4119-838f-251b417776b9 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:08.135564 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a2037-83df-4f8a-87bb-1ed29c4d7bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:08.136591 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a2037-83df-4f8a-87bb-1ed29c4d7bda None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:08.137064 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a2037-83df-4f8a-87bb-1ed29c4d7bda None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:08.137524 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a2037-83df-4f8a-87bb-1ed29c4d7bda None admin] PATH_INFO: `/v3/system/users/624ef795589a4556af89829661575328/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:08.139179 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a2037-83df-4f8a-87bb-1ed29c4d7bda None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=624ef795589a4556af89829661575328, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:08.140753 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a2037-83df-4f8a-87bb-1ed29c4d7bda None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:08.214215 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14447a90-bb51-441f-92b5-5e632c83a09f None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:08.235053 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 161/312] 10.222.0.33 () {58 vars in 1334 bytes} [Fri Sep 16 03:27:07 2022] PUT /identity/v3/system/users/624ef795589a4556af89829661575328/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:27:08.368071 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14447a90-bb51-441f-92b5-5e632c83a09f None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:08.428040 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c552c1b7-4ec6-4f0e-ba13-38fc7b3b9f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:08.428743 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552c1b7-4ec6-4f0e-ba13-38fc7b3b9f22 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:08.429024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552c1b7-4ec6-4f0e-ba13-38fc7b3b9f22 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:08.429296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552c1b7-4ec6-4f0e-ba13-38fc7b3b9f22 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:08.440509 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c552c1b7-4ec6-4f0e-ba13-38fc7b3b9f22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:08.446461 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-c552c1b7-4ec6-4f0e-ba13-38fc7b3b9f22 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 03:27:08.446461 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:08.446461 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:08.446461 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:08.446461 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:08.446461 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:08.446461 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:08.446461 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:08.446461 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:08.446461 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:08.446461 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:08.446461 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:08.446461 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:08.446461 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:08.446461 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:08.446461 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:08.447323 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:08.447323 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:08.447323 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:08.447323 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:08.447323 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:08.447323 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:08.447323 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:08.447323 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:08.447323 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:08.447323 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:08.447323 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:08.447323 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:08.447323 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:08.447323 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:08.447323 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:08.447323 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:08.448143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:08.448143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:08.448143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:08.448143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:08.448143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:08.448143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:08.448143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:08.448143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:08.448143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:08.448143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:08.448143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 03:27:08.448143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:08.448143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 152/313] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:27:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:27:08.454732 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a2037-83df-4f8a-87bb-1ed29c4d7bda None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:08.507171 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:08.559845 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a2037-83df-4f8a-87bb-1ed29c4d7bda None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:08.594843 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f3980-ef3d-4fc5-bbf4-c40890b3f47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:08.595456 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f3980-ef3d-4fc5-bbf4-c40890b3f47c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:08.595741 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f3980-ef3d-4fc5-bbf4-c40890b3f47c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:08.596016 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f3980-ef3d-4fc5-bbf4-c40890b3f47c None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:08.596684 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f3980-ef3d-4fc5-bbf4-c40890b3f47c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:08.596986 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f3980-ef3d-4fc5-bbf4-c40890b3f47c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:08.598389 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f3980-ef3d-4fc5-bbf4-c40890b3f47c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:08.607890 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 162/314] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 03:27:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:27:08.613842 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c552c1b7-4ec6-4f0e-ba13-38fc7b3b9f22 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:08.665305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:08.727874 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c552c1b7-4ec6-4f0e-ba13-38fc7b3b9f22 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:08.763516 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bfe550-8e2a-4097-94c8-4556cd49450e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:08.764522 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfe550-8e2a-4097-94c8-4556cd49450e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:08.764998 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfe550-8e2a-4097-94c8-4556cd49450e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:08.765475 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfe550-8e2a-4097-94c8-4556cd49450e None admin] PATH_INFO: `/v3/users/56becb9745c3480fae1109525220c569` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:08.766836 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bfe550-8e2a-4097-94c8-4556cd49450e None admin] RBAC: Authorizing `identity:get_user(user_id=56becb9745c3480fae1109525220c569)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:08.768508 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bfe550-8e2a-4097-94c8-4556cd49450e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:08.770872 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 153/315] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:27:08 2022] GET /identity/v3/users/56becb9745c3480fae1109525220c569 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:08.777125 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f3980-ef3d-4fc5-bbf4-c40890b3f47c None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:08.884646 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f3980-ef3d-4fc5-bbf4-c40890b3f47c None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:08.898090 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:08.920541 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d06e25-0ed6-46d0-9b8f-41891d12429b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:08.921433 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d06e25-0ed6-46d0-9b8f-41891d12429b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:08.921932 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d06e25-0ed6-46d0-9b8f-41891d12429b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:08.922416 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d06e25-0ed6-46d0-9b8f-41891d12429b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:08.995196 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d06e25-0ed6-46d0-9b8f-41891d12429b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:08.997061 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d06e25-0ed6-46d0-9b8f-41891d12429b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:09.100165 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 163/316] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:27:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 03:27:09.106417 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bfe550-8e2a-4097-94c8-4556cd49450e None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:09.209241 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bfe550-8e2a-4097-94c8-4556cd49450e None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:09.228129 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:09.248541 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa8b49-c648-4733-9b97-890186dca09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:09.249180 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa8b49-c648-4733-9b97-890186dca09e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:09.249465 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa8b49-c648-4733-9b97-890186dca09e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:09.249763 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa8b49-c648-4733-9b97-890186dca09e None admin] PATH_INFO: `/v3/projects/f14af8f557914f4291de2295e89b8249` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:09.250941 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aa8b49-c648-4733-9b97-890186dca09e None admin] RBAC: Authorizing `identity:get_project(project_id=f14af8f557914f4291de2295e89b8249)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:09.252364 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aa8b49-c648-4733-9b97-890186dca09e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:09.254345 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 154/317] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:27:09 2022] GET /identity/v3/projects/f14af8f557914f4291de2295e89b8249 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:09.260677 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d06e25-0ed6-46d0-9b8f-41891d12429b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:09.276742 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:09.365497 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d06e25-0ed6-46d0-9b8f-41891d12429b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:09.401106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55ad9c-f3f9-437e-94b4-d6afc98ab2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:09.401744 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55ad9c-f3f9-437e-94b4-d6afc98ab2d9 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:09.402024 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55ad9c-f3f9-437e-94b4-d6afc98ab2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:09.402299 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55ad9c-f3f9-437e-94b4-d6afc98ab2d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:09.403022 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55ad9c-f3f9-437e-94b4-d6afc98ab2d9 None admin] RBAC: Adding query filter params (role.id=35fd8044264e4590a6dcfeabaf194c78, scope.project.id=f14af8f557914f4291de2295e89b8249, user.id=56becb9745c3480fae1109525220c569) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:09.403324 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55ad9c-f3f9-437e-94b4-d6afc98ab2d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:09.404785 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55ad9c-f3f9-437e-94b4-d6afc98ab2d9 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:09.411013 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 164/318] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:27:09 2022] GET /identity/v3/role_assignments?user.id=56becb9745c3480fae1109525220c569&scope.project.id=f14af8f557914f4291de2295e89b8249&role.id=35fd8044264e4590a6dcfeabaf194c78 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:09.751451 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970b1bd-a16e-48ca-a074-aba1d9a1275d None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:09.751759 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970b1bd-a16e-48ca-a074-aba1d9a1275d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:09.752008 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970b1bd-a16e-48ca-a074-aba1d9a1275d None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:09.753476 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 155/319] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:09.758421 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96563d85-6ee2-43d1-a649-bc3c59acacd1 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:09.758886 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96563d85-6ee2-43d1-a649-bc3c59acacd1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:09.758962 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96563d85-6ee2-43d1-a649-bc3c59acacd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:09.778105 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-96563d85-6ee2-43d1-a649-bc3c59acacd1 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:09.779291 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-96563d85-6ee2-43d1-a649-bc3c59acacd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:09.848372 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 165/320] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 03:27:09.996660 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a7471-86e6-4e2a-9208-38203f4e83e2 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:09.997011 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a7471-86e6-4e2a-9208-38203f4e83e2 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:09.997220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a7471-86e6-4e2a-9208-38203f4e83e2 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:09.998726 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 156/321] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:10.003872 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64495fe-0c29-47e5-a28b-49e2647c81d9 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:10.004161 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64495fe-0c29-47e5-a28b-49e2647c81d9 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:10.004434 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64495fe-0c29-47e5-a28b-49e2647c81d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:10.017337 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:10.025419 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b64495fe-0c29-47e5-a28b-49e2647c81d9 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:10.026642 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b64495fe-0c29-47e5-a28b-49e2647c81d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:10.093679 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 166/322] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:27:10.116390 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a7471-86e6-4e2a-9208-38203f4e83e2 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:10.219023 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a7471-86e6-4e2a-9208-38203f4e83e2 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:10.252932 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc7cf2-766f-4a2a-8fc1-9cad7539fd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:10.253487 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc7cf2-766f-4a2a-8fc1-9cad7539fd37 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:10.253806 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc7cf2-766f-4a2a-8fc1-9cad7539fd37 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:10.254083 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc7cf2-766f-4a2a-8fc1-9cad7539fd37 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:10.264114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc7cf2-766f-4a2a-8fc1-9cad7539fd37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:10.269397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-25fc7cf2-766f-4a2a-8fc1-9cad7539fd37 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 03:27:10.269397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:10.269397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:10.269397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:10.269397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:10.269397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:10.269397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:10.269397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:10.269397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:10.269397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:10.269397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:10.269397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:10.269397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:10.269397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:10.269397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:10.269397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:10.270272 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:10.270272 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:10.270272 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:10.270272 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:10.270272 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:10.270272 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:10.270272 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:10.270272 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:10.270272 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:10.270272 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:10.270272 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:10.270272 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:10.270272 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:10.270272 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:10.270272 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:10.270272 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:10.271307 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:10.271307 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:10.271307 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:10.271307 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:10.271307 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:10.271307 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:10.271307 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:10.271307 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:10.271307 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:10.271307 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:10.271307 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 03:27:10.271307 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:10.274235 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 157/323] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:27:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:10.277019 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64495fe-0c29-47e5-a28b-49e2647c81d9 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:10.375429 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64495fe-0c29-47e5-a28b-49e2647c81d9 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:10.376347 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc7cf2-766f-4a2a-8fc1-9cad7539fd37 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:10.414668 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d708e-338f-44c3-9e10-55c67a1b5ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:10.415291 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d708e-338f-44c3-9e10-55c67a1b5ece None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:10.415579 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d708e-338f-44c3-9e10-55c67a1b5ece None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:10.415878 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d708e-338f-44c3-9e10-55c67a1b5ece None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:10.416531 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d708e-338f-44c3-9e10-55c67a1b5ece None admin] RBAC: Adding query filter params (name=reader) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:10.416840 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d708e-338f-44c3-9e10-55c67a1b5ece None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:10.418248 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d708e-338f-44c3-9e10-55c67a1b5ece None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:10.420650 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:10.426291 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:10.428937 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 167/324] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 03:27:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:10.434686 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d708e-338f-44c3-9e10-55c67a1b5ece None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:10.483237 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc7cf2-766f-4a2a-8fc1-9cad7539fd37 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:10.518398 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb90d5-a322-4e68-bf3b-141aa90a63f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:10.518947 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb90d5-a322-4e68-bf3b-141aa90a63f9 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:10.519225 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb90d5-a322-4e68-bf3b-141aa90a63f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:10.519492 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb90d5-a322-4e68-bf3b-141aa90a63f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:10.520861 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb90d5-a322-4e68-bf3b-141aa90a63f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:10.522373 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb90d5-a322-4e68-bf3b-141aa90a63f9 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:10.524452 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 158/325] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:27:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:27:10.530148 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4666bc-f5b6-40ab-a7f7-80153380df5e None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:10.530434 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4666bc-f5b6-40ab-a7f7-80153380df5e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:10.530708 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4666bc-f5b6-40ab-a7f7-80153380df5e None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:10.532321 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 159/326] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:10.532656 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4666bc-f5b6-40ab-a7f7-80153380df5e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:10.542236 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d708e-338f-44c3-9e10-55c67a1b5ece None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:10.576336 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e17b83b-af22-4569-b5e0-54fb1ad19a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:10.576963 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17b83b-af22-4569-b5e0-54fb1ad19a08 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:10.577244 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17b83b-af22-4569-b5e0-54fb1ad19a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:10.577522 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17b83b-af22-4569-b5e0-54fb1ad19a08 None admin] PATH_INFO: `/v3/users/f15fba3cddb64feca7dc14d606b716ea` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:10.578678 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e17b83b-af22-4569-b5e0-54fb1ad19a08 None admin] RBAC: Authorizing `identity:get_user(user_id=f15fba3cddb64feca7dc14d606b716ea)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:10.580119 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e17b83b-af22-4569-b5e0-54fb1ad19a08 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:10.581714 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 168/327] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:27:10 2022] GET /identity/v3/users/f15fba3cddb64feca7dc14d606b716ea => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:27:10.582807 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3f8fd-3cf1-40ca-babc-31000ecaea38 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:10.583094 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3f8fd-3cf1-40ca-babc-31000ecaea38 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:10.583370 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3f8fd-3cf1-40ca-babc-31000ecaea38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:10.601005 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-65d3f8fd-3cf1-40ca-babc-31000ecaea38 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:10.602741 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-65d3f8fd-3cf1-40ca-babc-31000ecaea38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:10.633829 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4666bc-f5b6-40ab-a7f7-80153380df5e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:10.646479 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:10.660998 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:10.668331 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4da46-2351-41c4-98ef-620d3ab30b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:10.668861 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 169/328] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:27:10.668954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4da46-2351-41c4-98ef-620d3ab30b42 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:10.669211 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4da46-2351-41c4-98ef-620d3ab30b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:10.669492 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4da46-2351-41c4-98ef-620d3ab30b42 None admin] PATH_INFO: `/v3/groups` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:10.669660 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3f8fd-3cf1-40ca-babc-31000ecaea38 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:10.670170 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4da46-2351-41c4-98ef-620d3ab30b42 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:10.671795 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4da46-2351-41c4-98ef-620d3ab30b42 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:10.765887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3f8fd-3cf1-40ca-babc-31000ecaea38 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:10.799421 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061829b4-c5e1-41fc-b5b3-e557bc816aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:10.800241 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061829b4-c5e1-41fc-b5b3-e557bc816aa8 None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:10.800352 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 160/329] 10.222.0.33 () {60 vars in 1134 bytes} [Fri Sep 16 03:27:10 2022] POST /identity/v3/groups => generated 226 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:27:10.801900 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061829b4-c5e1-41fc-b5b3-e557bc816aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:10.802414 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061829b4-c5e1-41fc-b5b3-e557bc816aa8 None admin] PATH_INFO: `/v3/system/users/f15fba3cddb64feca7dc14d606b716ea/roles/35fd8044264e4590a6dcfeabaf194c78` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:10.803807 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061829b4-c5e1-41fc-b5b3-e557bc816aa8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f15fba3cddb64feca7dc14d606b716ea, role_id=35fd8044264e4590a6dcfeabaf194c78)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:10.805387 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061829b4-c5e1-41fc-b5b3-e557bc816aa8 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:10.880979 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 170/330] 10.222.0.33 () {58 vars in 1334 bytes} [Fri Sep 16 03:27:10 2022] PUT /identity/v3/system/users/f15fba3cddb64feca7dc14d606b716ea/roles/35fd8044264e4590a6dcfeabaf194c78 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:27:10.942034 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4da46-2351-41c4-98ef-620d3ab30b42 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:11.073693 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4da46-2351-41c4-98ef-620d3ab30b42 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:11.109288 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ffedb-5888-4fce-b787-419d8aac4276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:11.109961 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ffedb-5888-4fce-b787-419d8aac4276 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:11.110240 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ffedb-5888-4fce-b787-419d8aac4276 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:11.110512 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ffedb-5888-4fce-b787-419d8aac4276 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:11.122453 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ffedb-5888-4fce-b787-419d8aac4276 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:11.127821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-194ffedb-5888-4fce-b787-419d8aac4276 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 03:27:11.127821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:11.127821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:11.127821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:11.127821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:11.127821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:11.127821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:11.127821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:11.127821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:11.127821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:11.127821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:11.127821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:11.127821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:11.127821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:11.127821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:11.127821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:11.128679 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:11.128679 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:11.128679 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:11.128679 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:11.128679 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:11.128679 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:11.128679 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:11.128679 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:11.128679 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:11.128679 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:11.128679 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:11.128679 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:11.128679 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:11.128679 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:11.128679 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:11.128679 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:11.129455 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:11.129455 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:11.129455 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:11.129455 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:11.129455 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:11.129455 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:11.129455 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:11.129455 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:11.129455 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:11.129455 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:11.129455 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 03:27:11.129455 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:11.129455 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 161/331] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:27:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:11.134925 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061829b4-c5e1-41fc-b5b3-e557bc816aa8 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:11.200435 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:11.243403 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061829b4-c5e1-41fc-b5b3-e557bc816aa8 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:11.279448 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cbd848-5fa6-4b6b-8f7c-85389b397cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:11.280482 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbd848-5fa6-4b6b-8f7c-85389b397cec None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:11.281009 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbd848-5fa6-4b6b-8f7c-85389b397cec None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:11.281798 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbd848-5fa6-4b6b-8f7c-85389b397cec None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:11.282670 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cbd848-5fa6-4b6b-8f7c-85389b397cec None admin] RBAC: Adding query filter params (name=member) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:11.283169 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cbd848-5fa6-4b6b-8f7c-85389b397cec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:11.284946 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cbd848-5fa6-4b6b-8f7c-85389b397cec None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:11.294336 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 171/332] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 03:27:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:11.300271 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ffedb-5888-4fce-b787-419d8aac4276 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:11.340860 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:11.426858 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ffedb-5888-4fce-b787-419d8aac4276 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:11.466184 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960a72d-6375-49ea-bbe3-9418780ec052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:11.467190 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960a72d-6375-49ea-bbe3-9418780ec052 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:11.467667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960a72d-6375-49ea-bbe3-9418780ec052 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:11.468219 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960a72d-6375-49ea-bbe3-9418780ec052 None admin] PATH_INFO: `/v3/users/624ef795589a4556af89829661575328` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:11.469548 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d960a72d-6375-49ea-bbe3-9418780ec052 None admin] RBAC: Authorizing `identity:get_user(user_id=624ef795589a4556af89829661575328)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:11.471220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d960a72d-6375-49ea-bbe3-9418780ec052 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:11.474746 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 162/333] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:27:11 2022] GET /identity/v3/users/624ef795589a4556af89829661575328 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:11.479775 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cbd848-5fa6-4b6b-8f7c-85389b397cec None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:11.598892 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cbd848-5fa6-4b6b-8f7c-85389b397cec None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:11.627895 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:11.643238 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c229c0-cbb3-4852-99c7-99c3436f3e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:11.644167 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c229c0-cbb3-4852-99c7-99c3436f3e9c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:11.644611 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c229c0-cbb3-4852-99c7-99c3436f3e9c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:11.649263 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c229c0-cbb3-4852-99c7-99c3436f3e9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:11.649263 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c229c0-cbb3-4852-99c7-99c3436f3e9c None admin] RBAC: Adding query filter params (role.id=7591562cf9564b288c108609d8e334b3, user.id=624ef795589a4556af89829661575328, scope.system=all) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:11.649263 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c229c0-cbb3-4852-99c7-99c3436f3e9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:11.649263 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c229c0-cbb3-4852-99c7-99c3436f3e9c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:11.662431 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 172/334] 10.222.0.33 () {56 vars in 1308 bytes} [Fri Sep 16 03:27:11 2022] GET /identity/v3/role_assignments?user.id=624ef795589a4556af89829661575328&scope.system=all&role.id=7591562cf9564b288c108609d8e334b3 => generated 510 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:13.333688 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d2a49-2e36-43ab-86b7-e9919e475671 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:13.334621 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d2a49-2e36-43ab-86b7-e9919e475671 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:13.335062 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d2a49-2e36-43ab-86b7-e9919e475671 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:13.337108 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 163/335] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:13.342877 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6801c9-02ce-4ea7-b067-799db7cf1189 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:13.343163 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6801c9-02ce-4ea7-b067-799db7cf1189 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:13.343443 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6801c9-02ce-4ea7-b067-799db7cf1189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:13.349140 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca593283-7909-4b9c-853f-0fffa962ee71 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:13.349596 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca593283-7909-4b9c-853f-0fffa962ee71 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:13.349740 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca593283-7909-4b9c-853f-0fffa962ee71 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:13.352726 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 173/336] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:13 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:13.368195 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4c6801c9-02ce-4ea7-b067-799db7cf1189 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:13.369420 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4c6801c9-02ce-4ea7-b067-799db7cf1189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:13.376206 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f45d7-1431-48b0-ba2e-1f20da645b77 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:13.376544 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f45d7-1431-48b0-ba2e-1f20da645b77 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:13.376757 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f45d7-1431-48b0-ba2e-1f20da645b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:13.410662 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8e5f45d7-1431-48b0-ba2e-1f20da645b77 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:13.411898 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8e5f45d7-1431-48b0-ba2e-1f20da645b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:13.508796 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 174/337] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 03:27:13.525370 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 164/338] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 03:27:13.539413 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0084c-964f-4e99-936b-82c1e6436152 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:13.539747 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0084c-964f-4e99-936b-82c1e6436152 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:13.539977 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0084c-964f-4e99-936b-82c1e6436152 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:13.541312 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 175/339] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:13.546670 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f28ea-f1f0-4c7d-ae78-5c340573d4ed None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:13.546954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f28ea-f1f0-4c7d-ae78-5c340573d4ed None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:13.547231 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f28ea-f1f0-4c7d-ae78-5c340573d4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:13.576676 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5e6f28ea-f1f0-4c7d-ae78-5c340573d4ed None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:13.577875 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5e6f28ea-f1f0-4c7d-ae78-5c340573d4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:13.605366 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:13.661261 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 165/340] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 03:27:13.880584 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce0084c-964f-4e99-936b-82c1e6436152 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:13.995692 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f28ea-f1f0-4c7d-ae78-5c340573d4ed None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:14.005122 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce0084c-964f-4e99-936b-82c1e6436152 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:14.017717 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:14.049125 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede4b9e-295e-4bd4-87b5-a9bdc760c8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:14.050141 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede4b9e-295e-4bd4-87b5-a9bdc760c8e1 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:14.051387 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede4b9e-295e-4bd4-87b5-a9bdc760c8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:14.051889 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede4b9e-295e-4bd4-87b5-a9bdc760c8e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:14.068057 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede4b9e-295e-4bd4-87b5-a9bdc760c8e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:14.074175 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-bede4b9e-295e-4bd4-87b5-a9bdc760c8e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 03:27:14.074175 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:14.074175 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:14.074175 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:14.074175 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:14.074175 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:14.074175 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:14.074175 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:14.074175 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:14.074175 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:14.074175 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:14.074175 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:14.074175 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:14.074175 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:14.074175 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:14.074175 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:14.075083 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:14.075083 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:14.075083 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:14.075083 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:14.075083 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:14.075083 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:14.075083 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:14.075083 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:14.075083 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:14.075083 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:14.075083 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:14.075083 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:14.075083 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:14.075083 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:14.075083 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:14.075083 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:14.075915 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:14.075915 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:14.075915 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:14.075915 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:14.075915 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:14.075915 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:14.075915 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:14.075915 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:14.075915 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:14.075915 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:14.075915 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 03:27:14.075915 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:14.078329 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 176/341] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:27:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:14.089752 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede4b9e-295e-4bd4-87b5-a9bdc760c8e1 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:14.221376 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede4b9e-295e-4bd4-87b5-a9bdc760c8e1 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:14.259220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f28ea-f1f0-4c7d-ae78-5c340573d4ed None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:14.260674 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596babf4-aa70-43d2-b45d-93f9778f30b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:14.261607 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596babf4-aa70-43d2-b45d-93f9778f30b8 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:14.262104 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596babf4-aa70-43d2-b45d-93f9778f30b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:14.264169 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596babf4-aa70-43d2-b45d-93f9778f30b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:14.265192 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596babf4-aa70-43d2-b45d-93f9778f30b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:14.265704 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596babf4-aa70-43d2-b45d-93f9778f30b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:14.268065 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596babf4-aa70-43d2-b45d-93f9778f30b8 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:14.285752 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 177/342] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 03:27:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:27:14.288177 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596babf4-aa70-43d2-b45d-93f9778f30b8 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:14.334307 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa05fc-cb0e-4d7a-a686-828588d4fede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:14.336409 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa05fc-cb0e-4d7a-a686-828588d4fede None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:14.337954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa05fc-cb0e-4d7a-a686-828588d4fede None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:14.338463 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa05fc-cb0e-4d7a-a686-828588d4fede None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:14.352372 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:14.368218 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa05fc-cb0e-4d7a-a686-828588d4fede None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:14.374304 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-06aa05fc-cb0e-4d7a-a686-828588d4fede None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 03:27:14.374304 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:14.374304 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:14.374304 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:14.374304 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:14.374304 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:14.374304 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:14.374304 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:14.374304 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:14.374304 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:14.374304 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:14.374304 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:14.374304 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:14.374304 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:14.374304 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:14.374304 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:14.375190 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:14.375190 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:14.375190 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:14.375190 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:14.375190 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:14.375190 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:14.375190 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:14.375190 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:14.375190 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:14.375190 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:14.375190 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:14.375190 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:14.375190 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:14.375190 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:14.375190 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:14.375190 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:14.375980 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:14.375980 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:14.375980 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:14.375980 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:14.375980 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:14.375980 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:14.375980 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:14.375980 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:14.375980 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:14.375980 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:14.375980 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 03:27:14.375980 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:14.379641 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 166/343] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:27:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:14.385444 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa05fc-cb0e-4d7a-a686-828588d4fede None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:14.419219 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:14.508661 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596babf4-aa70-43d2-b45d-93f9778f30b8 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:14.532954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa05fc-cb0e-4d7a-a686-828588d4fede None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:14.571605 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9adfd-5e80-4ee4-8ef8-ce8cdbe7ce7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:14.572338 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9adfd-5e80-4ee4-8ef8-ce8cdbe7ce7c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:14.572619 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9adfd-5e80-4ee4-8ef8-ce8cdbe7ce7c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:14.572889 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9adfd-5e80-4ee4-8ef8-ce8cdbe7ce7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:14.588932 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a4b3e-aeca-464e-bb80-b48635e43a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:14.589587 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a4b3e-aeca-464e-bb80-b48635e43a19 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:14.589889 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a4b3e-aeca-464e-bb80-b48635e43a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:14.590220 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a4b3e-aeca-464e-bb80-b48635e43a19 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:14.618433 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a4b3e-aeca-464e-bb80-b48635e43a19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:14.623631 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-7d5a4b3e-aeca-464e-bb80-b48635e43a19 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 03:27:14.623631 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:14.623631 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:14.623631 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:14.623631 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:14.623631 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:14.623631 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:14.623631 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:14.623631 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:14.623631 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:14.623631 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:14.623631 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:14.623631 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:14.623631 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:14.623631 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:14.623631 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:14.624540 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:14.624540 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:14.624540 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:14.624540 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:14.624540 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:14.624540 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:14.624540 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:14.624540 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:14.624540 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:14.624540 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:14.624540 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:14.624540 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:14.624540 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:14.624540 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:14.624540 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:14.624540 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:14.625828 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:14.625828 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:14.625828 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:14.625828 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:14.625828 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:14.625828 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:14.625828 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:14.625828 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:14.625828 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:14.625828 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:14.625828 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 03:27:14.625828 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:14.625828 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 178/344] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 03:27:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:14.625828 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a4b3e-aeca-464e-bb80-b48635e43a19 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:14.676969 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9adfd-5e80-4ee4-8ef8-ce8cdbe7ce7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:14.678656 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9adfd-5e80-4ee4-8ef8-ce8cdbe7ce7c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:14.718077 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:14.753617 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:14.763240 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a4b3e-aeca-464e-bb80-b48635e43a19 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:14.797605 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 167/345] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:27:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 03:27:14.798767 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9adfd-5e80-4ee4-8ef8-ce8cdbe7ce7c None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:14.802978 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfc8a6-e708-4299-a11f-6304222c859d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:14.803238 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfc8a6-e708-4299-a11f-6304222c859d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:14.804122 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfc8a6-e708-4299-a11f-6304222c859d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:14.804122 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfc8a6-e708-4299-a11f-6304222c859d None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:14.806166 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cfc8a6-e708-4299-a11f-6304222c859d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:14.806552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cfc8a6-e708-4299-a11f-6304222c859d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:14.808085 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cfc8a6-e708-4299-a11f-6304222c859d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:14.817673 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 179/346] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 03:27:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:14.818971 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00649304-a8d4-476b-b764-0d2f5ae81aa2 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:14.819353 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00649304-a8d4-476b-b764-0d2f5ae81aa2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:14.819694 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00649304-a8d4-476b-b764-0d2f5ae81aa2 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:14.821188 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 180/347] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:14.825655 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00649304-a8d4-476b-b764-0d2f5ae81aa2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:14.914036 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9adfd-5e80-4ee4-8ef8-ce8cdbe7ce7c None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:14.940510 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00649304-a8d4-476b-b764-0d2f5ae81aa2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:14.953913 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ac2b6-f51b-4759-aa83-1e5aa8f18ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:14.954894 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ac2b6-f51b-4759-aa83-1e5aa8f18ffa None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:14.955727 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ac2b6-f51b-4759-aa83-1e5aa8f18ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:14.956178 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ac2b6-f51b-4759-aa83-1e5aa8f18ffa None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:14.957004 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ac2b6-f51b-4759-aa83-1e5aa8f18ffa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:14.957490 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ac2b6-f51b-4759-aa83-1e5aa8f18ffa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:14.959438 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ac2b6-f51b-4759-aa83-1e5aa8f18ffa None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:14.965860 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:14.969500 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 168/348] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:27:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:14.975994 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6cfb4-9a26-4b19-af86-630acfb67002 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:14.976665 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6cfb4-9a26-4b19-af86-630acfb67002 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:14.977158 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6cfb4-9a26-4b19-af86-630acfb67002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:14.980229 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d769e4-97f1-461b-927a-794677fe191d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:14.980875 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d769e4-97f1-461b-927a-794677fe191d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:14.981145 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d769e4-97f1-461b-927a-794677fe191d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:14.981421 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d769e4-97f1-461b-927a-794677fe191d None admin] PATH_INFO: `/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:14.982593 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d769e4-97f1-461b-927a-794677fe191d None admin] RBAC: Authorizing `identity:get_project(project_id=e01bdca6ef9f47b192f68f70ff0bbdad)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:14.984133 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d769e4-97f1-461b-927a-794677fe191d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:14.985891 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 181/349] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:27:14 2022] GET /identity/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:14.987055 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d769e4-97f1-461b-927a-794677fe191d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:14.999022 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-bdd6cfb4-9a26-4b19-af86-630acfb67002 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:15.000578 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bdd6cfb4-9a26-4b19-af86-630acfb67002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:15.014135 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:15.073954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 169/350] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:27:15.075317 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6cfb4-9a26-4b19-af86-630acfb67002 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:15.094350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d769e4-97f1-461b-927a-794677fe191d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:15.146818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a12c8-3c43-46c2-8907-4d511d6583ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:15.147495 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a12c8-3c43-46c2-8907-4d511d6583ef None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:15.147778 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a12c8-3c43-46c2-8907-4d511d6583ef None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:15.148051 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a12c8-3c43-46c2-8907-4d511d6583ef None admin] PATH_INFO: `/v3/users/f15fba3cddb64feca7dc14d606b716ea` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:15.149273 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a12c8-3c43-46c2-8907-4d511d6583ef None admin] RBAC: Authorizing `identity:get_user(user_id=f15fba3cddb64feca7dc14d606b716ea)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:15.150793 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a12c8-3c43-46c2-8907-4d511d6583ef None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:15.152371 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 182/351] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:27:14 2022] GET /identity/v3/users/f15fba3cddb64feca7dc14d606b716ea => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:15.154398 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a12c8-3c43-46c2-8907-4d511d6583ef None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:15.201940 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6cfb4-9a26-4b19-af86-630acfb67002 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:15.237994 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:15.256074 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:15.258469 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8138756-6fcc-4167-9a6e-d89dfc8aef74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:15.259087 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8138756-6fcc-4167-9a6e-d89dfc8aef74 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:15.259359 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8138756-6fcc-4167-9a6e-d89dfc8aef74 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:15.259625 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8138756-6fcc-4167-9a6e-d89dfc8aef74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:15.265277 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a12c8-3c43-46c2-8907-4d511d6583ef None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:15.300840 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8256f-a035-4e74-aeab-1ab50b7c2c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:15.301479 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8256f-a035-4e74-aeab-1ab50b7c2c62 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:15.301824 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8256f-a035-4e74-aeab-1ab50b7c2c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:15.302095 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8256f-a035-4e74-aeab-1ab50b7c2c62 None admin] PATH_INFO: `/v3/groups/5056d570cd214b52931080e6fe4bc241` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:15.308985 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c8256f-a035-4e74-aeab-1ab50b7c2c62 None admin] RBAC: Authorizing `identity:get_group(group_id=5056d570cd214b52931080e6fe4bc241)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:15.310528 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c8256f-a035-4e74-aeab-1ab50b7c2c62 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:15.312324 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 183/352] 10.222.0.33 () {56 vars in 1180 bytes} [Fri Sep 16 03:27:15 2022] GET /identity/v3/groups/5056d570cd214b52931080e6fe4bc241 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:15.313902 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8256f-a035-4e74-aeab-1ab50b7c2c62 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:15.340961 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8138756-6fcc-4167-9a6e-d89dfc8aef74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:15.342696 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8138756-6fcc-4167-9a6e-d89dfc8aef74 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:15.447556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8256f-a035-4e74-aeab-1ab50b7c2c62 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:15.449325 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 170/353] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:27:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 03:27:15.454408 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8138756-6fcc-4167-9a6e-d89dfc8aef74 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:15.483126 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:15.486241 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a7793a-21a8-4974-a400-479c1911474d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:15.486857 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7793a-21a8-4974-a400-479c1911474d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:15.487137 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7793a-21a8-4974-a400-479c1911474d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:15.487407 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7793a-21a8-4974-a400-479c1911474d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:15.488195 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a7793a-21a8-4974-a400-479c1911474d None admin] RBAC: Adding query filter params (role.id=35fd8044264e4590a6dcfeabaf194c78, user.id=f15fba3cddb64feca7dc14d606b716ea, scope.system=all) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:15.488501 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a7793a-21a8-4974-a400-479c1911474d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:15.490077 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a7793a-21a8-4974-a400-479c1911474d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:15.504504 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 184/354] 10.222.0.33 () {56 vars in 1308 bytes} [Fri Sep 16 03:27:15 2022] GET /identity/v3/role_assignments?user.id=f15fba3cddb64feca7dc14d606b716ea&scope.system=all&role.id=35fd8044264e4590a6dcfeabaf194c78 => generated 510 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:15.505427 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a7793a-21a8-4974-a400-479c1911474d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:15.522033 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:15.568735 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8138756-6fcc-4167-9a6e-d89dfc8aef74 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:15.607626 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c59c9f-f205-44d8-83d8-7069c01e8596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:15.608682 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c59c9f-f205-44d8-83d8-7069c01e8596 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:15.609102 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c59c9f-f205-44d8-83d8-7069c01e8596 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:15.609526 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c59c9f-f205-44d8-83d8-7069c01e8596 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:15.610573 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c59c9f-f205-44d8-83d8-7069c01e8596 None admin] RBAC: Adding query filter params (group.id=5056d570cd214b52931080e6fe4bc241, role.id=7591562cf9564b288c108609d8e334b3, scope.project.id=e01bdca6ef9f47b192f68f70ff0bbdad) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:15.611045 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c59c9f-f205-44d8-83d8-7069c01e8596 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:15.612880 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c59c9f-f205-44d8-83d8-7069c01e8596 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:15.619704 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a7793a-21a8-4974-a400-479c1911474d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:15.620664 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 171/355] 10.222.0.33 () {56 vars in 1376 bytes} [Fri Sep 16 03:27:15 2022] GET /identity/v3/role_assignments?group.id=5056d570cd214b52931080e6fe4bc241&scope.project.id=e01bdca6ef9f47b192f68f70ff0bbdad&role.id=7591562cf9564b288c108609d8e334b3 => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:15.661747 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9c22b-5e7a-4e53-9bc0-c7e76fd81f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:15.662505 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9c22b-5e7a-4e53-9bc0-c7e76fd81f01 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:15.662792 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9c22b-5e7a-4e53-9bc0-c7e76fd81f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:15.663066 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9c22b-5e7a-4e53-9bc0-c7e76fd81f01 None admin] PATH_INFO: `/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:15.664415 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b9c22b-5e7a-4e53-9bc0-c7e76fd81f01 None admin] RBAC: Authorizing `identity:get_project(project_id=e01bdca6ef9f47b192f68f70ff0bbdad)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:15.665934 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b9c22b-5e7a-4e53-9bc0-c7e76fd81f01 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:15.667729 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 185/356] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:27:15 2022] GET /identity/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:15.673696 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c59c9f-f205-44d8-83d8-7069c01e8596 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:15.688774 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9c22b-5e7a-4e53-9bc0-c7e76fd81f01 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:15.831428 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:15.835421 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:15.877552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9c22b-5e7a-4e53-9bc0-c7e76fd81f01 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:15.881223 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c59c9f-f205-44d8-83d8-7069c01e8596 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:15.931930 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a7b8b-2c1e-4cae-8233-6575afb14be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:15.932989 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a7b8b-2c1e-4cae-8233-6575afb14be1 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:15.933489 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a7b8b-2c1e-4cae-8233-6575afb14be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:15.933938 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a7b8b-2c1e-4cae-8233-6575afb14be1 None admin] PATH_INFO: `/v3/groups/5056d570cd214b52931080e6fe4bc241` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:15.935271 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a7b8b-2c1e-4cae-8233-6575afb14be1 None admin] RBAC: Authorizing `identity:get_group(group_id=5056d570cd214b52931080e6fe4bc241)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:15.936679 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a7b8b-2c1e-4cae-8233-6575afb14be1 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:15.938586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 172/357] 10.222.0.33 () {56 vars in 1180 bytes} [Fri Sep 16 03:27:15 2022] GET /identity/v3/groups/5056d570cd214b52931080e6fe4bc241 => generated 226 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:15.939685 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15097d4-e17b-496f-89f1-3b5dcd82702f None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:15.939965 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15097d4-e17b-496f-89f1-3b5dcd82702f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:15.940236 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15097d4-e17b-496f-89f1-3b5dcd82702f None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:15.943674 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae842b6-cc77-46ab-ad79-7ebad83773f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:15.944551 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae842b6-cc77-46ab-ad79-7ebad83773f9 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:15.945579 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae842b6-cc77-46ab-ad79-7ebad83773f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:15.945992 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 173/358] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:15.946316 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae842b6-cc77-46ab-ad79-7ebad83773f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:15.946876 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15097d4-e17b-496f-89f1-3b5dcd82702f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:15.964982 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae842b6-cc77-46ab-ad79-7ebad83773f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:15.970771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-4ae842b6-cc77-46ab-ad79-7ebad83773f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 03:27:15.970771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:15.970771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:15.970771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:15.970771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:15.970771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:15.970771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:15.970771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:15.970771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:15.970771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:15.970771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:15.970771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:15.970771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:15.970771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:15.970771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:15.970771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:15.971727 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:15.971727 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:15.971727 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:15.971727 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:15.971727 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:15.971727 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:15.971727 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:15.971727 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:15.971727 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:15.971727 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:15.971727 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:15.971727 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:15.971727 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:15.971727 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:15.971727 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:15.971727 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:15.972516 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:15.972516 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:15.972516 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:15.972516 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:15.972516 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:15.972516 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:15.972516 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:15.972516 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:15.972516 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:15.972516 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:15.972516 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 03:27:15.972516 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:15.975345 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 186/359] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:27:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:27:15.975554 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9c764-b385-4d1d-b6f1-ee939082120d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:15.975837 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9c764-b385-4d1d-b6f1-ee939082120d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:15.976112 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9c764-b385-4d1d-b6f1-ee939082120d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:16.003199 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-37f9c764-b385-4d1d-b6f1-ee939082120d None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:16.004788 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-37f9c764-b385-4d1d-b6f1-ee939082120d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:16.088395 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 187/360] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:27:16.089413 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9c764-b385-4d1d-b6f1-ee939082120d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:16.102991 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15097d4-e17b-496f-89f1-3b5dcd82702f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:16.151068 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64060b-420a-4792-b250-df7d0c7d1e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:16.151786 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64060b-420a-4792-b250-df7d0c7d1e03 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:16.152175 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64060b-420a-4792-b250-df7d0c7d1e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:16.152513 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64060b-420a-4792-b250-df7d0c7d1e03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:16.153254 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f64060b-420a-4792-b250-df7d0c7d1e03 None admin] RBAC: Adding query filter params (group.id=5056d570cd214b52931080e6fe4bc241, role.id=fcb362c8a9fd47fbbb6b14397cae171c, scope.project.id=e01bdca6ef9f47b192f68f70ff0bbdad) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:16.153566 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f64060b-420a-4792-b250-df7d0c7d1e03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:16.155307 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f64060b-420a-4792-b250-df7d0c7d1e03 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:16.166310 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:16.167578 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 174/361] 10.222.0.33 () {56 vars in 1376 bytes} [Fri Sep 16 03:27:15 2022] GET /identity/v3/role_assignments?group.id=5056d570cd214b52931080e6fe4bc241&scope.project.id=e01bdca6ef9f47b192f68f70ff0bbdad&role.id=fcb362c8a9fd47fbbb6b14397cae171c => generated 260 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:16.186168 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74ee5c-45d3-418c-9864-01733cc29d32 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:16.186493 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74ee5c-45d3-418c-9864-01733cc29d32 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:16.186724 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74ee5c-45d3-418c-9864-01733cc29d32 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:16.188335 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 175/362] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 03:27:16.199573 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3919b0-d9a6-45c5-8132-3def43e3f2c9 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:16.199758 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3919b0-d9a6-45c5-8132-3def43e3f2c9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:16.199993 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3919b0-d9a6-45c5-8132-3def43e3f2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:16.217380 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9c764-b385-4d1d-b6f1-ee939082120d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:16.258196 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-9b3919b0-d9a6-45c5-8132-3def43e3f2c9 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:16.259539 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9b3919b0-d9a6-45c5-8132-3def43e3f2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:16.261123 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85654506-4635-4fde-858b-bfde8b1947cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:16.262386 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85654506-4635-4fde-858b-bfde8b1947cc None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:16.262883 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85654506-4635-4fde-858b-bfde8b1947cc None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:16.263373 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85654506-4635-4fde-858b-bfde8b1947cc None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:16.264301 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85654506-4635-4fde-858b-bfde8b1947cc None admin] RBAC: Adding query filter params (name=member) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:16.264959 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85654506-4635-4fde-858b-bfde8b1947cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:16.265136 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:16.267686 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85654506-4635-4fde-858b-bfde8b1947cc None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:16.279412 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 188/363] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 03:27:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:16.286249 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85654506-4635-4fde-858b-bfde8b1947cc None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:16.411506 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 176/364] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 03:27:16.419408 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85654506-4635-4fde-858b-bfde8b1947cc None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:16.452383 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:16.457567 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0275419-17fe-40ef-9c25-c9855c78bfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:16.458214 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0275419-17fe-40ef-9c25-c9855c78bfd4 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:16.458556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0275419-17fe-40ef-9c25-c9855c78bfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:16.458830 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0275419-17fe-40ef-9c25-c9855c78bfd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:16.530582 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3919b0-d9a6-45c5-8132-3def43e3f2c9 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:16.535741 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0275419-17fe-40ef-9c25-c9855c78bfd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:16.538088 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0275419-17fe-40ef-9c25-c9855c78bfd4 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:16.671153 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 189/365] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:27:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 03:27:16.677123 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0275419-17fe-40ef-9c25-c9855c78bfd4 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:16.691778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3919b0-d9a6-45c5-8132-3def43e3f2c9 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:16.726041 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:16.759647 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4b7b3-a755-416d-8695-395b1353c4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:16.760436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4b7b3-a755-416d-8695-395b1353c4ce None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:16.761024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4b7b3-a755-416d-8695-395b1353c4ce None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:16.761442 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4b7b3-a755-416d-8695-395b1353c4ce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:16.771084 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:16.775764 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad4b7b3-a755-416d-8695-395b1353c4ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:16.782553 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-6ad4b7b3-a755-416d-8695-395b1353c4ce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 03:27:16.782553 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:16.782553 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:16.782553 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:16.782553 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:16.782553 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:16.782553 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:16.782553 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:16.782553 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:16.782553 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:16.782553 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:16.782553 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:16.782553 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:16.782553 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:16.782553 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:16.782553 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:16.783429 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:16.783429 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:16.783429 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:16.783429 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:16.783429 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:16.783429 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:16.783429 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:16.783429 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:16.783429 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:16.783429 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:16.783429 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:16.783429 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:16.783429 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:16.783429 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:16.783429 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:16.783429 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:16.784216 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:16.784216 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:16.784216 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:16.784216 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:16.784216 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:16.784216 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:16.784216 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:16.784216 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:16.784216 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:16.784216 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:16.784216 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 03:27:16.784216 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:16.784216 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 177/366] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 03:27:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:27:16.784897 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4b7b3-a755-416d-8695-395b1353c4ce None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:16.802847 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0275419-17fe-40ef-9c25-c9855c78bfd4 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:16.843885 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc80ff6-1522-42d8-8d7d-ebd686d50067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:16.844526 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc80ff6-1522-42d8-8d7d-ebd686d50067 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:16.844811 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc80ff6-1522-42d8-8d7d-ebd686d50067 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:16.845083 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc80ff6-1522-42d8-8d7d-ebd686d50067 None admin] PATH_INFO: `/v3/projects/f14af8f557914f4291de2295e89b8249` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:16.846352 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc80ff6-1522-42d8-8d7d-ebd686d50067 None admin] RBAC: Authorizing `identity:get_project(project_id=f14af8f557914f4291de2295e89b8249)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:16.848020 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc80ff6-1522-42d8-8d7d-ebd686d50067 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:16.850076 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 190/367] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:27:16 2022] GET /identity/v3/projects/f14af8f557914f4291de2295e89b8249 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:16.851046 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc80ff6-1522-42d8-8d7d-ebd686d50067 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:16.926622 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4b7b3-a755-416d-8695-395b1353c4ce None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:16.966821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d5366-3cf6-4c86-afc9-779668504bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:16.967468 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d5366-3cf6-4c86-afc9-779668504bcb None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:16.968308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d5366-3cf6-4c86-afc9-779668504bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:16.968590 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d5366-3cf6-4c86-afc9-779668504bcb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:16.977251 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:16.980397 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc80ff6-1522-42d8-8d7d-ebd686d50067 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:16.982505 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d5366-3cf6-4c86-afc9-779668504bcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:16.988846 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-de6d5366-3cf6-4c86-afc9-779668504bcb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:27:16.988846 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:16.988846 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:16.988846 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:16.988846 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:16.988846 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:16.988846 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:16.988846 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:16.988846 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:16.988846 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:16.988846 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:16.988846 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:16.988846 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:16.988846 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:16.988846 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:16.988846 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:16.996466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:16.996466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:16.996466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:16.996466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:16.996466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:16.996466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:16.996466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:16.996466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:16.996466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:16.996466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:16.996466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:16.996466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:16.996466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:16.996466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:16.996466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:16.996466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:16.997254 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:16.997254 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:16.997254 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:16.997254 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:16.997254 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:16.997254 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:16.997254 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:16.997254 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:16.997254 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:16.997254 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:16.997254 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:27:16.997254 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:16.997254 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 178/368] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 03:27:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:16.997254 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d5366-3cf6-4c86-afc9-779668504bcb None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:17.028411 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de15d3f-ab98-4a3a-8f17-7a23575b3961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:17.029082 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de15d3f-ab98-4a3a-8f17-7a23575b3961 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:17.029625 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de15d3f-ab98-4a3a-8f17-7a23575b3961 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:17.029625 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de15d3f-ab98-4a3a-8f17-7a23575b3961 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:17.030482 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de15d3f-ab98-4a3a-8f17-7a23575b3961 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:17.030729 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de15d3f-ab98-4a3a-8f17-7a23575b3961 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:17.032230 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de15d3f-ab98-4a3a-8f17-7a23575b3961 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:17.040902 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 191/369] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:27:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:17.041905 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de15d3f-ab98-4a3a-8f17-7a23575b3961 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:17.079703 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:17.131811 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d5366-3cf6-4c86-afc9-779668504bcb None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:17.172031 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de15d3f-ab98-4a3a-8f17-7a23575b3961 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:17.177706 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290a8d5-b80d-40c0-9b7b-d271925f7e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:17.178370 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290a8d5-b80d-40c0-9b7b-d271925f7e81 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:17.178710 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290a8d5-b80d-40c0-9b7b-d271925f7e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:17.179046 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290a8d5-b80d-40c0-9b7b-d271925f7e81 None admin] PATH_INFO: `/v3/groups/5056d570cd214b52931080e6fe4bc241` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:17.181307 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290a8d5-b80d-40c0-9b7b-d271925f7e81 None admin] RBAC: Authorizing `identity:get_group(group_id=5056d570cd214b52931080e6fe4bc241)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:17.183311 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290a8d5-b80d-40c0-9b7b-d271925f7e81 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:17.185909 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 179/370] 10.222.0.33 () {56 vars in 1180 bytes} [Fri Sep 16 03:27:16 2022] GET /identity/v3/groups/5056d570cd214b52931080e6fe4bc241 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:17.186958 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290a8d5-b80d-40c0-9b7b-d271925f7e81 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:17.210086 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde065ca-86f8-46cf-85bc-721871b39861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:17.211268 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde065ca-86f8-46cf-85bc-721871b39861 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:17.211557 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde065ca-86f8-46cf-85bc-721871b39861 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:17.211889 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde065ca-86f8-46cf-85bc-721871b39861 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:17.212608 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde065ca-86f8-46cf-85bc-721871b39861 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:17.212916 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde065ca-86f8-46cf-85bc-721871b39861 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:17.214342 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde065ca-86f8-46cf-85bc-721871b39861 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:17.226098 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 192/371] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:27:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:17.227095 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde065ca-86f8-46cf-85bc-721871b39861 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:17.262447 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:17.330869 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290a8d5-b80d-40c0-9b7b-d271925f7e81 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:17.357359 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde065ca-86f8-46cf-85bc-721871b39861 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:17.358239 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:17.367783 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec85e89-536f-45a2-acb0-b73db69609f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:17.368407 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec85e89-536f-45a2-acb0-b73db69609f0 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:17.373766 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec85e89-536f-45a2-acb0-b73db69609f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:17.373766 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec85e89-536f-45a2-acb0-b73db69609f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:17.398008 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5891389-3246-49ea-9a4e-5862f745059c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:17.398684 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5891389-3246-49ea-9a4e-5862f745059c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:17.398961 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5891389-3246-49ea-9a4e-5862f745059c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:17.400684 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5891389-3246-49ea-9a4e-5862f745059c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:17.401430 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5891389-3246-49ea-9a4e-5862f745059c None admin] RBAC: Adding query filter params (group.id=5056d570cd214b52931080e6fe4bc241, role.id=7591562cf9564b288c108609d8e334b3, scope.project.id=f14af8f557914f4291de2295e89b8249) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:17.401760 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5891389-3246-49ea-9a4e-5862f745059c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:17.403531 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5891389-3246-49ea-9a4e-5862f745059c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:17.410112 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 193/372] 10.222.0.33 () {56 vars in 1376 bytes} [Fri Sep 16 03:27:17 2022] GET /identity/v3/role_assignments?group.id=5056d570cd214b52931080e6fe4bc241&scope.project.id=f14af8f557914f4291de2295e89b8249&role.id=7591562cf9564b288c108609d8e334b3 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:17.410980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5891389-3246-49ea-9a4e-5862f745059c None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:17.459828 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec85e89-536f-45a2-acb0-b73db69609f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:17.461417 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec85e89-536f-45a2-acb0-b73db69609f0 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:17.536493 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:17.551431 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5891389-3246-49ea-9a4e-5862f745059c None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:17.602304 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39545e9-a298-4abe-a7ae-20a862eaf9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:17.602936 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39545e9-a298-4abe-a7ae-20a862eaf9f5 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:17.603214 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39545e9-a298-4abe-a7ae-20a862eaf9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:17.603484 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39545e9-a298-4abe-a7ae-20a862eaf9f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:17.612703 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 180/373] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:27:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 03:27:17.618253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec85e89-536f-45a2-acb0-b73db69609f0 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:17.646676 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:17.690881 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39545e9-a298-4abe-a7ae-20a862eaf9f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:17.693523 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39545e9-a298-4abe-a7ae-20a862eaf9f5 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:17.738133 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec85e89-536f-45a2-acb0-b73db69609f0 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:17.776992 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2649b9c-76ee-4b18-90af-13ab1c39c6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:17.777659 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2649b9c-76ee-4b18-90af-13ab1c39c6b4 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:17.778034 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2649b9c-76ee-4b18-90af-13ab1c39c6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:17.778313 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2649b9c-76ee-4b18-90af-13ab1c39c6b4 None admin] PATH_INFO: `/v3/projects/f14af8f557914f4291de2295e89b8249` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:17.779468 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2649b9c-76ee-4b18-90af-13ab1c39c6b4 None admin] RBAC: Authorizing `identity:get_project(project_id=f14af8f557914f4291de2295e89b8249)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:17.780929 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2649b9c-76ee-4b18-90af-13ab1c39c6b4 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:17.782998 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 181/374] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:27:17 2022] GET /identity/v3/projects/f14af8f557914f4291de2295e89b8249 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:27:17.787926 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2649b9c-76ee-4b18-90af-13ab1c39c6b4 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:17.814696 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:17.829031 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 194/375] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:27:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 03:27:17.837344 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39545e9-a298-4abe-a7ae-20a862eaf9f5 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:17.948011 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:17.959153 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2649b9c-76ee-4b18-90af-13ab1c39c6b4 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:18.016134 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39545e9-a298-4abe-a7ae-20a862eaf9f5 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:18.031429 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f3cf32-de61-403d-9883-10674ad2a4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:18.032181 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3cf32-de61-403d-9883-10674ad2a4aa None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:18.032468 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3cf32-de61-403d-9883-10674ad2a4aa None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:18.032744 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3cf32-de61-403d-9883-10674ad2a4aa None admin] PATH_INFO: `/v3/groups/5056d570cd214b52931080e6fe4bc241` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:18.034921 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f3cf32-de61-403d-9883-10674ad2a4aa None admin] RBAC: Authorizing `identity:get_group(group_id=5056d570cd214b52931080e6fe4bc241)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:18.036480 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f3cf32-de61-403d-9883-10674ad2a4aa None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:18.042693 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 182/376] 10.222.0.33 () {56 vars in 1180 bytes} [Fri Sep 16 03:27:17 2022] GET /identity/v3/groups/5056d570cd214b52931080e6fe4bc241 => generated 226 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:27:18.048813 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f3cf32-de61-403d-9883-10674ad2a4aa None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:18.061077 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0097bce-c76f-4d02-a000-11e9127cc30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:18.061774 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0097bce-c76f-4d02-a000-11e9127cc30a None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:18.062058 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0097bce-c76f-4d02-a000-11e9127cc30a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:18.062333 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0097bce-c76f-4d02-a000-11e9127cc30a None admin] PATH_INFO: `/v3/projects/4c378d507cbc42e4b80e3f5c14a93477` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:18.063466 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0097bce-c76f-4d02-a000-11e9127cc30a None admin] RBAC: Authorizing `identity:get_project(project_id=4c378d507cbc42e4b80e3f5c14a93477)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:18.064903 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0097bce-c76f-4d02-a000-11e9127cc30a None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:18.066547 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 195/377] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:27:17 2022] GET /identity/v3/projects/4c378d507cbc42e4b80e3f5c14a93477 => generated 344 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:18.074003 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0097bce-c76f-4d02-a000-11e9127cc30a None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:18.183959 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:18.193444 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f3cf32-de61-403d-9883-10674ad2a4aa None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:18.252957 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881745f8-544e-4b3f-863d-ebf8af88387f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:18.253578 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881745f8-544e-4b3f-863d-ebf8af88387f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:18.253875 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881745f8-544e-4b3f-863d-ebf8af88387f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:18.254153 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881745f8-544e-4b3f-863d-ebf8af88387f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:18.254882 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881745f8-544e-4b3f-863d-ebf8af88387f None admin] RBAC: Adding query filter params (group.id=5056d570cd214b52931080e6fe4bc241, role.id=fcb362c8a9fd47fbbb6b14397cae171c, scope.project.id=f14af8f557914f4291de2295e89b8249) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:18.255191 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881745f8-544e-4b3f-863d-ebf8af88387f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:18.256629 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881745f8-544e-4b3f-863d-ebf8af88387f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:18.269842 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 183/378] 10.222.0.33 () {56 vars in 1376 bytes} [Fri Sep 16 03:27:18 2022] GET /identity/v3/role_assignments?group.id=5056d570cd214b52931080e6fe4bc241&scope.project.id=f14af8f557914f4291de2295e89b8249&role.id=fcb362c8a9fd47fbbb6b14397cae171c => generated 260 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:27:18.274605 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0097bce-c76f-4d02-a000-11e9127cc30a None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:18.312775 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0584748-47b7-41cb-bda6-c3d6a81e0bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:18.313591 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0584748-47b7-41cb-bda6-c3d6a81e0bb4 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:18.314033 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0584748-47b7-41cb-bda6-c3d6a81e0bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:18.314409 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0584748-47b7-41cb-bda6-c3d6a81e0bb4 None admin] PATH_INFO: `/v3/groups/70a70317e2d149ff8ed097c1d1c1df61` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:18.320849 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0584748-47b7-41cb-bda6-c3d6a81e0bb4 None admin] RBAC: Authorizing `identity:get_group(group_id=70a70317e2d149ff8ed097c1d1c1df61)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:18.322355 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0584748-47b7-41cb-bda6-c3d6a81e0bb4 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:18.324311 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 196/379] 10.222.0.33 () {56 vars in 1180 bytes} [Fri Sep 16 03:27:18 2022] GET /identity/v3/groups/70a70317e2d149ff8ed097c1d1c1df61 => generated 229 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:27:18.330591 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881745f8-544e-4b3f-863d-ebf8af88387f None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:18.362241 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:18.447122 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881745f8-544e-4b3f-863d-ebf8af88387f None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:18.492991 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd88566-81b5-472d-9f30-904a7ef0bbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:18.493620 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd88566-81b5-472d-9f30-904a7ef0bbde None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:18.493960 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd88566-81b5-472d-9f30-904a7ef0bbde None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:18.494238 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd88566-81b5-472d-9f30-904a7ef0bbde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:18.494999 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd88566-81b5-472d-9f30-904a7ef0bbde None admin] RBAC: Adding query filter params (group.id=70a70317e2d149ff8ed097c1d1c1df61, role.id=4ffac54101e248479bcdc0e54890020f, scope.project.id=4c378d507cbc42e4b80e3f5c14a93477) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:18.495310 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd88566-81b5-472d-9f30-904a7ef0bbde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:18.496793 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd88566-81b5-472d-9f30-904a7ef0bbde None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:18.508134 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 184/380] 10.222.0.33 () {56 vars in 1376 bytes} [Fri Sep 16 03:27:18 2022] GET /identity/v3/role_assignments?group.id=70a70317e2d149ff8ed097c1d1c1df61&scope.project.id=4c378d507cbc42e4b80e3f5c14a93477&role.id=4ffac54101e248479bcdc0e54890020f => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:18.609017 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0f263-9eb2-4b8e-a7ab-c8e112518e86 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:18.609518 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0f263-9eb2-4b8e-a7ab-c8e112518e86 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:18.609518 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0f263-9eb2-4b8e-a7ab-c8e112518e86 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:18.611203 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 197/381] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:18.616476 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e94f9f-0740-4a51-ae81-165169489b3d None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:18.617365 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e94f9f-0740-4a51-ae81-165169489b3d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:18.617684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e94f9f-0740-4a51-ae81-165169489b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:18.646925 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e2e94f9f-0740-4a51-ae81-165169489b3d None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:18.648783 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e2e94f9f-0740-4a51-ae81-165169489b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:18.738776 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 185/382] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:27:19.031315 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0f263-9eb2-4b8e-a7ab-c8e112518e86 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:19.033696 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559f7fd-f9e4-4c87-9966-903469ad3f54 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:19.034196 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559f7fd-f9e4-4c87-9966-903469ad3f54 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:19.034661 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559f7fd-f9e4-4c87-9966-903469ad3f54 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:19.036446 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 186/383] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:19.042499 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916895a-5aca-49cc-a932-bc1a06979e1b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:19.043078 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916895a-5aca-49cc-a932-bc1a06979e1b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:19.043546 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916895a-5aca-49cc-a932-bc1a06979e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:19.062937 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0916895a-5aca-49cc-a932-bc1a06979e1b None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:19.064479 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0916895a-5aca-49cc-a932-bc1a06979e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:19.081619 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:19.147577 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 187/384] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 03:27:19.169993 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0f263-9eb2-4b8e-a7ab-c8e112518e86 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:19.198458 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:19.213871 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51a4fa-ab0f-406f-bba2-e2eeee5cfd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:19.214519 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51a4fa-ab0f-406f-bba2-e2eeee5cfd87 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:19.214833 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51a4fa-ab0f-406f-bba2-e2eeee5cfd87 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:19.215107 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51a4fa-ab0f-406f-bba2-e2eeee5cfd87 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:19.225626 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c51a4fa-ab0f-406f-bba2-e2eeee5cfd87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:19.234730 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-4c51a4fa-ab0f-406f-bba2-e2eeee5cfd87 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 03:27:19.234730 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:19.234730 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:19.234730 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:19.234730 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:19.234730 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:19.234730 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:19.234730 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:19.234730 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:19.234730 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:19.234730 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:19.234730 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:19.234730 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:19.234730 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:19.234730 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:19.234730 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:19.235623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:19.235623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:19.235623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:19.235623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:19.235623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:19.235623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:19.235623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:19.235623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:19.235623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:19.235623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:19.235623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:19.235623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:19.235623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:19.235623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:19.235623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:19.235623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:19.236408 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:19.236408 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:19.236408 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:19.236408 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:19.236408 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:19.236408 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:19.236408 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:19.236408 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:19.236408 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:19.236408 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:19.236408 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 03:27:19.236408 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:19.239133 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 198/385] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:27:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:19.245429 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916895a-5aca-49cc-a932-bc1a06979e1b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:19.386739 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916895a-5aca-49cc-a932-bc1a06979e1b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:19.433308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390b04f-d805-44d8-b645-f9acf75cbd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:19.434221 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390b04f-d805-44d8-b645-f9acf75cbd3c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:19.434668 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390b04f-d805-44d8-b645-f9acf75cbd3c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:19.435075 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390b04f-d805-44d8-b645-f9acf75cbd3c None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:19.435871 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b390b04f-d805-44d8-b645-f9acf75cbd3c None admin] RBAC: Adding query filter params (name=member) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:19.436307 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b390b04f-d805-44d8-b645-f9acf75cbd3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:19.437851 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b390b04f-d805-44d8-b645-f9acf75cbd3c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:19.450038 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 188/386] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 03:27:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:19.455280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51a4fa-ab0f-406f-bba2-e2eeee5cfd87 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:19.518558 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390b04f-d805-44d8-b645-f9acf75cbd3c None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:19.538270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:19.583488 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51a4fa-ab0f-406f-bba2-e2eeee5cfd87 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:19.655003 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d8b31-3559-4d33-966f-42a0cff3af28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:19.655613 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d8b31-3559-4d33-966f-42a0cff3af28 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:19.655866 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d8b31-3559-4d33-966f-42a0cff3af28 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:19.656099 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d8b31-3559-4d33-966f-42a0cff3af28 None admin] PATH_INFO: `/v3/groups/5056d570cd214b52931080e6fe4bc241` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:19.658064 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390b04f-d805-44d8-b645-f9acf75cbd3c None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:19.662383 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d8b31-3559-4d33-966f-42a0cff3af28 None admin] RBAC: Authorizing `identity:get_group(group_id=5056d570cd214b52931080e6fe4bc241)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:19.664391 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d8b31-3559-4d33-966f-42a0cff3af28 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:19.666337 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 199/387] 10.222.0.33 () {56 vars in 1180 bytes} [Fri Sep 16 03:27:19 2022] GET /identity/v3/groups/5056d570cd214b52931080e6fe4bc241 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:19.671469 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d8b31-3559-4d33-966f-42a0cff3af28 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:19.699105 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8b4c3-f213-4346-89cb-fe7cb6f2dcdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:19.700139 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8b4c3-f213-4346-89cb-fe7cb6f2dcdb None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:19.700623 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8b4c3-f213-4346-89cb-fe7cb6f2dcdb None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:19.701112 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8b4c3-f213-4346-89cb-fe7cb6f2dcdb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:19.715388 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de8b4c3-f213-4346-89cb-fe7cb6f2dcdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:19.721369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-8de8b4c3-f213-4346-89cb-fe7cb6f2dcdb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 03:27:19.721369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:19.721369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:19.721369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:19.721369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:19.721369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:19.721369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:19.721369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:19.721369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:19.721369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:19.721369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:19.721369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:19.721369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:19.721369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:19.721369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:19.721369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:19.724501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:19.724501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:19.724501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:19.724501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:19.724501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:19.724501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:19.724501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:19.724501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:19.724501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:19.724501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:19.724501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:19.724501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:19.724501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:19.724501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:19.724501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:19.724501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:19.725319 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:19.725319 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:19.725319 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:19.725319 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:19.725319 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:19.725319 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:19.725319 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:19.725319 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:19.725319 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:19.725319 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:19.725319 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 03:27:19.725319 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:19.728014 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 189/388] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 03:27:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:19.737983 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8b4c3-f213-4346-89cb-fe7cb6f2dcdb None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:19.784030 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:19.815509 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:19.853016 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8b4c3-f213-4346-89cb-fe7cb6f2dcdb None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:19.894886 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7befb1e7-ca8a-45ca-94b6-31f19117cd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:19.895771 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7befb1e7-ca8a-45ca-94b6-31f19117cd46 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:19.896055 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7befb1e7-ca8a-45ca-94b6-31f19117cd46 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:19.896332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7befb1e7-ca8a-45ca-94b6-31f19117cd46 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:19.896995 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7befb1e7-ca8a-45ca-94b6-31f19117cd46 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:19.897303 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7befb1e7-ca8a-45ca-94b6-31f19117cd46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:19.899261 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7befb1e7-ca8a-45ca-94b6-31f19117cd46 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:19.899981 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d8b31-3559-4d33-966f-42a0cff3af28 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:19.913891 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 190/389] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:27:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:19.919488 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7befb1e7-ca8a-45ca-94b6-31f19117cd46 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:19.961116 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92b61a-6de5-4a93-9718-54eeb5fffbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:19.962180 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92b61a-6de5-4a93-9718-54eeb5fffbd0 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:19.962653 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92b61a-6de5-4a93-9718-54eeb5fffbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:19.963115 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92b61a-6de5-4a93-9718-54eeb5fffbd0 None admin] PATH_INFO: `/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:19.965085 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92b61a-6de5-4a93-9718-54eeb5fffbd0 None admin] RBAC: Authorizing `identity:get_project(project_id=e01bdca6ef9f47b192f68f70ff0bbdad)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:19.966812 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92b61a-6de5-4a93-9718-54eeb5fffbd0 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:19.970728 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 200/390] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:27:19 2022] GET /identity/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad => generated 298 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:27:19.976325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92b61a-6de5-4a93-9718-54eeb5fffbd0 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:20.103836 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7befb1e7-ca8a-45ca-94b6-31f19117cd46 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:20.164070 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92b61a-6de5-4a93-9718-54eeb5fffbd0 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:20.168749 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f1380-02be-44f7-81a0-3e5701e8a9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:20.169625 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f1380-02be-44f7-81a0-3e5701e8a9be None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:20.170831 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f1380-02be-44f7-81a0-3e5701e8a9be None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:20.171297 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f1380-02be-44f7-81a0-3e5701e8a9be None admin] PATH_INFO: `/v3/groups/5056d570cd214b52931080e6fe4bc241` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:20.177383 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f1380-02be-44f7-81a0-3e5701e8a9be None admin] RBAC: Authorizing `identity:get_group(group_id=5056d570cd214b52931080e6fe4bc241)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:20.179164 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f1380-02be-44f7-81a0-3e5701e8a9be None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:20.182352 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 191/391] 10.222.0.33 () {56 vars in 1180 bytes} [Fri Sep 16 03:27:19 2022] GET /identity/v3/groups/5056d570cd214b52931080e6fe4bc241 => generated 226 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:27:20.187726 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f1380-02be-44f7-81a0-3e5701e8a9be None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:20.191382 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:20.204578 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:20.239635 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474033b-a32b-46e7-8366-c0bc4cf7e879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:20.240308 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474033b-a32b-46e7-8366-c0bc4cf7e879 None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:20.240585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474033b-a32b-46e7-8366-c0bc4cf7e879 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:20.240853 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474033b-a32b-46e7-8366-c0bc4cf7e879 None admin] PATH_INFO: `/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad/groups/5056d570cd214b52931080e6fe4bc241/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:20.243615 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474033b-a32b-46e7-8366-c0bc4cf7e879 None admin] RBAC: Authorizing `identity:create_grant(project_id=e01bdca6ef9f47b192f68f70ff0bbdad, group_id=5056d570cd214b52931080e6fe4bc241, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:20.245067 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474033b-a32b-46e7-8366-c0bc4cf7e879 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:20.331575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f1380-02be-44f7-81a0-3e5701e8a9be None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:20.337090 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 201/392] 10.222.0.33 () {58 vars in 1442 bytes} [Fri Sep 16 03:27:19 2022] PUT /identity/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad/groups/5056d570cd214b52931080e6fe4bc241/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:27:20.372443 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4b38c-9cff-4f64-931e-2975959119b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:20.373093 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4b38c-9cff-4f64-931e-2975959119b4 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:20.373381 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4b38c-9cff-4f64-931e-2975959119b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:20.373672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4b38c-9cff-4f64-931e-2975959119b4 None admin] PATH_INFO: `/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:20.374817 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca4b38c-9cff-4f64-931e-2975959119b4 None admin] RBAC: Authorizing `identity:get_project(project_id=e01bdca6ef9f47b192f68f70ff0bbdad)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:20.376323 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca4b38c-9cff-4f64-931e-2975959119b4 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:20.378148 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 192/393] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:27:20 2022] GET /identity/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:27:20.384778 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474033b-a32b-46e7-8366-c0bc4cf7e879 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:20.534304 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474033b-a32b-46e7-8366-c0bc4cf7e879 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:20.559169 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58999b-ccf5-4146-97b6-7f371b4afc06 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:20.559684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58999b-ccf5-4146-97b6-7f371b4afc06 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:20.559787 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58999b-ccf5-4146-97b6-7f371b4afc06 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:20.561446 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 193/394] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:20.568335 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6f376-ef52-4af8-8b53-cb2f0a993acb None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:20.568626 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6f376-ef52-4af8-8b53-cb2f0a993acb None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:20.568907 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6f376-ef52-4af8-8b53-cb2f0a993acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:20.576249 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931845a4-7597-4c15-b9e0-6e098fb53a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:20.578380 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931845a4-7597-4c15-b9e0-6e098fb53a6c None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:20.578665 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931845a4-7597-4c15-b9e0-6e098fb53a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:20.578942 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931845a4-7597-4c15-b9e0-6e098fb53a6c None admin] PATH_INFO: `/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad/groups/5056d570cd214b52931080e6fe4bc241/roles/fcb362c8a9fd47fbbb6b14397cae171c` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:20.583216 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931845a4-7597-4c15-b9e0-6e098fb53a6c None admin] RBAC: Authorizing `identity:create_grant(project_id=e01bdca6ef9f47b192f68f70ff0bbdad, group_id=5056d570cd214b52931080e6fe4bc241, role_id=fcb362c8a9fd47fbbb6b14397cae171c)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:20.584672 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931845a4-7597-4c15-b9e0-6e098fb53a6c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:20.598379 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-05d6f376-ef52-4af8-8b53-cb2f0a993acb None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:20.599841 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-05d6f376-ef52-4af8-8b53-cb2f0a993acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:20.666631 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 202/395] 10.222.0.33 () {58 vars in 1442 bytes} [Fri Sep 16 03:27:20 2022] PUT /identity/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad/groups/5056d570cd214b52931080e6fe4bc241/roles/fcb362c8a9fd47fbbb6b14397cae171c => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:27:20.703496 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:20.709478 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 194/396] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:27:21.016850 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931845a4-7597-4c15-b9e0-6e098fb53a6c None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:21.059949 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:21.131081 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931845a4-7597-4c15-b9e0-6e098fb53a6c None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:21.173202 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f51865-9186-48e2-8f42-9850485c57dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:21.173879 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f51865-9186-48e2-8f42-9850485c57dc None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:21.174162 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f51865-9186-48e2-8f42-9850485c57dc None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:21.174437 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f51865-9186-48e2-8f42-9850485c57dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:21.191040 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f51865-9186-48e2-8f42-9850485c57dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:21.196496 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-04f51865-9186-48e2-8f42-9850485c57dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 03:27:21.196496 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:21.196496 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:21.196496 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:21.196496 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:21.196496 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:21.196496 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:21.196496 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:21.196496 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:21.196496 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:21.196496 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:21.196496 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:21.196496 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:21.196496 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:21.196496 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:21.196496 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:21.197358 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:21.197358 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:21.197358 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:21.197358 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:21.197358 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:21.197358 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:21.197358 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:21.197358 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:21.197358 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:21.197358 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:21.197358 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:21.197358 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:21.197358 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:21.197358 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:21.197358 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:21.197358 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:21.198172 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:21.198172 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:21.198172 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:21.198172 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:21.198172 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:21.198172 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:21.198172 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:21.198172 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:21.198172 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:21.198172 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:21.198172 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 03:27:21.198172 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:21.198172 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 203/397] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:27:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:21.203806 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6f376-ef52-4af8-8b53-cb2f0a993acb None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:21.360851 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6f376-ef52-4af8-8b53-cb2f0a993acb None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:21.409172 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72dad9-8485-4fea-9264-33cc0adb9ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:21.409823 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72dad9-8485-4fea-9264-33cc0adb9ba7 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:21.410106 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72dad9-8485-4fea-9264-33cc0adb9ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:21.410379 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72dad9-8485-4fea-9264-33cc0adb9ba7 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:21.411054 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72dad9-8485-4fea-9264-33cc0adb9ba7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:21.411356 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72dad9-8485-4fea-9264-33cc0adb9ba7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:21.412807 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72dad9-8485-4fea-9264-33cc0adb9ba7 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:21.421056 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec713f64-ca93-444b-b57a-62ebe04aa42d None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:21.421340 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec713f64-ca93-444b-b57a-62ebe04aa42d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:21.421615 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec713f64-ca93-444b-b57a-62ebe04aa42d None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:21.423090 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 204/398] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:21.428189 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac7695-f9b5-42ea-8751-8b99e0f59bcd None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:21.428705 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac7695-f9b5-42ea-8751-8b99e0f59bcd None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:21.429164 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac7695-f9b5-42ea-8751-8b99e0f59bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:21.432970 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 195/399] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 03:27:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:21.440914 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72dad9-8485-4fea-9264-33cc0adb9ba7 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:21.461985 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e0ac7695-f9b5-42ea-8751-8b99e0f59bcd None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:21.464629 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e0ac7695-f9b5-42ea-8751-8b99e0f59bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:21.548919 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 205/400] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 03:27:21.550424 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:21.550567 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6bea45-34ab-41e5-99d2-9dce1cdbe6d8 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:21.550978 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6bea45-34ab-41e5-99d2-9dce1cdbe6d8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:21.551518 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6bea45-34ab-41e5-99d2-9dce1cdbe6d8 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:21.552925 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 206/401] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:21.561431 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9dba34-aa89-4545-80e0-07c7c29e9bdd None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:21.565990 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9dba34-aa89-4545-80e0-07c7c29e9bdd None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:21.565990 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9dba34-aa89-4545-80e0-07c7c29e9bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:21.585207 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2d9dba34-aa89-4545-80e0-07c7c29e9bdd None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:21.587642 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2d9dba34-aa89-4545-80e0-07c7c29e9bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:21.604511 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72dad9-8485-4fea-9264-33cc0adb9ba7 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:21.644281 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6a87b-4819-45a8-a92c-aee24a55a6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:21.644845 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6a87b-4819-45a8-a92c-aee24a55a6f3 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:21.645127 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6a87b-4819-45a8-a92c-aee24a55a6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:21.645405 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6a87b-4819-45a8-a92c-aee24a55a6f3 None admin] PATH_INFO: `/v3/groups/5056d570cd214b52931080e6fe4bc241` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:21.647403 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c6a87b-4819-45a8-a92c-aee24a55a6f3 None admin] RBAC: Authorizing `identity:get_group(group_id=5056d570cd214b52931080e6fe4bc241)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:21.649421 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c6a87b-4819-45a8-a92c-aee24a55a6f3 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:21.650009 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:21.651346 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 196/402] 10.222.0.33 () {56 vars in 1180 bytes} [Fri Sep 16 03:27:21 2022] GET /identity/v3/groups/5056d570cd214b52931080e6fe4bc241 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:27:21.657071 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6a87b-4819-45a8-a92c-aee24a55a6f3 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:21.673314 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 207/403] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 03:27:21.806226 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6a87b-4819-45a8-a92c-aee24a55a6f3 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:21.836540 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:21.842577 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85a0a8-d178-46ae-9c12-798986a53848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:21.843216 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85a0a8-d178-46ae-9c12-798986a53848 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:21.843500 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85a0a8-d178-46ae-9c12-798986a53848 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:21.843778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85a0a8-d178-46ae-9c12-798986a53848 None admin] PATH_INFO: `/v3/projects/f14af8f557914f4291de2295e89b8249` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:21.844907 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85a0a8-d178-46ae-9c12-798986a53848 None admin] RBAC: Authorizing `identity:get_project(project_id=f14af8f557914f4291de2295e89b8249)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:21.846373 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85a0a8-d178-46ae-9c12-798986a53848 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:21.848433 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 197/404] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:27:21 2022] GET /identity/v3/projects/f14af8f557914f4291de2295e89b8249 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:21.854377 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9dba34-aa89-4545-80e0-07c7c29e9bdd None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:21.903956 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85a0a8-d178-46ae-9c12-798986a53848 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:22.030027 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85a0a8-d178-46ae-9c12-798986a53848 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:22.032523 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9dba34-aa89-4545-80e0-07c7c29e9bdd None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:22.073327 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f38c30-3608-47c0-8a7c-061645f3d9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:22.074577 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f38c30-3608-47c0-8a7c-061645f3d9e9 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:22.075541 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f38c30-3608-47c0-8a7c-061645f3d9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:22.076281 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f38c30-3608-47c0-8a7c-061645f3d9e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:22.087251 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d4dd2-63bf-4255-a2c4-2c180807ec6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:22.087914 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d4dd2-63bf-4255-a2c4-2c180807ec6c None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:22.088198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d4dd2-63bf-4255-a2c4-2c180807ec6c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:22.088469 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d4dd2-63bf-4255-a2c4-2c180807ec6c None admin] PATH_INFO: `/v3/projects/f14af8f557914f4291de2295e89b8249/groups/5056d570cd214b52931080e6fe4bc241/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:22.090395 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d4dd2-63bf-4255-a2c4-2c180807ec6c None admin] RBAC: Authorizing `identity:create_grant(project_id=f14af8f557914f4291de2295e89b8249, group_id=5056d570cd214b52931080e6fe4bc241, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:22.091694 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f38c30-3608-47c0-8a7c-061645f3d9e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:22.091855 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d4dd2-63bf-4255-a2c4-2c180807ec6c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:22.099220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-c2f38c30-3608-47c0-8a7c-061645f3d9e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:27:22.099220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:22.099220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:22.099220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:22.099220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:22.099220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:22.099220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:22.099220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:22.099220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:22.099220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:22.099220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:22.099220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:22.099220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:22.099220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:22.099220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:22.099220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:22.105308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:22.105308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:22.105308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:22.105308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:22.105308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:22.105308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:22.105308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:22.105308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:22.105308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:22.105308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:22.105308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:22.105308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:22.105308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:22.105308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:22.105308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:22.105308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:22.106146 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:22.106146 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:22.106146 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:22.106146 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:22.106146 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:22.106146 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:22.106146 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:22.106146 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:22.106146 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:22.106146 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:22.106146 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:27:22.106146 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:22.106146 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 198/405] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 03:27:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:27:22.106146 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f38c30-3608-47c0-8a7c-061645f3d9e9 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:22.171662 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:22.207551 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 208/406] 10.222.0.33 () {58 vars in 1442 bytes} [Fri Sep 16 03:27:21 2022] PUT /identity/v3/projects/f14af8f557914f4291de2295e89b8249/groups/5056d570cd214b52931080e6fe4bc241/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:27:22.208879 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d4dd2-63bf-4255-a2c4-2c180807ec6c None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:22.243865 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f38c30-3608-47c0-8a7c-061645f3d9e9 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:22.256863 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:22.319601 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e8398-5625-4233-8037-4ab1c2895b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:22.321175 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e8398-5625-4233-8037-4ab1c2895b64 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:22.321459 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e8398-5625-4233-8037-4ab1c2895b64 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:22.323908 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e8398-5625-4233-8037-4ab1c2895b64 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:22.347114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e8398-5625-4233-8037-4ab1c2895b64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:22.354139 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-9d6e8398-5625-4233-8037-4ab1c2895b64 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 03:27:22.354139 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:22.354139 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:22.354139 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:22.354139 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:22.354139 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:22.354139 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:22.354139 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:22.354139 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:22.354139 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:22.354139 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:22.354139 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:22.354139 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:22.354139 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:22.354139 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:22.354139 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:22.355123 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:22.355123 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:22.355123 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:22.355123 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:22.355123 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:22.355123 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:22.355123 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:22.355123 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:22.355123 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:22.355123 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:22.355123 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:22.355123 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:22.355123 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:22.355123 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:22.355123 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:22.355123 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:22.355945 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:22.355945 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:22.355945 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:22.355945 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:22.355945 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:22.355945 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:22.355945 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:22.355945 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:22.355945 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:22.355945 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:22.355945 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 03:27:22.355945 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:22.355945 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 199/407] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 03:27:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:22.363204 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e8398-5625-4233-8037-4ab1c2895b64 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:22.439117 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d4dd2-63bf-4255-a2c4-2c180807ec6c None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:22.497422 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db851fc7-6412-4500-91fc-e434d8b8986b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:22.498431 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db851fc7-6412-4500-91fc-e434d8b8986b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:22.498995 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db851fc7-6412-4500-91fc-e434d8b8986b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:22.499469 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db851fc7-6412-4500-91fc-e434d8b8986b None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:22.499939 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e8398-5625-4233-8037-4ab1c2895b64 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:22.500631 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db851fc7-6412-4500-91fc-e434d8b8986b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:22.501153 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db851fc7-6412-4500-91fc-e434d8b8986b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:22.503281 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db851fc7-6412-4500-91fc-e434d8b8986b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:22.512910 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 209/408] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:27:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:22.522526 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:22.523848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db851fc7-6412-4500-91fc-e434d8b8986b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:22.548946 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7dd0e8-5fd4-4e5d-98d3-80bada3fbd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:22.549614 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7dd0e8-5fd4-4e5d-98d3-80bada3fbd1a None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:22.550141 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7dd0e8-5fd4-4e5d-98d3-80bada3fbd1a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:22.550415 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7dd0e8-5fd4-4e5d-98d3-80bada3fbd1a None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:22.551087 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7dd0e8-5fd4-4e5d-98d3-80bada3fbd1a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:22.551391 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7dd0e8-5fd4-4e5d-98d3-80bada3fbd1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:22.552777 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7dd0e8-5fd4-4e5d-98d3-80bada3fbd1a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:22.572023 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 200/409] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:27:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:22.577784 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7dd0e8-5fd4-4e5d-98d3-80bada3fbd1a None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:22.683508 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:22.729401 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db851fc7-6412-4500-91fc-e434d8b8986b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:22.768773 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7dd0e8-5fd4-4e5d-98d3-80bada3fbd1a None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:22.803252 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60607efa-dd50-4a24-b786-c1305aff0049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:22.803908 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60607efa-dd50-4a24-b786-c1305aff0049 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:22.804217 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60607efa-dd50-4a24-b786-c1305aff0049 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:22.804530 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60607efa-dd50-4a24-b786-c1305aff0049 None admin] PATH_INFO: `/v3/groups/70a70317e2d149ff8ed097c1d1c1df61` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:22.805690 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60607efa-dd50-4a24-b786-c1305aff0049 None admin] RBAC: Authorizing `identity:get_group(group_id=70a70317e2d149ff8ed097c1d1c1df61)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:22.807131 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60607efa-dd50-4a24-b786-c1305aff0049 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:22.808852 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 210/410] 10.222.0.33 () {56 vars in 1180 bytes} [Fri Sep 16 03:27:22 2022] GET /identity/v3/groups/70a70317e2d149ff8ed097c1d1c1df61 => generated 229 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:22.817410 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60607efa-dd50-4a24-b786-c1305aff0049 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:22.817962 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5fb2e-8f61-4f31-ac99-c9421f73ab86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:22.818603 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5fb2e-8f61-4f31-ac99-c9421f73ab86 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:22.818884 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5fb2e-8f61-4f31-ac99-c9421f73ab86 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:22.819158 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5fb2e-8f61-4f31-ac99-c9421f73ab86 None admin] PATH_INFO: `/v3/groups/5056d570cd214b52931080e6fe4bc241` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:22.822716 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5fb2e-8f61-4f31-ac99-c9421f73ab86 None admin] RBAC: Authorizing `identity:get_group(group_id=5056d570cd214b52931080e6fe4bc241)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:22.824270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5fb2e-8f61-4f31-ac99-c9421f73ab86 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:22.829179 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 201/411] 10.222.0.33 () {56 vars in 1180 bytes} [Fri Sep 16 03:27:22 2022] GET /identity/v3/groups/5056d570cd214b52931080e6fe4bc241 => generated 226 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:22.832115 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5fb2e-8f61-4f31-ac99-c9421f73ab86 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:22.926110 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:22.981166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5fb2e-8f61-4f31-ac99-c9421f73ab86 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:23.016607 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60607efa-dd50-4a24-b786-c1305aff0049 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:23.046944 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e537a9-8412-442c-94e3-e1059ef251e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:23.047577 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e537a9-8412-442c-94e3-e1059ef251e1 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:23.047855 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e537a9-8412-442c-94e3-e1059ef251e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:23.048121 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e537a9-8412-442c-94e3-e1059ef251e1 None admin] PATH_INFO: `/v3/projects/f14af8f557914f4291de2295e89b8249` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:23.049386 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e537a9-8412-442c-94e3-e1059ef251e1 None admin] RBAC: Authorizing `identity:get_project(project_id=f14af8f557914f4291de2295e89b8249)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:23.050830 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e537a9-8412-442c-94e3-e1059ef251e1 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:23.052865 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 202/412] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:27:22 2022] GET /identity/v3/projects/f14af8f557914f4291de2295e89b8249 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:27:23.058699 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e537a9-8412-442c-94e3-e1059ef251e1 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:23.082368 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a9eb6-625c-45c0-9cd0-3291ce45f446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:23.083442 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a9eb6-625c-45c0-9cd0-3291ce45f446 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:23.083925 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a9eb6-625c-45c0-9cd0-3291ce45f446 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:23.084408 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a9eb6-625c-45c0-9cd0-3291ce45f446 None admin] PATH_INFO: `/v3/projects/4c378d507cbc42e4b80e3f5c14a93477` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:23.085798 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a9eb6-625c-45c0-9cd0-3291ce45f446 None admin] RBAC: Authorizing `identity:get_project(project_id=4c378d507cbc42e4b80e3f5c14a93477)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:23.087587 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a9eb6-625c-45c0-9cd0-3291ce45f446 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:23.090391 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 211/413] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:27:22 2022] GET /identity/v3/projects/4c378d507cbc42e4b80e3f5c14a93477 => generated 344 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:23.091621 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c3830-5028-49da-82be-1af0b5519889 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:23.092040 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c3830-5028-49da-82be-1af0b5519889 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:23.092470 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c3830-5028-49da-82be-1af0b5519889 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:23.094193 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 212/414] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:23.096247 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c3830-5028-49da-82be-1af0b5519889 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:23.115851 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:23.189111 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e537a9-8412-442c-94e3-e1059ef251e1 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:23.214051 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:23.228569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c3830-5028-49da-82be-1af0b5519889 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:23.237841 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0e82c-d8db-4444-b255-0dca12096f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:23.239184 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0e82c-d8db-4444-b255-0dca12096f8b None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:23.239626 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0e82c-d8db-4444-b255-0dca12096f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:23.240042 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0e82c-d8db-4444-b255-0dca12096f8b None admin] PATH_INFO: `/v3/projects/f14af8f557914f4291de2295e89b8249/groups/5056d570cd214b52931080e6fe4bc241/roles/fcb362c8a9fd47fbbb6b14397cae171c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:23.243581 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0e82c-d8db-4444-b255-0dca12096f8b None admin] RBAC: Authorizing `identity:create_grant(project_id=f14af8f557914f4291de2295e89b8249, group_id=5056d570cd214b52931080e6fe4bc241, role_id=fcb362c8a9fd47fbbb6b14397cae171c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:23.245422 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0e82c-d8db-4444-b255-0dca12096f8b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:23.268705 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c8e85-4dac-4de4-8ef0-2ddb2a9bc3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:23.269503 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c8e85-4dac-4de4-8ef0-2ddb2a9bc3af None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:23.269880 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c8e85-4dac-4de4-8ef0-2ddb2a9bc3af None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:23.270288 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c8e85-4dac-4de4-8ef0-2ddb2a9bc3af None admin] PATH_INFO: `/v3/projects/4c378d507cbc42e4b80e3f5c14a93477/groups/70a70317e2d149ff8ed097c1d1c1df61/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:23.272618 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c8e85-4dac-4de4-8ef0-2ddb2a9bc3af None admin] RBAC: Authorizing `identity:create_grant(project_id=4c378d507cbc42e4b80e3f5c14a93477, group_id=70a70317e2d149ff8ed097c1d1c1df61, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:23.274905 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c8e85-4dac-4de4-8ef0-2ddb2a9bc3af None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:23.314064 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 203/415] 10.222.0.33 () {58 vars in 1442 bytes} [Fri Sep 16 03:27:23 2022] PUT /identity/v3/projects/f14af8f557914f4291de2295e89b8249/groups/5056d570cd214b52931080e6fe4bc241/roles/fcb362c8a9fd47fbbb6b14397cae171c => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:27:23.315334 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469cee3f-c71a-4a1e-9726-cc894ca713c0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:23.315605 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469cee3f-c71a-4a1e-9726-cc894ca713c0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:23.315880 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469cee3f-c71a-4a1e-9726-cc894ca713c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:23.340820 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-469cee3f-c71a-4a1e-9726-cc894ca713c0 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:23.342251 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-469cee3f-c71a-4a1e-9726-cc894ca713c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:23.352825 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 213/416] 10.222.0.33 () {58 vars in 1442 bytes} [Fri Sep 16 03:27:23 2022] PUT /identity/v3/projects/4c378d507cbc42e4b80e3f5c14a93477/groups/70a70317e2d149ff8ed097c1d1c1df61/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:27:23.433669 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 204/417] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:27:23.599519 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88eeec5-56c7-4fdd-a951-f4ca9c3818af None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:23.599874 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88eeec5-56c7-4fdd-a951-f4ca9c3818af None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:23.600125 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88eeec5-56c7-4fdd-a951-f4ca9c3818af None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:23.602520 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 214/418] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 03:27:23.610616 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89132e8a-e3f8-41e3-b9a3-7763aca489e6 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:23.610923 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89132e8a-e3f8-41e3-b9a3-7763aca489e6 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:23.611178 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89132e8a-e3f8-41e3-b9a3-7763aca489e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:23.632044 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-89132e8a-e3f8-41e3-b9a3-7763aca489e6 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:23.633816 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-89132e8a-e3f8-41e3-b9a3-7763aca489e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:23.706626 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 205/419] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:27:23.743486 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88eeec5-56c7-4fdd-a951-f4ca9c3818af None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:23.823877 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:23.857461 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88eeec5-56c7-4fdd-a951-f4ca9c3818af None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:23.897428 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe9a2e-eb18-4b47-95a5-3ffda3094022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:23.898196 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe9a2e-eb18-4b47-95a5-3ffda3094022 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:23.898480 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe9a2e-eb18-4b47-95a5-3ffda3094022 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:23.898760 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe9a2e-eb18-4b47-95a5-3ffda3094022 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:23.915787 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe9a2e-eb18-4b47-95a5-3ffda3094022 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:23.920797 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-42fe9a2e-eb18-4b47-95a5-3ffda3094022 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 03:27:23.920797 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:23.920797 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:23.920797 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:23.920797 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:23.920797 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:23.920797 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:23.920797 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:23.920797 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:23.920797 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:23.920797 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:23.920797 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:23.920797 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:23.920797 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:23.920797 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:23.920797 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:23.921670 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:23.921670 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:23.921670 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:23.921670 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:23.921670 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:23.921670 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:23.921670 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:23.921670 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:23.921670 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:23.921670 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:23.921670 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:23.921670 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:23.921670 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:23.921670 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:23.921670 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:23.921670 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:23.922472 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:23.922472 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:23.922472 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:23.922472 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:23.922472 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:23.922472 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:23.922472 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:23.922472 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:23.922472 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:23.922472 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:23.922472 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 03:27:23.922472 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:23.922472 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 215/420] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:27:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:23.928054 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89132e8a-e3f8-41e3-b9a3-7763aca489e6 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:23.982040 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:23.986566 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe9a2e-eb18-4b47-95a5-3ffda3094022 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:24.089843 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89132e8a-e3f8-41e3-b9a3-7763aca489e6 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:24.128508 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe9a2e-eb18-4b47-95a5-3ffda3094022 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:24.148821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c30362-998c-48dc-9c16-f6ae6cececab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:24.150565 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c30362-998c-48dc-9c16-f6ae6cececab None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:24.150765 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c30362-998c-48dc-9c16-f6ae6cececab None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:24.151011 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c30362-998c-48dc-9c16-f6ae6cececab None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:24.151693 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c30362-998c-48dc-9c16-f6ae6cececab None admin] RBAC: Adding query filter params (name=member) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:24.152001 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c30362-998c-48dc-9c16-f6ae6cececab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:24.153388 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c30362-998c-48dc-9c16-f6ae6cececab None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:24.162291 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 206/421] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 03:27:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:24.167907 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c30362-998c-48dc-9c16-f6ae6cececab None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:24.178052 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb04b2-c5ca-421d-afe4-87a466d59fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:24.178984 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb04b2-c5ca-421d-afe4-87a466d59fda None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:24.179512 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb04b2-c5ca-421d-afe4-87a466d59fda None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:24.179978 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb04b2-c5ca-421d-afe4-87a466d59fda None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:24.190494 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb04b2-c5ca-421d-afe4-87a466d59fda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:24.196073 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-f2cb04b2-c5ca-421d-afe4-87a466d59fda None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 03:27:24.196073 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:24.196073 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:24.196073 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:24.196073 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:24.196073 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:24.196073 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:24.196073 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:24.196073 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:24.196073 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:24.196073 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:24.196073 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:24.196073 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:24.196073 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:24.196073 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:24.196073 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:24.196932 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:24.196932 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:24.196932 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:24.196932 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:24.196932 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:24.196932 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:24.196932 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:24.196932 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:24.196932 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:24.196932 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:24.196932 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:24.196932 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:24.196932 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:24.196932 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:24.196932 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:24.196932 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:24.197741 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:24.197741 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:24.197741 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:24.197741 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:24.197741 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:24.197741 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:24.197741 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:24.197741 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:24.197741 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:24.197741 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:24.197741 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 03:27:24.197741 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:24.200218 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 216/422] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 03:27:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:24.201815 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:24.206029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb04b2-c5ca-421d-afe4-87a466d59fda None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:24.388378 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:24.396068 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c30362-998c-48dc-9c16-f6ae6cececab None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:24.419021 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb04b2-c5ca-421d-afe4-87a466d59fda None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:24.456635 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc029356-8ab3-4987-a1d0-f9a68fd5c504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:24.457251 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc029356-8ab3-4987-a1d0-f9a68fd5c504 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:24.457531 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc029356-8ab3-4987-a1d0-f9a68fd5c504 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:24.457832 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc029356-8ab3-4987-a1d0-f9a68fd5c504 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:24.483653 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a1810-3e59-4425-8261-cdf01104c0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:24.484268 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a1810-3e59-4425-8261-cdf01104c0d7 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:24.484549 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a1810-3e59-4425-8261-cdf01104c0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:24.484886 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a1810-3e59-4425-8261-cdf01104c0d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:24.485559 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a1810-3e59-4425-8261-cdf01104c0d7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:24.485890 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a1810-3e59-4425-8261-cdf01104c0d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:24.487269 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a1810-3e59-4425-8261-cdf01104c0d7 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:24.506167 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 217/423] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:27:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:24.512712 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a1810-3e59-4425-8261-cdf01104c0d7 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:24.589910 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:24.599729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc029356-8ab3-4987-a1d0-f9a68fd5c504 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:24.601279 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc029356-8ab3-4987-a1d0-f9a68fd5c504 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:24.658515 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a1810-3e59-4425-8261-cdf01104c0d7 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:24.710992 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671b3a4-fc66-4deb-b5a1-758cffa61b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:24.711675 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671b3a4-fc66-4deb-b5a1-758cffa61b78 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:24.711963 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671b3a4-fc66-4deb-b5a1-758cffa61b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:24.712291 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671b3a4-fc66-4deb-b5a1-758cffa61b78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:24.799858 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:24.808905 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 207/424] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:27:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 16 03:27:24.814599 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc029356-8ab3-4987-a1d0-f9a68fd5c504 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:24.837546 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2671b3a4-fc66-4deb-b5a1-758cffa61b78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:24.839072 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2671b3a4-fc66-4deb-b5a1-758cffa61b78 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:24.943771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:24.980797 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc029356-8ab3-4987-a1d0-f9a68fd5c504 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:25.001729 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 218/425] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:27:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 03:27:25.003059 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9b2b6-76da-46d1-99e9-845d2df38cb2 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:25.003347 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9b2b6-76da-46d1-99e9-845d2df38cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:25.003624 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9b2b6-76da-46d1-99e9-845d2df38cb2 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:25.005926 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 219/426] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:25.006736 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9b2b6-76da-46d1-99e9-845d2df38cb2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:25.032950 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79878731-2fb4-476c-abac-ae1b07c8f9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:25.033587 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79878731-2fb4-476c-abac-ae1b07c8f9c9 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:25.033902 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79878731-2fb4-476c-abac-ae1b07c8f9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:25.034184 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79878731-2fb4-476c-abac-ae1b07c8f9c9 None admin] PATH_INFO: `/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:25.036077 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79878731-2fb4-476c-abac-ae1b07c8f9c9 None admin] RBAC: Authorizing `identity:get_project(project_id=e01bdca6ef9f47b192f68f70ff0bbdad)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:25.037756 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79878731-2fb4-476c-abac-ae1b07c8f9c9 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:25.040952 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 208/427] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:27:24 2022] GET /identity/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:27:25.042129 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a9ee5-785c-4ce3-83d8-9fc6f7358f8b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:25.042412 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a9ee5-785c-4ce3-83d8-9fc6f7358f8b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:25.042688 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a9ee5-785c-4ce3-83d8-9fc6f7358f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:25.063709 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-786a9ee5-785c-4ce3-83d8-9fc6f7358f8b None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:25.065287 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-786a9ee5-785c-4ce3-83d8-9fc6f7358f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:25.130422 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:25.141743 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 209/428] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:27:25.142769 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a9ee5-785c-4ce3-83d8-9fc6f7358f8b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:25.156459 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9b2b6-76da-46d1-99e9-845d2df38cb2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:25.225317 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd57915-e392-4da6-b017-d9c2fe894d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:25.226518 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd57915-e392-4da6-b017-d9c2fe894d30 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:25.226998 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd57915-e392-4da6-b017-d9c2fe894d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:25.227465 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd57915-e392-4da6-b017-d9c2fe894d30 None admin] PATH_INFO: `/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:25.229962 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd57915-e392-4da6-b017-d9c2fe894d30 None admin] RBAC: Authorizing `identity:get_project(project_id=e01bdca6ef9f47b192f68f70ff0bbdad)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:25.233091 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd57915-e392-4da6-b017-d9c2fe894d30 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:25.242415 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 220/429] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:27:25 2022] GET /identity/v3/projects/e01bdca6ef9f47b192f68f70ff0bbdad => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:25.254786 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd57915-e392-4da6-b017-d9c2fe894d30 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:25.286984 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:25.316780 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a9ee5-785c-4ce3-83d8-9fc6f7358f8b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:25.363229 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51e39d-3e60-4cf7-8f03-2e606556ff94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:25.364201 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd57915-e392-4da6-b017-d9c2fe894d30 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:25.364486 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51e39d-3e60-4cf7-8f03-2e606556ff94 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:25.364980 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51e39d-3e60-4cf7-8f03-2e606556ff94 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:25.365447 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51e39d-3e60-4cf7-8f03-2e606556ff94 None admin] PATH_INFO: `/v3/groups/5056d570cd214b52931080e6fe4bc241` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:25.367342 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51e39d-3e60-4cf7-8f03-2e606556ff94 None admin] RBAC: Authorizing `identity:get_group(group_id=5056d570cd214b52931080e6fe4bc241)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:25.368985 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51e39d-3e60-4cf7-8f03-2e606556ff94 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:25.370816 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 210/430] 10.222.0.33 () {56 vars in 1180 bytes} [Fri Sep 16 03:27:25 2022] GET /identity/v3/groups/5056d570cd214b52931080e6fe4bc241 => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:25.382913 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51e39d-3e60-4cf7-8f03-2e606556ff94 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:25.402041 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df38e4-0bb7-4cbe-a1dd-a2f75c178038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:25.402683 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df38e4-0bb7-4cbe-a1dd-a2f75c178038 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:25.402963 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df38e4-0bb7-4cbe-a1dd-a2f75c178038 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:25.403238 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df38e4-0bb7-4cbe-a1dd-a2f75c178038 None admin] PATH_INFO: `/v3/groups/5056d570cd214b52931080e6fe4bc241` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:25.406415 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df38e4-0bb7-4cbe-a1dd-a2f75c178038 None admin] RBAC: Authorizing `identity:get_group(group_id=5056d570cd214b52931080e6fe4bc241)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:25.409541 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df38e4-0bb7-4cbe-a1dd-a2f75c178038 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:25.414586 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 221/431] 10.222.0.33 () {56 vars in 1180 bytes} [Fri Sep 16 03:27:25 2022] GET /identity/v3/groups/5056d570cd214b52931080e6fe4bc241 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:25.419663 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df38e4-0bb7-4cbe-a1dd-a2f75c178038 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:25.519811 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:25.524357 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:25.533202 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df38e4-0bb7-4cbe-a1dd-a2f75c178038 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:25.564790 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51e39d-3e60-4cf7-8f03-2e606556ff94 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:25.568809 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a102fa-57b9-4015-974a-8da44794f912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:25.569537 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a102fa-57b9-4015-974a-8da44794f912 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:25.570399 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a102fa-57b9-4015-974a-8da44794f912 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:25.570680 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a102fa-57b9-4015-974a-8da44794f912 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:25.571414 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a102fa-57b9-4015-974a-8da44794f912 None admin] RBAC: Adding query filter params (group.id=5056d570cd214b52931080e6fe4bc241, role.id=fcb362c8a9fd47fbbb6b14397cae171c, scope.project.id=e01bdca6ef9f47b192f68f70ff0bbdad) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:25.571725 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a102fa-57b9-4015-974a-8da44794f912 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:25.573428 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a102fa-57b9-4015-974a-8da44794f912 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:25.585838 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 222/432] 10.222.0.33 () {56 vars in 1376 bytes} [Fri Sep 16 03:27:25 2022] GET /identity/v3/role_assignments?group.id=5056d570cd214b52931080e6fe4bc241&scope.project.id=e01bdca6ef9f47b192f68f70ff0bbdad&role.id=fcb362c8a9fd47fbbb6b14397cae171c => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:25.585838 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a102fa-57b9-4015-974a-8da44794f912 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:25.635151 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac903c-667e-48c3-85eb-fb68761d7628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:25.636013 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac903c-667e-48c3-85eb-fb68761d7628 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:25.637197 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac903c-667e-48c3-85eb-fb68761d7628 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:25.637619 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac903c-667e-48c3-85eb-fb68761d7628 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:25.639259 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac903c-667e-48c3-85eb-fb68761d7628 None admin] RBAC: Adding query filter params (group.id=5056d570cd214b52931080e6fe4bc241, role.id=7591562cf9564b288c108609d8e334b3, scope.project.id=e01bdca6ef9f47b192f68f70ff0bbdad) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:25.640763 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac903c-667e-48c3-85eb-fb68761d7628 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:25.642992 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac903c-667e-48c3-85eb-fb68761d7628 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:25.659324 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 211/433] 10.222.0.33 () {56 vars in 1376 bytes} [Fri Sep 16 03:27:25 2022] GET /identity/v3/role_assignments?group.id=5056d570cd214b52931080e6fe4bc241&scope.project.id=e01bdca6ef9f47b192f68f70ff0bbdad&role.id=7591562cf9564b288c108609d8e334b3 => generated 611 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:27:25.764828 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a102fa-57b9-4015-974a-8da44794f912 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:25.817531 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff22e7-93e9-4f83-a2e7-c407119a03f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:25.818145 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff22e7-93e9-4f83-a2e7-c407119a03f9 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:25.818428 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff22e7-93e9-4f83-a2e7-c407119a03f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:25.818704 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff22e7-93e9-4f83-a2e7-c407119a03f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:25.838808 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff22e7-93e9-4f83-a2e7-c407119a03f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:25.843887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-34ff22e7-93e9-4f83-a2e7-c407119a03f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 03:27:25.843887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:25.843887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:25.843887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:25.843887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:25.843887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:25.843887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:25.843887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:25.843887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:25.843887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:25.843887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:25.843887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:25.843887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:25.843887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:25.843887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:25.843887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:25.844870 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:25.844870 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:25.844870 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:25.844870 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:25.844870 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:25.844870 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:25.844870 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:25.844870 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:25.844870 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:25.844870 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:25.844870 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:25.844870 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:25.844870 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:25.844870 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:25.844870 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:25.844870 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:25.846095 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:25.846095 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:25.846095 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:25.846095 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:25.846095 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:25.846095 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:25.846095 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:25.846095 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:25.846095 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:25.846095 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:25.846095 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 03:27:25.846095 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:25.849809 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 223/434] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:27:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:25.852417 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac903c-667e-48c3-85eb-fb68761d7628 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:25.930343 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9e826-77dd-4d8e-84fc-a207b2619f94 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:25.934480 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9e826-77dd-4d8e-84fc-a207b2619f94 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:25.934480 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9e826-77dd-4d8e-84fc-a207b2619f94 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:25.934480 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 224/435] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 03:27:25.939040 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de7e80-43c9-4c3b-a0c9-080b985e5a70 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:25.939323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de7e80-43c9-4c3b-a0c9-080b985e5a70 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:25.939602 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de7e80-43c9-4c3b-a0c9-080b985e5a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:25.965937 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-48de7e80-43c9-4c3b-a0c9-080b985e5a70 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:25.967378 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-48de7e80-43c9-4c3b-a0c9-080b985e5a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:25.973113 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac903c-667e-48c3-85eb-fb68761d7628 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:25.984153 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:26.001760 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:26.010391 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077581b-ba8e-4863-bfe1-c7ecdbdc6490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:26.010982 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077581b-ba8e-4863-bfe1-c7ecdbdc6490 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:26.011263 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077581b-ba8e-4863-bfe1-c7ecdbdc6490 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:26.011535 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077581b-ba8e-4863-bfe1-c7ecdbdc6490 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:26.012201 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b077581b-ba8e-4863-bfe1-c7ecdbdc6490 None admin] RBAC: Adding query filter params (name=member) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:26.012521 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b077581b-ba8e-4863-bfe1-c7ecdbdc6490 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:26.013899 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b077581b-ba8e-4863-bfe1-c7ecdbdc6490 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:26.025398 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 212/436] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 03:27:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:26.025573 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9f9cc-abf7-4e65-98d4-20b89c8589f2 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:26.026361 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9f9cc-abf7-4e65-98d4-20b89c8589f2 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:26.026361 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9f9cc-abf7-4e65-98d4-20b89c8589f2 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:26.027413 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 213/437] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:26.033113 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917d973-0c4d-4942-b70b-765d06dd8df0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:26.033465 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917d973-0c4d-4942-b70b-765d06dd8df0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:26.033933 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917d973-0c4d-4942-b70b-765d06dd8df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:26.051959 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8917d973-0c4d-4942-b70b-765d06dd8df0 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:26.053139 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8917d973-0c4d-4942-b70b-765d06dd8df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:26.055463 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 225/438] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:27:26.056208 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de7e80-43c9-4c3b-a0c9-080b985e5a70 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:26.155294 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 214/439] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 03:27:26.184981 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de7e80-43c9-4c3b-a0c9-080b985e5a70 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:26.222140 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5995ea2-3701-4a8f-a1bf-583e2dd6c698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:26.222757 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5995ea2-3701-4a8f-a1bf-583e2dd6c698 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:26.223038 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5995ea2-3701-4a8f-a1bf-583e2dd6c698 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:26.223308 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5995ea2-3701-4a8f-a1bf-583e2dd6c698 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:26.238896 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:26.293207 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5995ea2-3701-4a8f-a1bf-583e2dd6c698 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:26.294767 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5995ea2-3701-4a8f-a1bf-583e2dd6c698 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:26.324022 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917d973-0c4d-4942-b70b-765d06dd8df0 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:26.404476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 226/440] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:27:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 03:27:26.409836 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5995ea2-3701-4a8f-a1bf-583e2dd6c698 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:26.451480 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917d973-0c4d-4942-b70b-765d06dd8df0 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:26.463158 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:26.476777 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:26.491599 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4d8ef-4cc2-4849-b824-ea6b719fa1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:26.492228 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4d8ef-4cc2-4849-b824-ea6b719fa1eb None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:26.492507 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4d8ef-4cc2-4849-b824-ea6b719fa1eb None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:26.492780 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4d8ef-4cc2-4849-b824-ea6b719fa1eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:26.502503 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a4d8ef-4cc2-4849-b824-ea6b719fa1eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:26.507831 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-45a4d8ef-4cc2-4849-b824-ea6b719fa1eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:27:26.507831 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:26.507831 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:26.507831 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:26.507831 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:26.507831 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:26.507831 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:26.507831 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:26.507831 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:26.507831 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:26.507831 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:26.507831 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:26.507831 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:26.507831 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:26.507831 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:26.507831 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:26.508726 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:26.508726 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:26.508726 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:26.508726 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:26.508726 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:26.508726 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:26.508726 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:26.508726 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:26.508726 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:26.508726 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:26.508726 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:26.508726 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:26.508726 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:26.508726 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:26.508726 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:26.508726 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:26.510544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:26.510544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:26.510544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:26.510544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:26.510544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:26.510544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:26.510544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:26.510544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:26.510544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:26.510544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:26.510544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:27:26.510544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:26.510544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 215/441] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 03:27:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:27:26.510544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4d8ef-4cc2-4849-b824-ea6b719fa1eb None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:26.521156 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5995ea2-3701-4a8f-a1bf-583e2dd6c698 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:26.557720 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64354240-dc16-4cea-a521-e207f68bc837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:26.558354 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64354240-dc16-4cea-a521-e207f68bc837 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:26.558636 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64354240-dc16-4cea-a521-e207f68bc837 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:26.558913 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64354240-dc16-4cea-a521-e207f68bc837 None admin] PATH_INFO: `/v3/projects/f14af8f557914f4291de2295e89b8249` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:26.560031 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64354240-dc16-4cea-a521-e207f68bc837 None admin] RBAC: Authorizing `identity:get_project(project_id=f14af8f557914f4291de2295e89b8249)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:26.561465 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64354240-dc16-4cea-a521-e207f68bc837 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:26.563248 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 227/442] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:27:26 2022] GET /identity/v3/projects/f14af8f557914f4291de2295e89b8249 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:26.563840 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64354240-dc16-4cea-a521-e207f68bc837 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:26.610418 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4d8ef-4cc2-4849-b824-ea6b719fa1eb None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:26.643218 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512e064-d52b-416c-96c9-5a5614076b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:26.643833 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512e064-d52b-416c-96c9-5a5614076b4c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:26.644108 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512e064-d52b-416c-96c9-5a5614076b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:26.644378 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512e064-d52b-416c-96c9-5a5614076b4c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:26.654340 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3512e064-d52b-416c-96c9-5a5614076b4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:26.659105 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-3512e064-d52b-416c-96c9-5a5614076b4c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 03:27:26.659105 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:26.659105 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:26.659105 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:26.659105 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:26.659105 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:26.659105 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:26.659105 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:26.659105 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:26.659105 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:26.659105 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:26.659105 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:26.659105 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:26.659105 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:26.659105 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:26.659105 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:26.660037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:26.660037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:26.660037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:26.660037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:26.660037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:26.660037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:26.660037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:26.660037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:26.660037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:26.660037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:26.660037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:26.660037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:26.660037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:26.660037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:26.660037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:26.660037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:26.660900 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:26.660900 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:26.660900 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:26.660900 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:26.660900 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:26.660900 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:26.660900 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:26.660900 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:26.660900 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:26.660900 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:26.660900 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 03:27:26.660900 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:26.660900 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 216/443] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 03:27:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:26.661563 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512e064-d52b-416c-96c9-5a5614076b4c None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:26.667835 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64354240-dc16-4cea-a521-e207f68bc837 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:26.681297 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:26.701198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e781621-62d5-40a5-a4d5-b95f04376bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:26.702562 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e781621-62d5-40a5-a4d5-b95f04376bdb None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:26.702845 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e781621-62d5-40a5-a4d5-b95f04376bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:26.703121 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e781621-62d5-40a5-a4d5-b95f04376bdb None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:26.703784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e781621-62d5-40a5-a4d5-b95f04376bdb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:26.704089 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e781621-62d5-40a5-a4d5-b95f04376bdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:26.704378 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:26.705830 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e781621-62d5-40a5-a4d5-b95f04376bdb None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:26.714876 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 228/444] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:27:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:26.715750 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e781621-62d5-40a5-a4d5-b95f04376bdb None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:26.761103 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512e064-d52b-416c-96c9-5a5614076b4c None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:26.794261 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a5538-34a3-4545-9700-fb7ca85a00ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:26.794885 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a5538-34a3-4545-9700-fb7ca85a00ea None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:26.795164 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a5538-34a3-4545-9700-fb7ca85a00ea None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:26.795434 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a5538-34a3-4545-9700-fb7ca85a00ea None admin] PATH_INFO: `/v3/groups/5056d570cd214b52931080e6fe4bc241` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:26.796544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a5538-34a3-4545-9700-fb7ca85a00ea None admin] RBAC: Authorizing `identity:get_group(group_id=5056d570cd214b52931080e6fe4bc241)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:26.798015 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a5538-34a3-4545-9700-fb7ca85a00ea None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:26.799559 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 217/445] 10.222.0.33 () {56 vars in 1180 bytes} [Fri Sep 16 03:27:26 2022] GET /identity/v3/groups/5056d570cd214b52931080e6fe4bc241 => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:26.800309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a5538-34a3-4545-9700-fb7ca85a00ea None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:26.816823 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e781621-62d5-40a5-a4d5-b95f04376bdb None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:26.850264 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b230048-9eb3-4d0a-85f0-4356fccc8a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:26.850847 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b230048-9eb3-4d0a-85f0-4356fccc8a12 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:26.851158 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b230048-9eb3-4d0a-85f0-4356fccc8a12 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:26.851429 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b230048-9eb3-4d0a-85f0-4356fccc8a12 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:26.852064 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b230048-9eb3-4d0a-85f0-4356fccc8a12 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:26.852365 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b230048-9eb3-4d0a-85f0-4356fccc8a12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:26.853793 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b230048-9eb3-4d0a-85f0-4356fccc8a12 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:26.861448 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 229/446] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:27:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:26.862247 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b230048-9eb3-4d0a-85f0-4356fccc8a12 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:26.900687 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:26.901062 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a5538-34a3-4545-9700-fb7ca85a00ea None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:26.916089 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:26.934354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710c3ba-db3b-46f9-9e4b-d0b5eb60f3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:26.934954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710c3ba-db3b-46f9-9e4b-d0b5eb60f3f8 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:26.935229 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710c3ba-db3b-46f9-9e4b-d0b5eb60f3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:26.935500 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710c3ba-db3b-46f9-9e4b-d0b5eb60f3f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:26.959251 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b230048-9eb3-4d0a-85f0-4356fccc8a12 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:26.993446 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccce1de-6ff7-4888-8150-d02293c4b621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:26.994077 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccce1de-6ff7-4888-8150-d02293c4b621 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:26.994360 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccce1de-6ff7-4888-8150-d02293c4b621 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:26.994661 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccce1de-6ff7-4888-8150-d02293c4b621 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:26.995435 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccce1de-6ff7-4888-8150-d02293c4b621 None admin] RBAC: Adding query filter params (group.id=5056d570cd214b52931080e6fe4bc241, role.id=7591562cf9564b288c108609d8e334b3, scope.project.id=f14af8f557914f4291de2295e89b8249) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:26.995742 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccce1de-6ff7-4888-8150-d02293c4b621 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:26.997305 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccce1de-6ff7-4888-8150-d02293c4b621 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:27.000094 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2710c3ba-db3b-46f9-9e4b-d0b5eb60f3f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:27.001565 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2710c3ba-db3b-46f9-9e4b-d0b5eb60f3f8 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:27.003158 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 230/447] 10.222.0.33 () {56 vars in 1376 bytes} [Fri Sep 16 03:27:26 2022] GET /identity/v3/role_assignments?group.id=5056d570cd214b52931080e6fe4bc241&scope.project.id=f14af8f557914f4291de2295e89b8249&role.id=7591562cf9564b288c108609d8e334b3 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:27.003934 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccce1de-6ff7-4888-8150-d02293c4b621 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:27.114182 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccce1de-6ff7-4888-8150-d02293c4b621 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:27.115423 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 218/448] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:27:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 03:27:27.116412 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:27.121725 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710c3ba-db3b-46f9-9e4b-d0b5eb60f3f8 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:27.133984 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:27.154869 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd91f40-364a-4d4d-a8ad-d989575b9963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:27.155575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd91f40-364a-4d4d-a8ad-d989575b9963 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:27.155880 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd91f40-364a-4d4d-a8ad-d989575b9963 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:27.156210 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd91f40-364a-4d4d-a8ad-d989575b9963 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:27.234289 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710c3ba-db3b-46f9-9e4b-d0b5eb60f3f8 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:27.239619 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd91f40-364a-4d4d-a8ad-d989575b9963 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:27.239766 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd91f40-364a-4d4d-a8ad-d989575b9963 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:27.273681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3905af1-77a5-4e98-a31b-e03ec38d1e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:27.274347 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3905af1-77a5-4e98-a31b-e03ec38d1e9a None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:27.274630 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3905af1-77a5-4e98-a31b-e03ec38d1e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:27.274901 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3905af1-77a5-4e98-a31b-e03ec38d1e9a None admin] PATH_INFO: `/v3/projects/4c378d507cbc42e4b80e3f5c14a93477` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:27.276113 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3905af1-77a5-4e98-a31b-e03ec38d1e9a None admin] RBAC: Authorizing `identity:get_project(project_id=4c378d507cbc42e4b80e3f5c14a93477)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:27.277562 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3905af1-77a5-4e98-a31b-e03ec38d1e9a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:27.279464 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 219/449] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:27:27 2022] GET /identity/v3/projects/4c378d507cbc42e4b80e3f5c14a93477 => generated 344 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:27.284907 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3905af1-77a5-4e98-a31b-e03ec38d1e9a None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:27.359717 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 231/450] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:27:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 03:27:27.365388 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd91f40-364a-4d4d-a8ad-d989575b9963 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:27.368786 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:27.370053 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:27.400243 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3905af1-77a5-4e98-a31b-e03ec38d1e9a None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:27.433669 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c75100-ea65-4378-b18c-d39bac92c536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:27.434305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c75100-ea65-4378-b18c-d39bac92c536 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:27.434585 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c75100-ea65-4378-b18c-d39bac92c536 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:27.434901 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c75100-ea65-4378-b18c-d39bac92c536 None admin] PATH_INFO: `/v3/groups/70a70317e2d149ff8ed097c1d1c1df61` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:27.436309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c75100-ea65-4378-b18c-d39bac92c536 None admin] RBAC: Authorizing `identity:get_group(group_id=70a70317e2d149ff8ed097c1d1c1df61)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:27.438191 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c75100-ea65-4378-b18c-d39bac92c536 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:27.439745 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 220/451] 10.222.0.33 () {56 vars in 1180 bytes} [Fri Sep 16 03:27:27 2022] GET /identity/v3/groups/70a70317e2d149ff8ed097c1d1c1df61 => generated 229 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:27:27.445445 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c75100-ea65-4378-b18c-d39bac92c536 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:27.468559 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd91f40-364a-4d4d-a8ad-d989575b9963 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:27.501353 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80645a63-e8f2-49bc-8748-b4ee0535560b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:27.501954 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80645a63-e8f2-49bc-8748-b4ee0535560b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:27.502231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80645a63-e8f2-49bc-8748-b4ee0535560b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:27.502504 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80645a63-e8f2-49bc-8748-b4ee0535560b None admin] PATH_INFO: `/v3/projects/f14af8f557914f4291de2295e89b8249` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:27.503628 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80645a63-e8f2-49bc-8748-b4ee0535560b None admin] RBAC: Authorizing `identity:get_project(project_id=f14af8f557914f4291de2295e89b8249)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:27.505056 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80645a63-e8f2-49bc-8748-b4ee0535560b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:27.506677 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 232/452] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:27:27 2022] GET /identity/v3/projects/f14af8f557914f4291de2295e89b8249 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:27:27.512093 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80645a63-e8f2-49bc-8748-b4ee0535560b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:27.542408 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c75100-ea65-4378-b18c-d39bac92c536 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:27.575875 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba496c-361c-4b56-90a2-18a98e5ffe89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:27.576559 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba496c-361c-4b56-90a2-18a98e5ffe89 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:27.576847 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba496c-361c-4b56-90a2-18a98e5ffe89 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:27.577117 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba496c-361c-4b56-90a2-18a98e5ffe89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:27.577867 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba496c-361c-4b56-90a2-18a98e5ffe89 None admin] RBAC: Adding query filter params (group.id=70a70317e2d149ff8ed097c1d1c1df61, role.id=4ffac54101e248479bcdc0e54890020f, scope.project.id=4c378d507cbc42e4b80e3f5c14a93477) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:27.578176 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba496c-361c-4b56-90a2-18a98e5ffe89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:27.579595 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba496c-361c-4b56-90a2-18a98e5ffe89 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:27.579703 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:27.585171 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 221/453] 10.222.0.33 () {56 vars in 1376 bytes} [Fri Sep 16 03:27:27 2022] GET /identity/v3/role_assignments?group.id=70a70317e2d149ff8ed097c1d1c1df61&scope.project.id=4c378d507cbc42e4b80e3f5c14a93477&role.id=4ffac54101e248479bcdc0e54890020f => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:27:27.610686 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80645a63-e8f2-49bc-8748-b4ee0535560b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:27.648454 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc84b58-c6ac-4a2b-8281-ccbf595648c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:27.649103 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc84b58-c6ac-4a2b-8281-ccbf595648c9 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:27.649380 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc84b58-c6ac-4a2b-8281-ccbf595648c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:27.649674 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc84b58-c6ac-4a2b-8281-ccbf595648c9 None admin] PATH_INFO: `/v3/groups/5056d570cd214b52931080e6fe4bc241` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:27.650813 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc84b58-c6ac-4a2b-8281-ccbf595648c9 None admin] RBAC: Authorizing `identity:get_group(group_id=5056d570cd214b52931080e6fe4bc241)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:27.652256 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc84b58-c6ac-4a2b-8281-ccbf595648c9 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:27.653902 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 233/454] 10.222.0.33 () {56 vars in 1180 bytes} [Fri Sep 16 03:27:27 2022] GET /identity/v3/groups/5056d570cd214b52931080e6fe4bc241 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:27:27.660041 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba496c-361c-4b56-90a2-18a98e5ffe89 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:27.673004 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:27.771728 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba496c-361c-4b56-90a2-18a98e5ffe89 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:27.806856 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4fa5d-54b0-4fb5-98cc-674d3314d360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:27.807461 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4fa5d-54b0-4fb5-98cc-674d3314d360 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:27.807741 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4fa5d-54b0-4fb5-98cc-674d3314d360 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:27.808016 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4fa5d-54b0-4fb5-98cc-674d3314d360 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:27.808740 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d4fa5d-54b0-4fb5-98cc-674d3314d360 None admin] RBAC: Adding query filter params (group.id=5056d570cd214b52931080e6fe4bc241, role.id=fcb362c8a9fd47fbbb6b14397cae171c, scope.project.id=f14af8f557914f4291de2295e89b8249) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:27.809048 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d4fa5d-54b0-4fb5-98cc-674d3314d360 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:27.810516 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d4fa5d-54b0-4fb5-98cc-674d3314d360 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:27.816247 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 222/455] 10.222.0.33 () {56 vars in 1376 bytes} [Fri Sep 16 03:27:27 2022] GET /identity/v3/role_assignments?group.id=5056d570cd214b52931080e6fe4bc241&scope.project.id=f14af8f557914f4291de2295e89b8249&role.id=fcb362c8a9fd47fbbb6b14397cae171c => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:30.670583 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92e65b-7364-48b4-b4de-de13ddf69d78 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:30.671119 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92e65b-7364-48b4-b4de-de13ddf69d78 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:30.671119 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92e65b-7364-48b4-b4de-de13ddf69d78 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:30.672718 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 234/456] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:30.678665 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf5a26-8db3-46bb-bcf8-ba49eef5b440 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:30.679732 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf5a26-8db3-46bb-bcf8-ba49eef5b440 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:30.679732 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf5a26-8db3-46bb-bcf8-ba49eef5b440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:30.706497 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-80bf5a26-8db3-46bb-bcf8-ba49eef5b440 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:30.707714 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-80bf5a26-8db3-46bb-bcf8-ba49eef5b440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:30.798995 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6928b7-a440-4dc2-aaa2-20181b99a5b9 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:30.799191 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 223/457] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:27:30.799280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6928b7-a440-4dc2-aaa2-20181b99a5b9 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:30.799539 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6928b7-a440-4dc2-aaa2-20181b99a5b9 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:30.800845 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 235/458] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:30.815523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7561306-154a-4f2e-818d-36e24a5cf8b1 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:30.815798 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7561306-154a-4f2e-818d-36e24a5cf8b1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:30.816075 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7561306-154a-4f2e-818d-36e24a5cf8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:30.825359 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:30.842613 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d7561306-154a-4f2e-818d-36e24a5cf8b1 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:30.848244 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d7561306-154a-4f2e-818d-36e24a5cf8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:30.931286 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 224/459] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:27:31.152714 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53beba-9a78-4465-9523-184207d0d5e1 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:31.153105 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53beba-9a78-4465-9523-184207d0d5e1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:31.153280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53beba-9a78-4465-9523-184207d0d5e1 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:31.154953 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 236/460] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:31.161055 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e849989-577e-45e3-be81-1b51aebea278 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:31.161334 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e849989-577e-45e3-be81-1b51aebea278 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:31.161601 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e849989-577e-45e3-be81-1b51aebea278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:31.185850 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0e849989-577e-45e3-be81-1b51aebea278 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:31.186956 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0e849989-577e-45e3-be81-1b51aebea278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:31.203929 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53beba-9a78-4465-9523-184207d0d5e1 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:31.291468 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 225/461] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 03:27:31.292713 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71e7ce-5a75-4029-aa12-8728ea737e42 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:31.292998 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71e7ce-5a75-4029-aa12-8728ea737e42 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:31.293267 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71e7ce-5a75-4029-aa12-8728ea737e42 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:31.294627 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 226/462] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:31.295189 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71e7ce-5a75-4029-aa12-8728ea737e42 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:31.339895 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53beba-9a78-4465-9523-184207d0d5e1 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:31.364941 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:31.380877 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8cde59-9827-415e-be75-4fefc6ac663f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:31.381914 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cde59-9827-415e-be75-4fefc6ac663f None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:31.382241 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cde59-9827-415e-be75-4fefc6ac663f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:31.382808 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cde59-9827-415e-be75-4fefc6ac663f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:31.390627 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:31.395327 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8cde59-9827-415e-be75-4fefc6ac663f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:31.397036 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8cde59-9827-415e-be75-4fefc6ac663f None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:31.408141 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71e7ce-5a75-4029-aa12-8728ea737e42 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:31.416654 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-7d8cde59-9827-415e-be75-4fefc6ac663f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:31.416654 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:31.416654 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:31.416654 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:31.416654 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:31.416654 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:31.416654 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:31.416654 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:31.416654 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:31.416654 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:31.416654 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:31.416654 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:31.416654 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:27:31.416654 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:27:31.416654 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:27:31.416654 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:27:31.417768 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:31.417768 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:31.417768 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:31.417768 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:31.417768 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:31.417768 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:31.417768 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:31.417768 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:31.417768 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:31.417768 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:31.417768 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:31.417768 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:31.417768 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:31.417768 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:31.417768 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:31.417768 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:31.417768 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:27:31.418618 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:27:31.418618 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:31.418618 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:31.418618 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 237/463] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:27:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:31.419894 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44811ee-8c75-448b-a1f3-b4a8bad85572 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:31.420102 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44811ee-8c75-448b-a1f3-b4a8bad85572 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:31.422462 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44811ee-8c75-448b-a1f3-b4a8bad85572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:31.442907 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a44811ee-8c75-448b-a1f3-b4a8bad85572 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:31.444043 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a44811ee-8c75-448b-a1f3-b4a8bad85572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:31.447239 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ca6ce-5f8a-4039-b9fd-1635325242ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:31.447921 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ca6ce-5f8a-4039-b9fd-1635325242ff None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:31.448198 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ca6ce-5f8a-4039-b9fd-1635325242ff None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:31.448465 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ca6ce-5f8a-4039-b9fd-1635325242ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:31.459653 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7ca6ce-5f8a-4039-b9fd-1635325242ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:31.461870 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7ca6ce-5f8a-4039-b9fd-1635325242ff None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:31.477620 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-eb7ca6ce-5f8a-4039-b9fd-1635325242ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:31.477620 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:31.477620 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:31.477620 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:31.477620 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:31.477620 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:31.477620 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:31.477620 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:31.477620 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:31.477620 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:31.477620 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:31.477620 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:31.477620 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:27:31.477620 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:27:31.477620 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:27:31.477620 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:27:31.479718 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:31.479718 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:31.479718 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:31.479718 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:31.479718 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:31.479718 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:31.479718 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:31.479718 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:31.479718 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:31.479718 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:31.479718 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:31.479718 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:31.479718 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:31.479718 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:31.479718 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:31.479718 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:31.479718 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:27:31.481781 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:27:31.481781 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:31.481781 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:31.481781 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 227/464] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:27:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:31.481781 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ca6ce-5f8a-4039-b9fd-1635325242ff None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:31.529452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 238/465] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:27:31.530345 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44811ee-8c75-448b-a1f3-b4a8bad85572 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:31.606830 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ca6ce-5f8a-4039-b9fd-1635325242ff None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:31.621864 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:31.643477 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad6a47-44f8-40eb-8430-dc31e2d340af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:31.644341 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad6a47-44f8-40eb-8430-dc31e2d340af None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:31.644689 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad6a47-44f8-40eb-8430-dc31e2d340af None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:31.645089 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad6a47-44f8-40eb-8430-dc31e2d340af None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:31.646155 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad6a47-44f8-40eb-8430-dc31e2d340af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:31.646524 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad6a47-44f8-40eb-8430-dc31e2d340af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:31.647302 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44811ee-8c75-448b-a1f3-b4a8bad85572 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:31.648094 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad6a47-44f8-40eb-8430-dc31e2d340af None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:31.661464 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 228/466] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:31.662579 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad6a47-44f8-40eb-8430-dc31e2d340af None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:31.671620 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:31.690815 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10525d96-f1b7-4311-9ba3-d3b52c9e2a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:31.691477 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10525d96-f1b7-4311-9ba3-d3b52c9e2a7e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:31.692005 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10525d96-f1b7-4311-9ba3-d3b52c9e2a7e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:31.692470 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10525d96-f1b7-4311-9ba3-d3b52c9e2a7e None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:31.693317 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10525d96-f1b7-4311-9ba3-d3b52c9e2a7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:31.693811 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10525d96-f1b7-4311-9ba3-d3b52c9e2a7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:31.695719 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10525d96-f1b7-4311-9ba3-d3b52c9e2a7e None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:31.722378 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 239/467] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:31.723874 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10525d96-f1b7-4311-9ba3-d3b52c9e2a7e None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:31.779827 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad6a47-44f8-40eb-8430-dc31e2d340af None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:31.814983 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c85633-6f8a-4d7b-9451-7a5e91ef7689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:31.815779 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c85633-6f8a-4d7b-9451-7a5e91ef7689 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:31.815885 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c85633-6f8a-4d7b-9451-7a5e91ef7689 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:31.816138 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c85633-6f8a-4d7b-9451-7a5e91ef7689 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:31.826970 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c85633-6f8a-4d7b-9451-7a5e91ef7689 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:31.828513 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c85633-6f8a-4d7b-9451-7a5e91ef7689 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:31.842712 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10525d96-f1b7-4311-9ba3-d3b52c9e2a7e None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:31.843384 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-d7c85633-6f8a-4d7b-9451-7a5e91ef7689 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:31.843384 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:31.843384 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:31.843384 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:31.843384 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:31.843384 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:31.843384 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:31.843384 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:31.843384 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:31.843384 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:31.843384 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:31.843384 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:31.843384 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:27:31.843384 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:27:31.843384 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:27:31.843384 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:27:31.844220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:31.844220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:31.844220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:31.844220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:31.844220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:31.844220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:31.844220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:31.844220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:31.844220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:31.844220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:31.844220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:31.844220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:31.844220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:31.844220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:31.844220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:31.844220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:31.844220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:27:31.845048 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:27:31.845048 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:31.845048 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:31.845048 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 229/468] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:27:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:31.845284 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c85633-6f8a-4d7b-9451-7a5e91ef7689 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:31.874797 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:31.886211 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f0595-d45d-4588-bb88-7f1716e8f8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:31.887059 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f0595-d45d-4588-bb88-7f1716e8f8cd None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:31.887478 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f0595-d45d-4588-bb88-7f1716e8f8cd None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:31.887987 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f0595-d45d-4588-bb88-7f1716e8f8cd None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:31.888771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f0595-d45d-4588-bb88-7f1716e8f8cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:31.890403 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f0595-d45d-4588-bb88-7f1716e8f8cd None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:31.951058 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c85633-6f8a-4d7b-9451-7a5e91ef7689 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:31.980944 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 240/469] 10.222.0.33 () {60 vars in 1132 bytes} [Fri Sep 16 03:27:31 2022] POST /identity/v3/users => generated 248 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:27:31.982061 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f0595-d45d-4588-bb88-7f1716e8f8cd None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:31.993542 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de9d31-0db0-4a86-beca-0c53fad6556b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:31.994212 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de9d31-0db0-4a86-beca-0c53fad6556b None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:31.994488 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de9d31-0db0-4a86-beca-0c53fad6556b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:31.994759 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de9d31-0db0-4a86-beca-0c53fad6556b None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:31.998302 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de9d31-0db0-4a86-beca-0c53fad6556b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:31.998302 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de9d31-0db0-4a86-beca-0c53fad6556b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:32.033991 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:32.081813 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 230/470] 10.222.0.33 () {60 vars in 1132 bytes} [Fri Sep 16 03:27:31 2022] POST /identity/v3/users => generated 246 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:27:32.083348 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de9d31-0db0-4a86-beca-0c53fad6556b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:32.112800 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f0595-d45d-4588-bb88-7f1716e8f8cd None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:32.166034 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449e25a-bdb8-41e4-8047-a9dd7f84a542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:32.166853 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449e25a-bdb8-41e4-8047-a9dd7f84a542 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:32.167250 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449e25a-bdb8-41e4-8047-a9dd7f84a542 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:32.167546 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449e25a-bdb8-41e4-8047-a9dd7f84a542 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:32.183592 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449e25a-bdb8-41e4-8047-a9dd7f84a542 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:32.185935 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449e25a-bdb8-41e4-8047-a9dd7f84a542 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:32.203733 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-9449e25a-bdb8-41e4-8047-a9dd7f84a542 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:32.203733 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:32.203733 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:32.203733 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:32.203733 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:32.203733 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:32.203733 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:32.203733 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:32.203733 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:32.203733 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:32.203733 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:32.203733 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:32.203733 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:27:32.203733 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:27:32.203733 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:27:32.203733 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:27:32.204818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:32.204818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:32.204818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:32.204818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:32.204818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:32.204818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:32.204818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:32.204818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:32.204818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:32.204818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:32.204818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:32.204818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:32.204818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:32.204818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:32.204818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:32.204818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:32.204818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:27:32.205722 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:27:32.205722 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:32.205722 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:32.207806 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 241/471] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:27:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:32.207806 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa8023-a8e2-49f8-8ddd-051b5c9f65a1 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:32.207806 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa8023-a8e2-49f8-8ddd-051b5c9f65a1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:32.208102 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa8023-a8e2-49f8-8ddd-051b5c9f65a1 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:32.208615 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:32.209601 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 242/472] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:32.214802 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa8023-a8e2-49f8-8ddd-051b5c9f65a1 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:32.236117 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de9d31-0db0-4a86-beca-0c53fad6556b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:32.281739 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7354280-a671-4ebf-91f8-5f83be74ddc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:32.282407 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7354280-a671-4ebf-91f8-5f83be74ddc3 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:32.282690 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7354280-a671-4ebf-91f8-5f83be74ddc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:32.282963 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7354280-a671-4ebf-91f8-5f83be74ddc3 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:32.283609 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7354280-a671-4ebf-91f8-5f83be74ddc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:32.283914 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7354280-a671-4ebf-91f8-5f83be74ddc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:32.285289 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7354280-a671-4ebf-91f8-5f83be74ddc3 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:32.299283 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 231/473] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:32.301044 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1206c-094a-4492-902e-776c0775c1c7 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:32.301320 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1206c-094a-4492-902e-776c0775c1c7 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:32.301591 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1206c-094a-4492-902e-776c0775c1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:32.323318 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-fcc1206c-094a-4492-902e-776c0775c1c7 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:32.324535 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fcc1206c-094a-4492-902e-776c0775c1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:32.344619 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:32.360289 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa8023-a8e2-49f8-8ddd-051b5c9f65a1 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:32.402553 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 232/474] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:27:32.404008 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1206c-094a-4492-902e-776c0775c1c7 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:32.404300 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde60cf1-4f8e-4d5d-8f0c-315168606116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:32.404914 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde60cf1-4f8e-4d5d-8f0c-315168606116 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:32.405196 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde60cf1-4f8e-4d5d-8f0c-315168606116 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:32.405468 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde60cf1-4f8e-4d5d-8f0c-315168606116 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:32.406138 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde60cf1-4f8e-4d5d-8f0c-315168606116 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:32.406439 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde60cf1-4f8e-4d5d-8f0c-315168606116 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:32.407940 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde60cf1-4f8e-4d5d-8f0c-315168606116 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:32.427790 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 243/475] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:32.433920 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde60cf1-4f8e-4d5d-8f0c-315168606116 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:32.481156 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:32.512485 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1206c-094a-4492-902e-776c0775c1c7 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:32.548794 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba116bfc-e585-42c1-a086-42a13035e111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:32.549511 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba116bfc-e585-42c1-a086-42a13035e111 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:32.549901 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba116bfc-e585-42c1-a086-42a13035e111 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:32.550332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba116bfc-e585-42c1-a086-42a13035e111 None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:32.550951 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba116bfc-e585-42c1-a086-42a13035e111 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:32.552464 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba116bfc-e585-42c1-a086-42a13035e111 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:32.557787 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde60cf1-4f8e-4d5d-8f0c-315168606116 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:32.598445 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930cd47-b60f-4da1-a758-e2c538cb5447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:32.599112 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930cd47-b60f-4da1-a758-e2c538cb5447 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:32.599390 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930cd47-b60f-4da1-a758-e2c538cb5447 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:32.599663 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930cd47-b60f-4da1-a758-e2c538cb5447 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:32.600319 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930cd47-b60f-4da1-a758-e2c538cb5447 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:32.602492 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930cd47-b60f-4da1-a758-e2c538cb5447 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:32.648898 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 233/476] 10.222.0.33 () {60 vars in 1132 bytes} [Fri Sep 16 03:27:32 2022] POST /identity/v3/users => generated 248 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:27:32.689345 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 244/477] 10.222.0.33 () {60 vars in 1132 bytes} [Fri Sep 16 03:27:32 2022] POST /identity/v3/users => generated 249 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:27:32.763050 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba116bfc-e585-42c1-a086-42a13035e111 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:32.912540 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba116bfc-e585-42c1-a086-42a13035e111 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:32.941029 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:32.950482 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74ab36-e46e-4f8f-b75f-4304bcf9a927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:32.951090 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74ab36-e46e-4f8f-b75f-4304bcf9a927 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:32.951368 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74ab36-e46e-4f8f-b75f-4304bcf9a927 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:32.951632 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74ab36-e46e-4f8f-b75f-4304bcf9a927 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:32.952307 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec74ab36-e46e-4f8f-b75f-4304bcf9a927 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:32.953801 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec74ab36-e46e-4f8f-b75f-4304bcf9a927 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:32.999697 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.sql.core [None req-ec74ab36-e46e-4f8f-b75f-4304bcf9a927 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 16 03:27:32.999697 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 16 03:27:32.999697 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [parameters: {'id': 'aed86309b9c54995b72286131a49008c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 16 03:27:32.999697 dv-cinder-857993-1-smb devstack@keystone.service[81776]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81776) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 16 03:27:33.017276 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-ec74ab36-e46e-4f8f-b75f-4304bcf9a927 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 16 03:27:33.017276 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:33.017276 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 03:27:33.017276 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 16 03:27:33.017276 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 03:27:33.017276 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 16 03:27:33.017276 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 03:27:33.017276 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application result = self._query(query) Sep 16 03:27:33.017276 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 03:27:33.017276 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application conn.query(q) Sep 16 03:27:33.017276 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 03:27:33.017276 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 03:27:33.017276 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 03:27:33.017276 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application result.read() Sep 16 03:27:33.017276 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 03:27:33.018234 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 16 03:27:33.018234 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 03:27:33.018234 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 16 03:27:33.018234 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 03:27:33.018234 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 16 03:27:33.018234 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 03:27:33.018234 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 16 03:27:33.018234 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 16 03:27:33.018234 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:33.018234 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 16 03:27:33.018234 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:33.018234 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:33.018234 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 16 03:27:33.018234 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 16 03:27:33.018234 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 16 03:27:33.018234 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return ref.to_dict() Sep 16 03:27:33.018234 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 16 03:27:33.018234 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application next(self.gen) Sep 16 03:27:33.019140 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 16 03:27:33.019140 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application yield resource Sep 16 03:27:33.019140 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 16 03:27:33.019140 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application next(self.gen) Sep 16 03:27:33.019140 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 16 03:27:33.019140 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self.session.rollback() Sep 16 03:27:33.019140 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 03:27:33.019140 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self.force_reraise() Sep 16 03:27:33.019140 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 03:27:33.019140 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise self.value Sep 16 03:27:33.019140 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 16 03:27:33.019140 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 16 03:27:33.019140 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 16 03:27:33.019140 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application session.commit() Sep 16 03:27:33.019140 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 16 03:27:33.019140 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 16 03:27:33.019140 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 16 03:27:33.020004 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._prepare_impl() Sep 16 03:27:33.020004 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 16 03:27:33.020004 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self.session.flush() Sep 16 03:27:33.020004 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 16 03:27:33.020004 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._flush(objects) Sep 16 03:27:33.020004 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 16 03:27:33.020004 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 16 03:27:33.020004 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 16 03:27:33.020004 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application compat.raise_( Sep 16 03:27:33.020004 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 03:27:33.020004 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception Sep 16 03:27:33.020004 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 16 03:27:33.020004 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application flush_context.execute() Sep 16 03:27:33.020004 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 16 03:27:33.020004 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rec.execute(self) Sep 16 03:27:33.020004 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 16 03:27:33.020004 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 16 03:27:33.021854 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 16 03:27:33.021854 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 16 03:27:33.021854 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 16 03:27:33.021854 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 16 03:27:33.021854 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 16 03:27:33.021854 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 16 03:27:33.021854 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 16 03:27:33.021854 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 16 03:27:33.021854 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 16 03:27:33.021854 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 16 03:27:33.021854 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 16 03:27:33.021854 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 16 03:27:33.021854 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 16 03:27:33.021854 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 16 03:27:33.021854 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 03:27:33.021854 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception Sep 16 03:27:33.023877 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 03:27:33.023877 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 16 03:27:33.023877 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 03:27:33.023877 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 16 03:27:33.023877 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 03:27:33.023877 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application result = self._query(query) Sep 16 03:27:33.023877 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 03:27:33.023877 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application conn.query(q) Sep 16 03:27:33.023877 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 03:27:33.023877 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 03:27:33.023877 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 03:27:33.023877 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application result.read() Sep 16 03:27:33.023877 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 03:27:33.023877 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 16 03:27:33.023877 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 03:27:33.023877 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 16 03:27:33.026232 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 03:27:33.026232 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 16 03:27:33.026232 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 03:27:33.026232 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 16 03:27:33.026232 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 16 03:27:33.026232 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 16 03:27:33.026232 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [parameters: {'id': 'aed86309b9c54995b72286131a49008c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 16 03:27:33.026232 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 16 03:27:33.026232 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:33.026232 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 03:27:33.026232 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:33.026232 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:33.026232 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:33.026232 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:33.026232 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:33.026232 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:33.028285 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:33.028285 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:33.028285 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:33.028285 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:33.028285 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:33.028285 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:33.028285 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 16 03:27:33.028285 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 16 03:27:33.028285 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:33.028285 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:33.028285 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 16 03:27:33.028285 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 16 03:27:33.028285 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 16 03:27:33.028285 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 16 03:27:33.028285 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 16 03:27:33.028285 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:33.036487 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 234/478] 10.222.0.33 () {60 vars in 1131 bytes} [Fri Sep 16 03:27:32 2022] POST /identity/v3/roles => generated 144 bytes in 256 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:33.036582 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930cd47-b60f-4da1-a758-e2c538cb5447 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:33.036582 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:33.185609 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930cd47-b60f-4da1-a758-e2c538cb5447 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:33.224369 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3061a-ae22-454c-afaa-9107cdbd6642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:33.225244 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3061a-ae22-454c-afaa-9107cdbd6642 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:33.226247 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3061a-ae22-454c-afaa-9107cdbd6642 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:33.226664 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3061a-ae22-454c-afaa-9107cdbd6642 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:33.244855 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3061a-ae22-454c-afaa-9107cdbd6642 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:33.250532 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-80f3061a-ae22-454c-afaa-9107cdbd6642 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 03:27:33.250532 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:33.250532 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:33.250532 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:33.250532 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:33.250532 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:33.250532 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:33.250532 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:33.250532 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:33.250532 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:33.250532 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:33.250532 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:33.250532 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:33.250532 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:33.250532 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:33.250532 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:33.251595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:33.251595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:33.251595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:33.251595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:33.251595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:33.251595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:33.251595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:33.251595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:33.251595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:33.251595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:33.251595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:33.251595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:33.251595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:33.251595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:33.251595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:33.251595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:33.252577 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:33.252577 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:33.252577 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:33.252577 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:33.252577 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:33.252577 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:33.252577 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:33.252577 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:33.252577 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:33.252577 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:33.252577 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 03:27:33.252577 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:33.254545 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 245/479] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 03:27:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:33.261285 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74ab36-e46e-4f8f-b75f-4304bcf9a927 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:33.393118 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74ab36-e46e-4f8f-b75f-4304bcf9a927 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:33.438410 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c81d72-26b3-425f-afdd-65d2236e8d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:33.439302 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c81d72-26b3-425f-afdd-65d2236e8d2e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:33.439752 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c81d72-26b3-425f-afdd-65d2236e8d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:33.440168 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c81d72-26b3-425f-afdd-65d2236e8d2e None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:33.440967 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c81d72-26b3-425f-afdd-65d2236e8d2e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:33.441469 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c81d72-26b3-425f-afdd-65d2236e8d2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:33.443016 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c81d72-26b3-425f-afdd-65d2236e8d2e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:33.457191 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 235/480] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:27:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:34.650391 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbfc44-8e94-460c-8766-fbc817f45144 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:34.650916 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbfc44-8e94-460c-8766-fbc817f45144 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:34.651222 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbfc44-8e94-460c-8766-fbc817f45144 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:34.652819 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 246/481] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:34.658446 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fc39e-b998-4f01-8ed4-910c34116093 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:34.658863 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fc39e-b998-4f01-8ed4-910c34116093 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:34.659039 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fc39e-b998-4f01-8ed4-910c34116093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:34.684493 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c43fc39e-b998-4f01-8ed4-910c34116093 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:34.685731 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c43fc39e-b998-4f01-8ed4-910c34116093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:34.739104 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:34.759877 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 236/482] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:27:34.962083 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbb179-2461-4171-8cdf-6bf296515dac None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:34.962387 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbb179-2461-4171-8cdf-6bf296515dac None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:34.962733 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbb179-2461-4171-8cdf-6bf296515dac None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:34.964311 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 247/483] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:34.969751 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec03bdc-6fc6-40c0-b9e1-dbb5741e88d0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:34.970048 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec03bdc-6fc6-40c0-b9e1-dbb5741e88d0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:34.970327 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec03bdc-6fc6-40c0-b9e1-dbb5741e88d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:35.039997 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-dec03bdc-6fc6-40c0-b9e1-dbb5741e88d0 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:35.041209 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-dec03bdc-6fc6-40c0-b9e1-dbb5741e88d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:35.059793 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbb179-2461-4171-8cdf-6bf296515dac None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:35.149620 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 237/484] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:27:35.174916 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:35.237220 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbb179-2461-4171-8cdf-6bf296515dac None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:35.281067 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8059b2a-bf3b-4995-a002-e25fa8306b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:35.281747 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8059b2a-bf3b-4995-a002-e25fa8306b06 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:35.282032 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8059b2a-bf3b-4995-a002-e25fa8306b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:35.282304 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8059b2a-bf3b-4995-a002-e25fa8306b06 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:35.292968 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8059b2a-bf3b-4995-a002-e25fa8306b06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:35.298796 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cad1ba-13a1-4566-9831-f99f4f038384 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:35.299082 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cad1ba-13a1-4566-9831-f99f4f038384 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:35.299358 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cad1ba-13a1-4566-9831-f99f4f038384 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:35.299902 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-f8059b2a-bf3b-4995-a002-e25fa8306b06 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 03:27:35.299902 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:35.299902 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:35.299902 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:35.299902 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:35.299902 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:35.299902 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:35.299902 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:35.299902 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:35.299902 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:35.299902 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:35.299902 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:35.299902 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:35.299902 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:35.299902 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:35.299902 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:35.300731 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:35.300731 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:35.300731 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:35.300731 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:35.300731 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:35.300731 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:35.300731 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:35.300731 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:35.300731 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:35.300731 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:35.300731 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:35.300731 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:35.300731 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:35.300731 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:35.300731 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:35.300731 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:35.302176 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:35.302176 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:35.302176 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:35.302176 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:35.302176 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:35.302176 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:35.302176 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:35.302176 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:35.302176 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:35.302176 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:35.302176 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 03:27:35.302176 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:35.302782 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 238/485] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 03:27:35.304484 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 248/486] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 03:27:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:35.309763 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cad1ba-13a1-4566-9831-f99f4f038384 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:35.312004 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765853da-8c10-4b9e-910f-c2089edb3785 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:35.312491 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765853da-8c10-4b9e-910f-c2089edb3785 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:35.312973 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765853da-8c10-4b9e-910f-c2089edb3785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:35.340944 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-765853da-8c10-4b9e-910f-c2089edb3785 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:35.342398 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-765853da-8c10-4b9e-910f-c2089edb3785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:35.446588 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cad1ba-13a1-4566-9831-f99f4f038384 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:35.464165 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:35.484175 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 249/487] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 03:27:35.494712 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e19e6a-6038-473b-aacb-81c64d1f17ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:35.495639 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e19e6a-6038-473b-aacb-81c64d1f17ad None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:35.496119 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e19e6a-6038-473b-aacb-81c64d1f17ad None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:35.496633 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e19e6a-6038-473b-aacb-81c64d1f17ad None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:35.497527 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e19e6a-6038-473b-aacb-81c64d1f17ad None admin] RBAC: Adding query filter params (name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:35.498068 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e19e6a-6038-473b-aacb-81c64d1f17ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:35.499691 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e19e6a-6038-473b-aacb-81c64d1f17ad None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:35.515892 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 239/488] 10.222.0.33 () {56 vars in 1103 bytes} [Fri Sep 16 03:27:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:35.522166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e19e6a-6038-473b-aacb-81c64d1f17ad None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:35.522285 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765853da-8c10-4b9e-910f-c2089edb3785 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:35.640799 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:35.654941 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e19e6a-6038-473b-aacb-81c64d1f17ad None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:35.692036 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765853da-8c10-4b9e-910f-c2089edb3785 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:35.732308 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fcf0e-bc9e-420a-8583-11efc114c473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:35.733348 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fcf0e-bc9e-420a-8583-11efc114c473 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:35.733863 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fcf0e-bc9e-420a-8583-11efc114c473 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:35.734336 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fcf0e-bc9e-420a-8583-11efc114c473 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:35.738977 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fe4c6-7622-4679-836b-e6350935c281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:35.739632 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fe4c6-7622-4679-836b-e6350935c281 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:35.739918 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fe4c6-7622-4679-836b-e6350935c281 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:35.740202 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fe4c6-7622-4679-836b-e6350935c281 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:35.748536 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11fcf0e-bc9e-420a-8583-11efc114c473 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:35.750271 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11fcf0e-bc9e-420a-8583-11efc114c473 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:35.765616 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-f11fcf0e-bc9e-420a-8583-11efc114c473 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:35.765616 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:35.765616 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:35.765616 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:35.765616 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:35.765616 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:35.765616 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:35.765616 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:35.765616 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:35.765616 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:35.765616 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:35.765616 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:35.765616 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:27:35.765616 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:27:35.765616 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:27:35.765616 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:27:35.766550 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:35.766550 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:35.766550 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:35.766550 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:35.766550 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:35.766550 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:35.766550 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:35.766550 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:35.766550 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:35.766550 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:35.766550 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:35.766550 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:35.766550 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:35.766550 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:35.766550 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:35.766550 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:35.766550 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:27:35.767408 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:27:35.767408 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:35.767408 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:35.767567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10fe4c6-7622-4679-836b-e6350935c281 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:35.769528 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 250/489] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:27:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:35.776045 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fcf0e-bc9e-420a-8583-11efc114c473 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:35.777741 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-c10fe4c6-7622-4679-836b-e6350935c281 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 03:27:35.777741 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:35.777741 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:35.777741 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:35.777741 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:35.777741 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:35.777741 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:35.777741 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:35.777741 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:35.777741 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:35.777741 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:35.777741 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:35.777741 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:35.777741 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:35.777741 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:35.777741 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:35.778592 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:35.778592 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:35.778592 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:35.778592 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:35.778592 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:35.778592 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:35.778592 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:35.778592 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:35.778592 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:35.778592 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:35.778592 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:35.778592 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:35.778592 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:35.778592 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:35.778592 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:35.778592 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:35.779379 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:35.779379 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:35.779379 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:35.779379 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:35.779379 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:35.779379 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:35.779379 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:35.779379 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:35.779379 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:35.779379 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:35.779379 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 03:27:35.779379 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:35.779379 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 240/490] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 03:27:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:35.784643 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fe4c6-7622-4679-836b-e6350935c281 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:35.836902 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:35.890958 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fcf0e-bc9e-420a-8583-11efc114c473 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:35.899849 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:35.904824 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fe4c6-7622-4679-836b-e6350935c281 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:35.928515 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a00463-3e37-498a-81ad-8c496444df83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:35.929763 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a00463-3e37-498a-81ad-8c496444df83 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:35.930076 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a00463-3e37-498a-81ad-8c496444df83 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:35.930554 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a00463-3e37-498a-81ad-8c496444df83 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:35.930997 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a00463-3e37-498a-81ad-8c496444df83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:35.931295 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a00463-3e37-498a-81ad-8c496444df83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:35.932784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a00463-3e37-498a-81ad-8c496444df83 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:35.941559 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902d2d4-9f66-4bb7-9d58-5ee55dd60cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:35.947877 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902d2d4-9f66-4bb7-9d58-5ee55dd60cdb None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:35.947877 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902d2d4-9f66-4bb7-9d58-5ee55dd60cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:35.947877 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902d2d4-9f66-4bb7-9d58-5ee55dd60cdb None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:35.947877 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8902d2d4-9f66-4bb7-9d58-5ee55dd60cdb None admin] RBAC: Adding query filter params (name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:35.947877 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8902d2d4-9f66-4bb7-9d58-5ee55dd60cdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:35.948221 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 251/491] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:35.948221 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a00463-3e37-498a-81ad-8c496444df83 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:35.949439 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8902d2d4-9f66-4bb7-9d58-5ee55dd60cdb None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:35.958187 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 241/492] 10.222.0.33 () {56 vars in 1103 bytes} [Fri Sep 16 03:27:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:35.959258 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95197fe8-9ef3-4560-bc99-f7bad1f9de33 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:35.959543 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95197fe8-9ef3-4560-bc99-f7bad1f9de33 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:35.959822 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95197fe8-9ef3-4560-bc99-f7bad1f9de33 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:35.961577 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 242/493] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:35.962273 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95197fe8-9ef3-4560-bc99-f7bad1f9de33 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:36.060381 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a00463-3e37-498a-81ad-8c496444df83 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:36.064264 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:36.068197 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95197fe8-9ef3-4560-bc99-f7bad1f9de33 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:36.096860 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94cec9-9742-45c8-b3a2-bc6b009cecb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:36.097523 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94cec9-9742-45c8-b3a2-bc6b009cecb0 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:36.097834 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94cec9-9742-45c8-b3a2-bc6b009cecb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:36.098105 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94cec9-9742-45c8-b3a2-bc6b009cecb0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:36.103384 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496cd48-5612-45a1-b4ca-d7a6bfff6350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:36.104038 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496cd48-5612-45a1-b4ca-d7a6bfff6350 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:36.104299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496cd48-5612-45a1-b4ca-d7a6bfff6350 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:36.104627 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496cd48-5612-45a1-b4ca-d7a6bfff6350 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:36.109655 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94cec9-9742-45c8-b3a2-bc6b009cecb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:36.111633 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7496cd48-5612-45a1-b4ca-d7a6bfff6350 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:36.113076 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7496cd48-5612-45a1-b4ca-d7a6bfff6350 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:36.115694 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-ee94cec9-9742-45c8-b3a2-bc6b009cecb0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 03:27:36.115694 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:36.115694 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:36.115694 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:36.115694 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:36.115694 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:36.115694 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:36.115694 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:36.115694 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:36.115694 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:36.115694 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:36.115694 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:36.115694 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:36.115694 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:36.115694 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:36.115694 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:36.116675 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:36.116675 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:36.116675 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:36.116675 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:36.116675 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:36.116675 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:36.116675 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:36.116675 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:36.116675 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:36.116675 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:36.116675 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:36.116675 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:36.116675 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:36.116675 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:36.116675 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:36.116675 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:36.117486 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:36.117486 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:36.117486 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:36.117486 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:36.117486 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:36.117486 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:36.117486 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:36.117486 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:36.117486 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:36.117486 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:36.117486 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 03:27:36.117486 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:36.117486 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 252/494] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 03:27:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:36.118198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94cec9-9742-45c8-b3a2-bc6b009cecb0 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:36.128582 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-7496cd48-5612-45a1-b4ca-d7a6bfff6350 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 16 03:27:36.128582 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:36.128582 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:36.128582 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:36.128582 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:36.128582 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:36.128582 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:36.128582 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:36.128582 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:36.128582 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:36.128582 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:36.128582 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:36.128582 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 03:27:36.128582 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 03:27:36.128582 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 03:27:36.128582 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 03:27:36.130009 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:36.130009 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:36.130009 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 03:27:36.130009 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:27:36.130009 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 03:27:36.130009 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:27:36.130009 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:36.130009 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:36.130009 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:36.130009 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:36.130009 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:36.130009 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:36.130009 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:36.130009 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:36.130009 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:36.130009 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:36.130009 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:36.130009 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:36.130936 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:36.130936 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:36.130936 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 03:27:36.130936 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 03:27:36.130936 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 03:27:36.130936 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 03:27:36.130936 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 03:27:36.130936 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 03:27:36.130936 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 16 03:27:36.130936 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:36.130936 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 243/495] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:27:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:36.131498 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901c986-1704-4ec0-83b4-03b228d4aa90 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:36.131498 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901c986-1704-4ec0-83b4-03b228d4aa90 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:36.131498 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901c986-1704-4ec0-83b4-03b228d4aa90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:36.151562 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3901c986-1704-4ec0-83b4-03b228d4aa90 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:36.152763 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3901c986-1704-4ec0-83b4-03b228d4aa90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:36.156397 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:36.227467 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 244/496] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:27:36.233824 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901c986-1704-4ec0-83b4-03b228d4aa90 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:36.247522 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94cec9-9742-45c8-b3a2-bc6b009cecb0 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:36.286534 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e99e06-4784-4536-a68f-bcfcd450b169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:36.287280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e99e06-4784-4536-a68f-bcfcd450b169 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:36.287713 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e99e06-4784-4536-a68f-bcfcd450b169 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:36.288067 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e99e06-4784-4536-a68f-bcfcd450b169 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:36.299566 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e99e06-4784-4536-a68f-bcfcd450b169 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:36.301176 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e99e06-4784-4536-a68f-bcfcd450b169 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:36.319130 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-61e99e06-4784-4536-a68f-bcfcd450b169 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:36.319130 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:36.319130 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:36.319130 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:36.319130 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:36.319130 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:36.319130 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:36.319130 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:36.319130 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:36.319130 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:36.319130 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:36.319130 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:36.319130 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:27:36.319130 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:27:36.319130 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:27:36.319130 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:27:36.320552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:36.320552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:36.320552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:36.320552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:36.320552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:36.320552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:36.320552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:36.320552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:36.320552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:36.320552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:36.320552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:36.320552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:36.320552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:36.320552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:36.320552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:36.320552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:36.320552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:27:36.321374 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:27:36.321374 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:36.321374 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:36.325288 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 253/497] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:27:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:36.326094 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e99e06-4784-4536-a68f-bcfcd450b169 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:36.337880 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:36.349567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901c986-1704-4ec0-83b4-03b228d4aa90 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:36.384332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ff1d2-70d6-4cf7-b86b-cd89d8118926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:36.385125 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ff1d2-70d6-4cf7-b86b-cd89d8118926 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:36.385560 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ff1d2-70d6-4cf7-b86b-cd89d8118926 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:36.385877 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ff1d2-70d6-4cf7-b86b-cd89d8118926 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:36.386532 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ff1d2-70d6-4cf7-b86b-cd89d8118926 None admin] RBAC: Adding query filter params (name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:36.386837 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ff1d2-70d6-4cf7-b86b-cd89d8118926 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:36.388330 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ff1d2-70d6-4cf7-b86b-cd89d8118926 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:36.396934 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 245/498] 10.222.0.33 () {56 vars in 1103 bytes} [Fri Sep 16 03:27:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:36.398173 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fee716-7542-4071-8f07-13d01dfe6a60 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:36.398458 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fee716-7542-4071-8f07-13d01dfe6a60 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:36.398733 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fee716-7542-4071-8f07-13d01dfe6a60 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:36.400066 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 246/499] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:36.400612 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fee716-7542-4071-8f07-13d01dfe6a60 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:36.409917 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:36.433051 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e99e06-4784-4536-a68f-bcfcd450b169 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:36.467837 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0968301-5640-4924-aa71-76c9ba19bdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:36.468594 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0968301-5640-4924-aa71-76c9ba19bdd2 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:36.468980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0968301-5640-4924-aa71-76c9ba19bdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:36.469387 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0968301-5640-4924-aa71-76c9ba19bdd2 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:36.470456 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0968301-5640-4924-aa71-76c9ba19bdd2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:36.471322 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0968301-5640-4924-aa71-76c9ba19bdd2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:36.472859 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0968301-5640-4924-aa71-76c9ba19bdd2 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:36.505593 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fee716-7542-4071-8f07-13d01dfe6a60 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:36.511040 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 254/500] 10.222.0.33 () {56 vars in 1137 bytes} [Fri Sep 16 03:27:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:36.511728 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0968301-5640-4924-aa71-76c9ba19bdd2 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:36.539623 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c28fa2-bf93-470f-af56-2831f6e3c2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:36.540255 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c28fa2-bf93-470f-af56-2831f6e3c2ed None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:36.540535 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c28fa2-bf93-470f-af56-2831f6e3c2ed None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:36.540809 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c28fa2-bf93-470f-af56-2831f6e3c2ed None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:36.541444 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c28fa2-bf93-470f-af56-2831f6e3c2ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:36.541779 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c28fa2-bf93-470f-af56-2831f6e3c2ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:36.543145 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c28fa2-bf93-470f-af56-2831f6e3c2ed None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:36.554813 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 247/501] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:36.555952 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a967b5-dc87-4696-9549-feac01296a65 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:36.556236 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a967b5-dc87-4696-9549-feac01296a65 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:36.556510 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a967b5-dc87-4696-9549-feac01296a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:36.574726 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-79a967b5-dc87-4696-9549-feac01296a65 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:36.575849 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-79a967b5-dc87-4696-9549-feac01296a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:36.578539 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:36.610474 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0968301-5640-4924-aa71-76c9ba19bdd2 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:36.640101 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 248/502] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:27:36.640991 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a967b5-dc87-4696-9549-feac01296a65 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:36.644866 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576dbb50-38a5-4bf5-a768-524fedaa931a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:36.645775 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576dbb50-38a5-4bf5-a768-524fedaa931a None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:36.646057 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576dbb50-38a5-4bf5-a768-524fedaa931a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:36.646325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576dbb50-38a5-4bf5-a768-524fedaa931a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:36.654849 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:36.667058 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576dbb50-38a5-4bf5-a768-524fedaa931a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:36.668578 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576dbb50-38a5-4bf5-a768-524fedaa931a None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:36.684275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-576dbb50-38a5-4bf5-a768-524fedaa931a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:36.684275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:36.684275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:36.684275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:36.684275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:36.684275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:36.684275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:36.684275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:36.684275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:36.684275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:36.684275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:36.684275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:36.684275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:27:36.684275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:27:36.684275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:27:36.684275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:27:36.685231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:36.685231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:36.685231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:36.685231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:36.685231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:36.685231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:36.685231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:36.685231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:36.685231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:36.685231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:36.685231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:36.685231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:36.685231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:36.685231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:36.685231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:36.685231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:36.685231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:27:36.690880 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:27:36.690880 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:36.690880 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:36.690880 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 255/503] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:27:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:36.690880 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576dbb50-38a5-4bf5-a768-524fedaa931a None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:36.754282 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a967b5-dc87-4696-9549-feac01296a65 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:36.789478 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31088ccc-44c6-4e0d-adc7-3f5b967b55f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:36.790445 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31088ccc-44c6-4e0d-adc7-3f5b967b55f3 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:36.790964 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31088ccc-44c6-4e0d-adc7-3f5b967b55f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:36.791375 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31088ccc-44c6-4e0d-adc7-3f5b967b55f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:36.797981 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576dbb50-38a5-4bf5-a768-524fedaa931a None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:36.800768 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:36.804201 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31088ccc-44c6-4e0d-adc7-3f5b967b55f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:36.810134 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-31088ccc-44c6-4e0d-adc7-3f5b967b55f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 03:27:36.810134 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:36.810134 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:36.810134 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:36.810134 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:36.810134 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:36.810134 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:36.810134 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:36.810134 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:36.810134 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:36.810134 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:36.810134 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:36.810134 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:36.810134 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:36.810134 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:36.810134 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:36.815014 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:36.815014 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:36.815014 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:36.815014 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:36.815014 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:36.815014 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:36.815014 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:36.815014 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:36.815014 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:36.815014 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:36.815014 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:36.815014 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:36.815014 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:36.815014 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:36.815014 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:36.815014 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:36.815957 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:36.815957 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:36.815957 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:36.815957 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:36.815957 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:36.815957 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:36.815957 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:36.815957 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:36.815957 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:36.815957 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:36.815957 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 03:27:36.815957 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:36.815957 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 249/504] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 03:27:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:36.815957 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31088ccc-44c6-4e0d-adc7-3f5b967b55f3 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:36.837080 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1986bc-43c4-416d-b16f-7dcb8b20b311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:36.837826 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1986bc-43c4-416d-b16f-7dcb8b20b311 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:36.838113 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1986bc-43c4-416d-b16f-7dcb8b20b311 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:36.838716 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1986bc-43c4-416d-b16f-7dcb8b20b311 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:36.900195 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:36.912902 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1986bc-43c4-416d-b16f-7dcb8b20b311 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:36.914928 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1986bc-43c4-416d-b16f-7dcb8b20b311 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:36.921799 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31088ccc-44c6-4e0d-adc7-3f5b967b55f3 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:36.949238 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620becca-0f52-4616-8094-e5c16178062e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:36.949893 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620becca-0f52-4616-8094-e5c16178062e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:36.950174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620becca-0f52-4616-8094-e5c16178062e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:36.950444 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620becca-0f52-4616-8094-e5c16178062e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:36.958733 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620becca-0f52-4616-8094-e5c16178062e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:36.960733 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620becca-0f52-4616-8094-e5c16178062e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:36.971986 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-620becca-0f52-4616-8094-e5c16178062e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 03:27:36.971986 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:36.971986 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:36.971986 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:36.971986 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:36.971986 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:36.971986 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:36.971986 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:36.971986 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:36.971986 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:36.971986 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:36.971986 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:36.971986 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 03:27:36.971986 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 03:27:36.971986 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 03:27:36.971986 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 03:27:36.973073 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:36.973073 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:36.973073 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 03:27:36.973073 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:27:36.973073 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 03:27:36.973073 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:27:36.973073 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:36.973073 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:36.973073 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:36.973073 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:36.973073 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:36.973073 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:36.973073 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:36.973073 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:36.973073 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:36.973073 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:36.973073 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:36.973073 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:36.979437 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:36.979437 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:36.979437 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 03:27:36.979437 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 03:27:36.979437 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 03:27:36.979437 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 03:27:36.979437 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 03:27:36.979437 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 03:27:36.979437 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 03:27:36.979437 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:36.979437 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 250/505] 10.222.0.33 () {56 vars in 1093 bytes} [Fri Sep 16 03:27:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:36.979437 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620becca-0f52-4616-8094-e5c16178062e None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:37.016647 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 256/506] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:27:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 03:27:37.018561 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1986bc-43c4-416d-b16f-7dcb8b20b311 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:37.031290 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:37.070871 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620becca-0f52-4616-8094-e5c16178062e None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:37.103111 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87511a7c-f196-4bb3-98a6-1bf7d6e83586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:37.103560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:37.103779 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87511a7c-f196-4bb3-98a6-1bf7d6e83586 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:37.104063 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87511a7c-f196-4bb3-98a6-1bf7d6e83586 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:37.104337 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87511a7c-f196-4bb3-98a6-1bf7d6e83586 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:37.104960 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87511a7c-f196-4bb3-98a6-1bf7d6e83586 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:37.105256 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87511a7c-f196-4bb3-98a6-1bf7d6e83586 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:37.106656 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87511a7c-f196-4bb3-98a6-1bf7d6e83586 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:37.115159 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1986bc-43c4-416d-b16f-7dcb8b20b311 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:37.118949 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 251/507] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:37.119811 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87511a7c-f196-4bb3-98a6-1bf7d6e83586 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:37.148999 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109004c9-e96c-48c3-aad9-a756e3fd4188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:37.149603 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109004c9-e96c-48c3-aad9-a756e3fd4188 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:37.149911 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109004c9-e96c-48c3-aad9-a756e3fd4188 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:37.150181 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109004c9-e96c-48c3-aad9-a756e3fd4188 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:37.150832 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109004c9-e96c-48c3-aad9-a756e3fd4188 None admin] RBAC: Adding query filter params (name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:37.151130 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109004c9-e96c-48c3-aad9-a756e3fd4188 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:37.152490 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109004c9-e96c-48c3-aad9-a756e3fd4188 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:37.160078 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 257/508] 10.222.0.33 () {56 vars in 1103 bytes} [Fri Sep 16 03:27:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:37.160844 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109004c9-e96c-48c3-aad9-a756e3fd4188 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:37.216588 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87511a7c-f196-4bb3-98a6-1bf7d6e83586 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:37.236404 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:37.250549 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e90355-4be6-43b6-b16e-f3c119ac7067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:37.255320 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e90355-4be6-43b6-b16e-f3c119ac7067 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:37.255320 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e90355-4be6-43b6-b16e-f3c119ac7067 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:37.255320 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e90355-4be6-43b6-b16e-f3c119ac7067 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:37.257150 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109004c9-e96c-48c3-aad9-a756e3fd4188 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:37.261536 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e90355-4be6-43b6-b16e-f3c119ac7067 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:37.263029 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e90355-4be6-43b6-b16e-f3c119ac7067 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:37.279312 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-34e90355-4be6-43b6-b16e-f3c119ac7067 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:37.279312 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:37.279312 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:37.279312 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:37.279312 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:37.279312 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:37.279312 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:37.279312 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:37.279312 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:37.279312 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:37.279312 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:37.279312 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:37.279312 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:27:37.279312 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:27:37.279312 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:27:37.279312 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:27:37.280446 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:37.280446 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:37.280446 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:37.280446 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:37.280446 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:37.280446 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:37.280446 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:37.280446 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:37.280446 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:37.280446 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:37.280446 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:37.280446 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:37.280446 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:37.280446 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:37.280446 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:37.280446 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:37.280446 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:27:37.281484 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:27:37.281484 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:37.281484 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:37.281484 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 252/509] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:27:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:37.282145 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e90355-4be6-43b6-b16e-f3c119ac7067 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:37.295106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058cba5-53ca-4acd-a94e-8361308ce384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:37.295713 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058cba5-53ca-4acd-a94e-8361308ce384 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:37.295989 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058cba5-53ca-4acd-a94e-8361308ce384 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:37.296262 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058cba5-53ca-4acd-a94e-8361308ce384 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:37.296980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058cba5-53ca-4acd-a94e-8361308ce384 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:37.297311 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058cba5-53ca-4acd-a94e-8361308ce384 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:37.298779 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058cba5-53ca-4acd-a94e-8361308ce384 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:37.315728 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 258/510] 10.222.0.33 () {56 vars in 1133 bytes} [Fri Sep 16 03:27:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:37.316512 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058cba5-53ca-4acd-a94e-8361308ce384 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:37.326716 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:37.383597 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e90355-4be6-43b6-b16e-f3c119ac7067 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:37.413569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058cba5-53ca-4acd-a94e-8361308ce384 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:37.415900 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd38d0-fe5f-4b5e-98fc-e5cc7c9bfecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:37.416528 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd38d0-fe5f-4b5e-98fc-e5cc7c9bfecc None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:37.416809 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd38d0-fe5f-4b5e-98fc-e5cc7c9bfecc None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:37.417081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd38d0-fe5f-4b5e-98fc-e5cc7c9bfecc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:37.427219 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd38d0-fe5f-4b5e-98fc-e5cc7c9bfecc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:37.429157 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd38d0-fe5f-4b5e-98fc-e5cc7c9bfecc None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:37.442927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-1bcd38d0-fe5f-4b5e-98fc-e5cc7c9bfecc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:37.442927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:37.442927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:37.442927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:37.442927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:37.442927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:37.442927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:37.442927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:37.442927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:37.442927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:37.442927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:37.442927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:37.442927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:27:37.442927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:27:37.442927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:27:37.442927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:27:37.443821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:37.443821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:37.443821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:37.443821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:37.443821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:37.443821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:37.443821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:37.443821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:37.443821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:37.443821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:37.443821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:37.443821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:37.443821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:37.443821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:37.443821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:37.443821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:37.443821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:27:37.444758 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:27:37.444758 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:37.444758 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:37.444758 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 253/511] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:27:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:37.445474 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd38d0-fe5f-4b5e-98fc-e5cc7c9bfecc None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:37.448282 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8402f6-2288-43e4-97c2-9938e61c445b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:37.449861 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8402f6-2288-43e4-97c2-9938e61c445b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:37.450147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8402f6-2288-43e4-97c2-9938e61c445b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:37.450420 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8402f6-2288-43e4-97c2-9938e61c445b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:37.458261 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8402f6-2288-43e4-97c2-9938e61c445b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:37.459696 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8402f6-2288-43e4-97c2-9938e61c445b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:37.470174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:37.473323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-0f8402f6-2288-43e4-97c2-9938e61c445b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 16 03:27:37.473323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:37.473323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:37.473323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:37.473323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:37.473323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:37.473323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:37.473323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:37.473323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:37.473323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:37.473323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:37.473323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:37.473323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 03:27:37.473323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 03:27:37.473323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 03:27:37.473323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 03:27:37.474275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:37.474275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:37.474275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 03:27:37.474275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:27:37.474275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 03:27:37.474275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:27:37.474275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:37.474275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:37.474275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:37.474275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:37.474275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:37.474275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:37.474275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:37.474275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:37.474275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:37.474275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:37.474275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:37.474275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:37.475181 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:37.475181 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:37.475181 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 03:27:37.475181 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 03:27:37.475181 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 03:27:37.475181 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 03:27:37.475181 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 03:27:37.475181 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 03:27:37.475181 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 16 03:27:37.475181 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:37.479072 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 259/512] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 03:27:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:37.479837 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8402f6-2288-43e4-97c2-9938e61c445b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:37.544124 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd38d0-fe5f-4b5e-98fc-e5cc7c9bfecc None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:37.545522 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:37.576644 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64007ba8-aee8-4bb8-a892-0c8690010200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:37.577406 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64007ba8-aee8-4bb8-a892-0c8690010200 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:37.577829 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64007ba8-aee8-4bb8-a892-0c8690010200 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:37.578199 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64007ba8-aee8-4bb8-a892-0c8690010200 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:37.579092 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8402f6-2288-43e4-97c2-9938e61c445b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:37.588447 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64007ba8-aee8-4bb8-a892-0c8690010200 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:37.589906 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64007ba8-aee8-4bb8-a892-0c8690010200 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:37.604081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-64007ba8-aee8-4bb8-a892-0c8690010200 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:37.604081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:37.604081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:37.604081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:37.604081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:37.604081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:37.604081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:37.604081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:37.604081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:37.604081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:37.604081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:37.604081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:37.604081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:27:37.604081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:27:37.604081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:27:37.604081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:27:37.605166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:37.605166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:37.605166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:37.605166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:37.605166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:37.605166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:37.605166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:37.605166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:37.605166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:37.605166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:37.605166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:37.605166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:37.605166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:37.605166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:37.605166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:37.605166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:37.605166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:27:37.606258 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:27:37.606258 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:37.606258 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:37.606258 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 254/513] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:27:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:37.606258 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64007ba8-aee8-4bb8-a892-0c8690010200 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:37.614940 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08eb0c9-b0e5-4a87-ae3f-4d9d356394c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:37.615542 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08eb0c9-b0e5-4a87-ae3f-4d9d356394c4 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:37.615826 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08eb0c9-b0e5-4a87-ae3f-4d9d356394c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:37.616104 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08eb0c9-b0e5-4a87-ae3f-4d9d356394c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:37.617299 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08eb0c9-b0e5-4a87-ae3f-4d9d356394c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:37.617603 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08eb0c9-b0e5-4a87-ae3f-4d9d356394c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:37.619009 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08eb0c9-b0e5-4a87-ae3f-4d9d356394c4 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:37.630515 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 260/514] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:37.631374 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08eb0c9-b0e5-4a87-ae3f-4d9d356394c4 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:37.681387 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:37.705069 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64007ba8-aee8-4bb8-a892-0c8690010200 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:37.732268 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08eb0c9-b0e5-4a87-ae3f-4d9d356394c4 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:37.739074 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1243963-4329-4de2-92e1-8e5f07f215af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:37.739754 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1243963-4329-4de2-92e1-8e5f07f215af None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:37.740039 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1243963-4329-4de2-92e1-8e5f07f215af None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:37.740316 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1243963-4329-4de2-92e1-8e5f07f215af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:37.758513 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:37.766308 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba884f2-eeed-42cb-b215-0e354c091309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:37.766913 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba884f2-eeed-42cb-b215-0e354c091309 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:37.767217 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba884f2-eeed-42cb-b215-0e354c091309 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:37.767517 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba884f2-eeed-42cb-b215-0e354c091309 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:37.768230 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba884f2-eeed-42cb-b215-0e354c091309 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:37.768559 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba884f2-eeed-42cb-b215-0e354c091309 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:37.770006 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba884f2-eeed-42cb-b215-0e354c091309 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:37.781720 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 261/515] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:37.782513 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba884f2-eeed-42cb-b215-0e354c091309 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:37.813790 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1243963-4329-4de2-92e1-8e5f07f215af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:37.815276 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1243963-4329-4de2-92e1-8e5f07f215af None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:37.880476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba884f2-eeed-42cb-b215-0e354c091309 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:37.888975 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:37.912047 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 255/516] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:27:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 03:27:37.912980 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1243963-4329-4de2-92e1-8e5f07f215af None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:37.914121 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e30c2-4c27-43e0-a1d7-96fc21090a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:37.914910 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e30c2-4c27-43e0-a1d7-96fc21090a79 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:37.915330 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e30c2-4c27-43e0-a1d7-96fc21090a79 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:37.915763 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e30c2-4c27-43e0-a1d7-96fc21090a79 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:37.916483 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e30c2-4c27-43e0-a1d7-96fc21090a79 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:37.916793 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e30c2-4c27-43e0-a1d7-96fc21090a79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:37.918258 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e30c2-4c27-43e0-a1d7-96fc21090a79 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:37.936852 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 262/517] 10.222.0.33 () {56 vars in 1139 bytes} [Fri Sep 16 03:27:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:37.937853 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e30c2-4c27-43e0-a1d7-96fc21090a79 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:37.983912 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:38.015171 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1243963-4329-4de2-92e1-8e5f07f215af None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:38.035120 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e30c2-4c27-43e0-a1d7-96fc21090a79 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:38.047922 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea2261-9aa2-4841-910e-b8291e17871f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:38.048522 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea2261-9aa2-4841-910e-b8291e17871f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:38.048795 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea2261-9aa2-4841-910e-b8291e17871f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:38.049058 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea2261-9aa2-4841-910e-b8291e17871f None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:38.049710 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea2261-9aa2-4841-910e-b8291e17871f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:38.050010 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea2261-9aa2-4841-910e-b8291e17871f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:38.051374 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea2261-9aa2-4841-910e-b8291e17871f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:38.062530 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 256/518] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:38.066481 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea2261-9aa2-4841-910e-b8291e17871f None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:38.068293 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f883f19-9d04-4071-840f-02ffe99d8e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:38.068901 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f883f19-9d04-4071-840f-02ffe99d8e74 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:38.069181 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f883f19-9d04-4071-840f-02ffe99d8e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:38.069562 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f883f19-9d04-4071-840f-02ffe99d8e74 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:38.070247 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f883f19-9d04-4071-840f-02ffe99d8e74 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:38.071691 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f883f19-9d04-4071-840f-02ffe99d8e74 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:38.100148 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:38.161458 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea2261-9aa2-4841-910e-b8291e17871f None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:38.164415 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 263/519] 10.222.0.33 () {60 vars in 1132 bytes} [Fri Sep 16 03:27:37 2022] POST /identity/v3/users => generated 247 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:27:38.165304 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f883f19-9d04-4071-840f-02ffe99d8e74 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:38.200942 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ebc362-8b63-437c-8ae5-09b017ee3f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:38.201526 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebc362-8b63-437c-8ae5-09b017ee3f41 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:38.201831 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebc362-8b63-437c-8ae5-09b017ee3f41 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:38.202225 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebc362-8b63-437c-8ae5-09b017ee3f41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:38.209839 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ebc362-8b63-437c-8ae5-09b017ee3f41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:38.211986 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ebc362-8b63-437c-8ae5-09b017ee3f41 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:38.227454 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-18ebc362-8b63-437c-8ae5-09b017ee3f41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:27:38.227454 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:38.227454 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:38.227454 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:38.227454 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:38.227454 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:38.227454 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:38.227454 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:38.227454 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:38.227454 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:38.227454 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:38.227454 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:38.227454 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 03:27:38.227454 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 03:27:38.227454 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 03:27:38.228361 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 03:27:38.228361 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:38.228361 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:38.228361 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:38.228361 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:38.228361 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:38.228361 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:38.228361 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:38.228361 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:38.228361 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:38.228361 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:38.228361 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:38.228361 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:38.228361 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:38.228361 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:38.228361 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:38.228361 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:38.229575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 03:27:38.229575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 03:27:38.229575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 03:27:38.229575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 03:27:38.229575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 03:27:38.229575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 03:27:38.229575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:27:38.229575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:38.229575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 257/520] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:27:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:38.229575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ebc362-8b63-437c-8ae5-09b017ee3f41 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:38.276773 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f883f19-9d04-4071-840f-02ffe99d8e74 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:38.279264 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:38.316907 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ffec1-17c2-4cad-a835-9a3293de538e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:38.317670 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ffec1-17c2-4cad-a835-9a3293de538e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:38.318064 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ffec1-17c2-4cad-a835-9a3293de538e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:38.318277 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ffec1-17c2-4cad-a835-9a3293de538e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:38.330894 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ffec1-17c2-4cad-a835-9a3293de538e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:38.332357 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ffec1-17c2-4cad-a835-9a3293de538e None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:38.342620 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:38.348350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-f04ffec1-17c2-4cad-a835-9a3293de538e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:38.348350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:38.348350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:38.348350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:38.348350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:38.348350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:38.348350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:38.348350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:38.348350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:38.348350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:38.348350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:38.348350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:38.348350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:27:38.348350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:27:38.348350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:27:38.348350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:27:38.350367 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:38.350367 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:38.350367 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:38.350367 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:38.350367 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:38.350367 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:38.350367 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:38.350367 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:38.350367 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:38.350367 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:38.350367 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:38.350367 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:38.350367 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:38.350367 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:38.350367 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:38.350367 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:38.350367 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:27:38.352715 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:27:38.352715 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:38.352715 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:38.352919 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ebc362-8b63-437c-8ae5-09b017ee3f41 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:38.352990 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 264/521] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:27:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:38.355352 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ffec1-17c2-4cad-a835-9a3293de538e None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:38.392535 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6bc2c5-b9b0-4b5a-9069-790ec2a252b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:38.393247 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bc2c5-b9b0-4b5a-9069-790ec2a252b1 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:38.393594 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bc2c5-b9b0-4b5a-9069-790ec2a252b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:38.393963 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bc2c5-b9b0-4b5a-9069-790ec2a252b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:38.468125 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6bc2c5-b9b0-4b5a-9069-790ec2a252b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:38.469597 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6bc2c5-b9b0-4b5a-9069-790ec2a252b1 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:38.473313 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ffec1-17c2-4cad-a835-9a3293de538e None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:38.515439 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de523d5-1dfb-41b5-9d16-b6e45ca2d515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:38.516548 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de523d5-1dfb-41b5-9d16-b6e45ca2d515 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:38.517222 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de523d5-1dfb-41b5-9d16-b6e45ca2d515 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:38.517698 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de523d5-1dfb-41b5-9d16-b6e45ca2d515 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:38.528757 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de523d5-1dfb-41b5-9d16-b6e45ca2d515 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:38.531360 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de523d5-1dfb-41b5-9d16-b6e45ca2d515 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:38.543565 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-5de523d5-1dfb-41b5-9d16-b6e45ca2d515 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 03:27:38.543565 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:38.543565 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:38.543565 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:38.543565 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:38.543565 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:38.543565 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:38.543565 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:38.543565 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:38.543565 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:38.543565 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:38.543565 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:38.543565 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 03:27:38.543565 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 03:27:38.543565 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 03:27:38.543565 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 03:27:38.544693 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:38.544693 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:38.544693 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 03:27:38.544693 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:27:38.544693 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 03:27:38.544693 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:27:38.544693 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:38.544693 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:38.544693 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:38.544693 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:38.544693 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:38.544693 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:38.544693 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:38.544693 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:38.544693 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:38.544693 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:38.544693 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:38.544693 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:38.546625 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:38.546625 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:38.546625 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 03:27:38.546625 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 03:27:38.546625 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 03:27:38.546625 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 03:27:38.546625 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 03:27:38.546625 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 03:27:38.546625 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 03:27:38.546625 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:38.546625 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 265/522] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:27:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:38.546625 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de523d5-1dfb-41b5-9d16-b6e45ca2d515 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:38.567652 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:38.568133 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:38.575245 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 258/523] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:27:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 03:27:38.576111 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6bc2c5-b9b0-4b5a-9069-790ec2a252b1 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:38.660698 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de523d5-1dfb-41b5-9d16-b6e45ca2d515 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:38.681857 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6bc2c5-b9b0-4b5a-9069-790ec2a252b1 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:38.703710 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b2270-b01b-415f-bec4-0d7e146ebfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:38.704486 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b2270-b01b-415f-bec4-0d7e146ebfd4 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:38.704766 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b2270-b01b-415f-bec4-0d7e146ebfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:38.705338 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b2270-b01b-415f-bec4-0d7e146ebfd4 None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:38.706074 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b2270-b01b-415f-bec4-0d7e146ebfd4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:38.706382 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b2270-b01b-415f-bec4-0d7e146ebfd4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:38.708246 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b2270-b01b-415f-bec4-0d7e146ebfd4 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:38.723670 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f21b8e4-738f-4b1a-a069-4d714c5066a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:38.724225 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21b8e4-738f-4b1a-a069-4d714c5066a2 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:38.724664 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21b8e4-738f-4b1a-a069-4d714c5066a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:38.724949 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21b8e4-738f-4b1a-a069-4d714c5066a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:38.725723 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f21b8e4-738f-4b1a-a069-4d714c5066a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:38.726024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f21b8e4-738f-4b1a-a069-4d714c5066a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:38.726722 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 266/524] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 03:27:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:38.727323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b2270-b01b-415f-bec4-0d7e146ebfd4 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:38.732427 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f21b8e4-738f-4b1a-a069-4d714c5066a2 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:38.749153 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 259/525] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:38.749153 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f21b8e4-738f-4b1a-a069-4d714c5066a2 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:38.804501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:38.812743 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:38.837470 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b2270-b01b-415f-bec4-0d7e146ebfd4 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:38.850614 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f21b8e4-738f-4b1a-a069-4d714c5066a2 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:38.872123 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f512d9-1505-478c-a7bc-153561410c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:38.872867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f512d9-1505-478c-a7bc-153561410c89 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:38.873206 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f512d9-1505-478c-a7bc-153561410c89 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:38.873486 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f512d9-1505-478c-a7bc-153561410c89 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:38.874274 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f512d9-1505-478c-a7bc-153561410c89 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:38.874590 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f512d9-1505-478c-a7bc-153561410c89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:38.876104 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f512d9-1505-478c-a7bc-153561410c89 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:38.887166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e0195-a491-4a1f-9c16-d97c77bbb4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:38.887806 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e0195-a491-4a1f-9c16-d97c77bbb4b4 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:38.888084 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e0195-a491-4a1f-9c16-d97c77bbb4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:38.888353 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e0195-a491-4a1f-9c16-d97c77bbb4b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:38.899364 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 267/526] 10.222.0.33 () {56 vars in 1137 bytes} [Fri Sep 16 03:27:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:38.899364 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f512d9-1505-478c-a7bc-153561410c89 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:38.904516 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e0195-a491-4a1f-9c16-d97c77bbb4b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:38.906058 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e0195-a491-4a1f-9c16-d97c77bbb4b4 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:38.920610 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-152e0195-a491-4a1f-9c16-d97c77bbb4b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:38.920610 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:38.920610 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:38.920610 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:38.920610 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:38.920610 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:38.920610 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:38.920610 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:38.920610 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:38.920610 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:38.920610 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:38.920610 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:38.920610 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:27:38.920610 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:27:38.920610 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:27:38.920610 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:27:38.921549 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:38.921549 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:38.921549 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:38.921549 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:38.921549 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:38.921549 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:38.921549 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:38.921549 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:38.921549 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:38.921549 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:38.921549 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:38.921549 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:38.921549 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:38.921549 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:38.921549 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:38.921549 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:38.921549 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:27:38.922423 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:27:38.922423 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:38.922423 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:38.922423 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 260/527] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:27:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:38.922423 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e0195-a491-4a1f-9c16-d97c77bbb4b4 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:39.008846 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f512d9-1505-478c-a7bc-153561410c89 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:39.028648 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e0195-a491-4a1f-9c16-d97c77bbb4b4 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:39.038544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:39.039268 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:39.044356 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f01168-16a4-4201-b490-e35e63111b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:39.044882 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f01168-16a4-4201-b490-e35e63111b4e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:39.045162 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f01168-16a4-4201-b490-e35e63111b4e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:39.045434 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f01168-16a4-4201-b490-e35e63111b4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:39.046183 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f01168-16a4-4201-b490-e35e63111b4e None admin] RBAC: Adding query filter params (role.id=8a338e321ece4061b4b30d6231167b4e, scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2, user.id=aafb065e06c3481bbed8d98e893766ee) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:39.046490 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f01168-16a4-4201-b490-e35e63111b4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:39.048020 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f01168-16a4-4201-b490-e35e63111b4e None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:39.061854 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 268/528] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:27:38 2022] GET /identity/v3/role_assignments?user.id=aafb065e06c3481bbed8d98e893766ee&scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2&role.id=8a338e321ece4061b4b30d6231167b4e => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:39.061854 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f01168-16a4-4201-b490-e35e63111b4e None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:39.073861 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cccdeb-5d7c-4d1a-90af-f05d5b30a6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:39.074930 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cccdeb-5d7c-4d1a-90af-f05d5b30a6ac None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:39.075299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cccdeb-5d7c-4d1a-90af-f05d5b30a6ac None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:39.075655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cccdeb-5d7c-4d1a-90af-f05d5b30a6ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:39.083393 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cccdeb-5d7c-4d1a-90af-f05d5b30a6ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:39.085538 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cccdeb-5d7c-4d1a-90af-f05d5b30a6ac None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:39.098380 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-a6cccdeb-5d7c-4d1a-90af-f05d5b30a6ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:27:39.098380 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:39.098380 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:39.098380 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:39.098380 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:39.098380 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:39.098380 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:39.098380 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:39.098380 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:39.098380 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:39.098380 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:39.098380 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:39.098380 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 03:27:39.098380 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 03:27:39.098380 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 03:27:39.099328 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 03:27:39.099328 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:39.099328 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:39.099328 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:39.099328 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:39.099328 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:39.099328 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:39.099328 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:39.099328 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:39.099328 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:39.099328 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:39.099328 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:39.099328 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:39.099328 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:39.099328 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:39.099328 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:39.099328 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:39.100200 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 03:27:39.100200 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 03:27:39.100200 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 03:27:39.100200 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 03:27:39.100200 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 03:27:39.100200 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 03:27:39.100200 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:27:39.100200 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:39.100200 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 261/529] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:27:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:39.101473 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cccdeb-5d7c-4d1a-90af-f05d5b30a6ac None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:39.200988 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f01168-16a4-4201-b490-e35e63111b4e None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:39.215608 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cccdeb-5d7c-4d1a-90af-f05d5b30a6ac None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:39.249912 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eac5cf-f857-452a-a382-5da0d9d8e3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:39.250542 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eac5cf-f857-452a-a382-5da0d9d8e3e2 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:39.250825 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eac5cf-f857-452a-a382-5da0d9d8e3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:39.251353 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eac5cf-f857-452a-a382-5da0d9d8e3e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:39.260384 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ab647-72d3-4cdb-becd-bbad358ec192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:39.261344 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ab647-72d3-4cdb-becd-bbad358ec192 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:39.261806 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ab647-72d3-4cdb-becd-bbad358ec192 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:39.262207 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ab647-72d3-4cdb-becd-bbad358ec192 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:39.263110 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ab647-72d3-4cdb-becd-bbad358ec192 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:39.263555 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ab647-72d3-4cdb-becd-bbad358ec192 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:39.265186 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ab647-72d3-4cdb-becd-bbad358ec192 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:39.279606 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 262/530] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:39.280481 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ab647-72d3-4cdb-becd-bbad358ec192 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:39.311569 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:39.324960 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:39.332220 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eac5cf-f857-452a-a382-5da0d9d8e3e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:39.333967 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eac5cf-f857-452a-a382-5da0d9d8e3e2 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:39.402911 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ab647-72d3-4cdb-becd-bbad358ec192 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:39.444222 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 269/531] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:27:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 03:27:39.445101 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eac5cf-f857-452a-a382-5da0d9d8e3e2 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:39.452635 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc674f31-6e9e-4f77-a59c-677f644aec55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:39.453259 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc674f31-6e9e-4f77-a59c-677f644aec55 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:39.453539 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc674f31-6e9e-4f77-a59c-677f644aec55 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:39.453857 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc674f31-6e9e-4f77-a59c-677f644aec55 None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:39.454538 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc674f31-6e9e-4f77-a59c-677f644aec55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:39.455370 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc674f31-6e9e-4f77-a59c-677f644aec55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:39.456853 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc674f31-6e9e-4f77-a59c-677f644aec55 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:39.481282 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 263/532] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 03:27:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:39.482442 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc674f31-6e9e-4f77-a59c-677f644aec55 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:39.558785 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:39.565749 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eac5cf-f857-452a-a382-5da0d9d8e3e2 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:39.586560 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:39.604243 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc674f31-6e9e-4f77-a59c-677f644aec55 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:39.605156 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7d5a1-8fac-4b52-bfda-1ae77f1ef623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:39.605955 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7d5a1-8fac-4b52-bfda-1ae77f1ef623 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:39.606360 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7d5a1-8fac-4b52-bfda-1ae77f1ef623 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:39.606865 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7d5a1-8fac-4b52-bfda-1ae77f1ef623 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:39.615479 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f7d5a1-8fac-4b52-bfda-1ae77f1ef623 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:39.617411 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f7d5a1-8fac-4b52-bfda-1ae77f1ef623 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:39.631886 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-13f7d5a1-8fac-4b52-bfda-1ae77f1ef623 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:27:39.631886 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:39.631886 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:39.631886 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:39.631886 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:39.631886 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:39.631886 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:39.631886 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:39.631886 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:39.631886 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:39.631886 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:39.631886 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:39.631886 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 03:27:39.631886 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 03:27:39.631886 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 03:27:39.632755 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 03:27:39.632755 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:39.632755 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:39.632755 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:39.632755 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:39.632755 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:39.632755 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:39.632755 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:39.632755 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:39.632755 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:39.632755 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:39.632755 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:39.632755 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:39.632755 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:39.632755 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:39.632755 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:39.632755 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:39.633602 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 03:27:39.633602 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 03:27:39.633602 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 03:27:39.633602 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 03:27:39.633602 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 03:27:39.633602 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 03:27:39.633602 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:27:39.633602 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:39.633602 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 270/533] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:27:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:39.634812 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7d5a1-8fac-4b52-bfda-1ae77f1ef623 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:39.650352 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b8cc08-0ee8-4b9a-bc39-f263ff9de854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:39.651262 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8cc08-0ee8-4b9a-bc39-f263ff9de854 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:39.652015 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8cc08-0ee8-4b9a-bc39-f263ff9de854 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:39.652941 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8cc08-0ee8-4b9a-bc39-f263ff9de854 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:39.667302 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b8cc08-0ee8-4b9a-bc39-f263ff9de854 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:39.669914 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b8cc08-0ee8-4b9a-bc39-f263ff9de854 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:39.690233 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-e4b8cc08-0ee8-4b9a-bc39-f263ff9de854 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:39.690233 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:39.690233 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:39.690233 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:39.690233 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:39.690233 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:39.690233 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:39.690233 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:39.690233 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:39.690233 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:39.690233 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:39.690233 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:39.690233 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:27:39.690233 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:27:39.690233 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:27:39.690233 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:27:39.691156 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:39.691156 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:39.691156 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:39.691156 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:39.691156 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:39.691156 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:39.691156 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:39.691156 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:39.691156 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:39.691156 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:39.691156 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:39.691156 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:39.691156 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:39.691156 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:39.691156 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:39.691156 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:39.691156 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:27:39.692066 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:27:39.692066 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:39.692066 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:39.692066 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 264/534] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:27:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:39.692278 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b8cc08-0ee8-4b9a-bc39-f263ff9de854 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:39.757278 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7d5a1-8fac-4b52-bfda-1ae77f1ef623 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:39.795981 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0648d7-bbec-41cf-8ecb-3458e2b23690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:39.796589 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0648d7-bbec-41cf-8ecb-3458e2b23690 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:39.796870 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0648d7-bbec-41cf-8ecb-3458e2b23690 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:39.797142 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0648d7-bbec-41cf-8ecb-3458e2b23690 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:39.797898 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0648d7-bbec-41cf-8ecb-3458e2b23690 None admin] RBAC: Adding query filter params (role.id=8a338e321ece4061b4b30d6231167b4e, scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2, user.id=c09d1a4ac8b64921a6b05fcd567bb770) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:39.798206 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0648d7-bbec-41cf-8ecb-3458e2b23690 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:39.799663 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0648d7-bbec-41cf-8ecb-3458e2b23690 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:39.805661 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 271/535] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:27:39 2022] GET /identity/v3/role_assignments?user.id=c09d1a4ac8b64921a6b05fcd567bb770&scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2&role.id=8a338e321ece4061b4b30d6231167b4e => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:39.806465 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0648d7-bbec-41cf-8ecb-3458e2b23690 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:39.843753 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b8cc08-0ee8-4b9a-bc39-f263ff9de854 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:39.848196 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:39.926835 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e16cf7-2615-4ae5-adfe-13e4a2d7c38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:39.929513 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e16cf7-2615-4ae5-adfe-13e4a2d7c38f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:39.930033 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e16cf7-2615-4ae5-adfe-13e4a2d7c38f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:39.950707 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e16cf7-2615-4ae5-adfe-13e4a2d7c38f None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:39.950707 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e16cf7-2615-4ae5-adfe-13e4a2d7c38f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:39.950707 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e16cf7-2615-4ae5-adfe-13e4a2d7c38f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:39.950707 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e16cf7-2615-4ae5-adfe-13e4a2d7c38f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:39.960643 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:39.966436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 265/536] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 03:27:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:39.972583 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e16cf7-2615-4ae5-adfe-13e4a2d7c38f None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:40.015923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0648d7-bbec-41cf-8ecb-3458e2b23690 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:40.055058 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add06195-3620-447f-a458-4c538935cc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:40.055834 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add06195-3620-447f-a458-4c538935cc48 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:40.056391 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add06195-3620-447f-a458-4c538935cc48 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:40.056789 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add06195-3620-447f-a458-4c538935cc48 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:40.057550 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add06195-3620-447f-a458-4c538935cc48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:40.057986 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add06195-3620-447f-a458-4c538935cc48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:40.059674 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add06195-3620-447f-a458-4c538935cc48 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:40.074048 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 272/537] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:40.079910 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add06195-3620-447f-a458-4c538935cc48 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:40.122864 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e16cf7-2615-4ae5-adfe-13e4a2d7c38f None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:40.187735 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6575a-8fb7-4666-a995-769121c1d8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:40.188346 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6575a-8fb7-4666-a995-769121c1d8dc None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:40.188628 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6575a-8fb7-4666-a995-769121c1d8dc None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:40.188903 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6575a-8fb7-4666-a995-769121c1d8dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:40.189647 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f6575a-8fb7-4666-a995-769121c1d8dc None admin] RBAC: Adding query filter params (role.id=8a338e321ece4061b4b30d6231167b4e, scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2, user.id=ae04099495a24a04801563cf18dc5626) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:40.189956 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f6575a-8fb7-4666-a995-769121c1d8dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:40.191402 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f6575a-8fb7-4666-a995-769121c1d8dc None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:40.205594 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 266/538] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:27:39 2022] GET /identity/v3/role_assignments?user.id=ae04099495a24a04801563cf18dc5626&scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2&role.id=8a338e321ece4061b4b30d6231167b4e => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:40.221402 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:40.242540 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add06195-3620-447f-a458-4c538935cc48 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:40.290505 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a0b79-c985-40da-830e-4f5e69f7b964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:40.291173 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a0b79-c985-40da-830e-4f5e69f7b964 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:40.291450 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a0b79-c985-40da-830e-4f5e69f7b964 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:40.291722 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a0b79-c985-40da-830e-4f5e69f7b964 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:40.304172 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a0b79-c985-40da-830e-4f5e69f7b964 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:40.305734 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a0b79-c985-40da-830e-4f5e69f7b964 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:40.322326 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-af4a0b79-c985-40da-830e-4f5e69f7b964 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:27:40.322326 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:40.322326 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:40.322326 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:40.322326 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:40.322326 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:40.322326 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:40.322326 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:40.322326 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:40.322326 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:40.322326 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:40.322326 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:40.322326 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 03:27:40.322326 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 03:27:40.322326 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 03:27:40.324452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 03:27:40.324452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:40.324452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:40.324452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:40.324452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:40.324452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:40.324452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:40.324452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:40.324452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:40.324452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:40.324452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:40.324452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:40.324452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:40.324452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:40.324452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:40.324452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:40.324452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:40.326586 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 03:27:40.326586 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 03:27:40.326586 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 03:27:40.326586 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 03:27:40.326586 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 03:27:40.326586 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 03:27:40.326586 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:27:40.326586 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:40.329665 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 273/539] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:27:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:27:40.333616 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6575a-8fb7-4666-a995-769121c1d8dc None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:40.404979 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:40.460689 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6575a-8fb7-4666-a995-769121c1d8dc None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:40.497755 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44c4f7-2d78-4c60-a297-9ba7a4fe4aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:40.498761 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44c4f7-2d78-4c60-a297-9ba7a4fe4aea None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:40.499256 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44c4f7-2d78-4c60-a297-9ba7a4fe4aea None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:40.499375 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233716d-7f34-4427-a983-b4d2a97e1b17 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:40.499579 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233716d-7f34-4427-a983-b4d2a97e1b17 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:40.499853 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233716d-7f34-4427-a983-b4d2a97e1b17 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:40.500228 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44c4f7-2d78-4c60-a297-9ba7a4fe4aea None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:40.501123 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44c4f7-2d78-4c60-a297-9ba7a4fe4aea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:40.501457 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 274/540] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:40.501883 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44c4f7-2d78-4c60-a297-9ba7a4fe4aea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:40.503534 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44c4f7-2d78-4c60-a297-9ba7a4fe4aea None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:40.507433 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff65c82-cf25-4a4b-9fdd-993b65e092e8 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:40.507717 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff65c82-cf25-4a4b-9fdd-993b65e092e8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:40.507988 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff65c82-cf25-4a4b-9fdd-993b65e092e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:40.517682 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 267/541] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 03:27:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:40.524273 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44c4f7-2d78-4c60-a297-9ba7a4fe4aea None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:40.540623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-7ff65c82-cf25-4a4b-9fdd-993b65e092e8 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:40.542952 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7ff65c82-cf25-4a4b-9fdd-993b65e092e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:40.644251 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 275/542] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 03:27:40.673915 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44c4f7-2d78-4c60-a297-9ba7a4fe4aea None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:40.711152 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:40.729133 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e78d64-c3a0-4eff-a94a-cc56d409a735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:40.729782 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e78d64-c3a0-4eff-a94a-cc56d409a735 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:40.730699 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e78d64-c3a0-4eff-a94a-cc56d409a735 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:40.730699 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e78d64-c3a0-4eff-a94a-cc56d409a735 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:40.731212 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e78d64-c3a0-4eff-a94a-cc56d409a735 None admin] RBAC: Adding query filter params (role.id=8a338e321ece4061b4b30d6231167b4e, scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2, user.id=d193a353763e43d0b5e8b49702f09faa) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:40.731526 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e78d64-c3a0-4eff-a94a-cc56d409a735 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:40.733086 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e78d64-c3a0-4eff-a94a-cc56d409a735 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:40.738980 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 268/543] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:27:40 2022] GET /identity/v3/role_assignments?user.id=d193a353763e43d0b5e8b49702f09faa&scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2&role.id=8a338e321ece4061b4b30d6231167b4e => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:27:41.022098 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff65c82-cf25-4a4b-9fdd-993b65e092e8 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:41.117900 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:41.156693 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff65c82-cf25-4a4b-9fdd-993b65e092e8 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:41.204442 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6605387-9b2f-4b2f-8885-151a80eb22fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:41.205084 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6605387-9b2f-4b2f-8885-151a80eb22fa None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:41.205364 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6605387-9b2f-4b2f-8885-151a80eb22fa None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:41.205655 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6605387-9b2f-4b2f-8885-151a80eb22fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:41.223916 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6605387-9b2f-4b2f-8885-151a80eb22fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:41.228847 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-e6605387-9b2f-4b2f-8885-151a80eb22fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 03:27:41.228847 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:41.228847 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:41.228847 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:41.228847 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:41.228847 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:41.228847 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:41.228847 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:41.228847 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:41.228847 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:41.228847 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:41.228847 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:41.228847 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:41.228847 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:41.228847 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:41.228847 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:41.230926 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:41.230926 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:41.230926 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:41.230926 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:41.230926 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:41.230926 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:41.230926 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:41.230926 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:41.230926 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:41.230926 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:41.230926 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:41.230926 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:41.230926 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:41.230926 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:41.230926 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:41.230926 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:41.232867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:41.232867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:41.232867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:41.232867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:41.232867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:41.232867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:41.232867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:41.232867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:41.232867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:41.232867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:41.232867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 03:27:41.232867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:41.232867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 276/544] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 03:27:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:41.237670 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e78d64-c3a0-4eff-a94a-cc56d409a735 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:41.367911 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e78d64-c3a0-4eff-a94a-cc56d409a735 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:41.422685 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219999b-f621-4077-8d06-4df4f86305db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:41.423304 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219999b-f621-4077-8d06-4df4f86305db None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:41.423588 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219999b-f621-4077-8d06-4df4f86305db None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:41.423864 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219999b-f621-4077-8d06-4df4f86305db None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:41.424528 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8219999b-f621-4077-8d06-4df4f86305db None admin] RBAC: Adding query filter params (name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:41.424833 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8219999b-f621-4077-8d06-4df4f86305db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:41.426244 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8219999b-f621-4077-8d06-4df4f86305db None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:41.436892 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 269/545] 10.222.0.33 () {56 vars in 1103 bytes} [Fri Sep 16 03:27:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:41.442537 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6605387-9b2f-4b2f-8885-151a80eb22fa None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:41.573589 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6605387-9b2f-4b2f-8885-151a80eb22fa None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:41.605989 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:41.609996 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd483a1-8f36-4d2f-ab81-e23a3139d4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:41.610638 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd483a1-8f36-4d2f-ab81-e23a3139d4b9 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:41.610984 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd483a1-8f36-4d2f-ab81-e23a3139d4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:41.611267 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd483a1-8f36-4d2f-ab81-e23a3139d4b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:41.628360 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd483a1-8f36-4d2f-ab81-e23a3139d4b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:41.628360 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd483a1-8f36-4d2f-ab81-e23a3139d4b9 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:41.639119 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-bbd483a1-8f36-4d2f-ab81-e23a3139d4b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:41.639119 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:41.639119 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:41.639119 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:41.639119 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:41.639119 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:41.639119 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:41.639119 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:41.639119 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:41.639119 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:41.639119 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:41.639119 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:41.639119 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:27:41.639119 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:27:41.639119 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:27:41.639119 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:27:41.640149 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:41.640149 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:41.640149 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:41.640149 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:41.640149 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:41.640149 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:41.640149 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:41.640149 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:41.640149 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:41.640149 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:41.640149 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:41.640149 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:41.640149 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:41.640149 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:41.640149 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:41.640149 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:41.640149 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:27:41.641593 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:27:41.641593 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:41.641593 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:41.641593 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 277/546] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:27:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:41.646390 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219999b-f621-4077-8d06-4df4f86305db None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:41.713504 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:41.765065 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219999b-f621-4077-8d06-4df4f86305db None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:41.783543 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25c321-4608-490c-ba50-36e2803682cd None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:41.783828 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25c321-4608-490c-ba50-36e2803682cd None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:41.784114 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25c321-4608-490c-ba50-36e2803682cd None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:41.785458 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 278/547] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 03:27:41.790750 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e327232-315d-4fcb-8b78-b5e0aae139b8 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:41.791205 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e327232-315d-4fcb-8b78-b5e0aae139b8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:41.791487 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e327232-315d-4fcb-8b78-b5e0aae139b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:41.810402 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-7e327232-315d-4fcb-8b78-b5e0aae139b8 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:41.811678 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7e327232-315d-4fcb-8b78-b5e0aae139b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:41.820259 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0283cdf-b77b-40fb-97a4-d143459ed95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:41.820877 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0283cdf-b77b-40fb-97a4-d143459ed95e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:41.821143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0283cdf-b77b-40fb-97a4-d143459ed95e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:41.821426 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0283cdf-b77b-40fb-97a4-d143459ed95e None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:41.822107 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0283cdf-b77b-40fb-97a4-d143459ed95e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:41.822476 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0283cdf-b77b-40fb-97a4-d143459ed95e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:41.823919 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0283cdf-b77b-40fb-97a4-d143459ed95e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:41.850109 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 270/548] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:41.854466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0283cdf-b77b-40fb-97a4-d143459ed95e None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:41.964968 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 279/549] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:27:42.024282 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0283cdf-b77b-40fb-97a4-d143459ed95e None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:42.061538 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:42.093996 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17f1f3-dbdd-43b0-9a4c-eec656999b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:42.095045 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17f1f3-dbdd-43b0-9a4c-eec656999b38 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:42.095528 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17f1f3-dbdd-43b0-9a4c-eec656999b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:42.095995 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17f1f3-dbdd-43b0-9a4c-eec656999b38 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:42.107129 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a17f1f3-dbdd-43b0-9a4c-eec656999b38 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:42.108818 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a17f1f3-dbdd-43b0-9a4c-eec656999b38 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:42.123854 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-1a17f1f3-dbdd-43b0-9a4c-eec656999b38 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 16 03:27:42.123854 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:42.123854 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:42.123854 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:42.123854 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:42.123854 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:42.123854 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:42.123854 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:42.123854 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:42.123854 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:42.123854 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:42.123854 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:42.123854 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 03:27:42.123854 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 03:27:42.123854 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 03:27:42.123854 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 03:27:42.124764 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:42.124764 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:42.124764 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 03:27:42.124764 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:27:42.124764 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 03:27:42.124764 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:27:42.124764 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:42.124764 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:42.124764 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:42.124764 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:42.124764 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:42.124764 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:42.124764 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:42.124764 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:42.124764 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:42.124764 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:42.124764 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:42.124764 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:42.125729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:42.125729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:42.125729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 03:27:42.125729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 03:27:42.125729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 03:27:42.125729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 03:27:42.125729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 03:27:42.125729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 03:27:42.125729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 16 03:27:42.125729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:42.128320 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 271/550] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 03:27:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:42.134175 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e327232-315d-4fcb-8b78-b5e0aae139b8 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:42.247582 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e327232-315d-4fcb-8b78-b5e0aae139b8 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:42.250722 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17f1f3-dbdd-43b0-9a4c-eec656999b38 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:42.263869 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:42.310483 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350ab84-47aa-4fb3-a2ce-a9f06fd56c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:42.311127 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350ab84-47aa-4fb3-a2ce-a9f06fd56c38 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:42.311414 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350ab84-47aa-4fb3-a2ce-a9f06fd56c38 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:42.311688 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350ab84-47aa-4fb3-a2ce-a9f06fd56c38 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:42.312454 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350ab84-47aa-4fb3-a2ce-a9f06fd56c38 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:42.312770 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350ab84-47aa-4fb3-a2ce-a9f06fd56c38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:42.314309 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350ab84-47aa-4fb3-a2ce-a9f06fd56c38 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:42.352385 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 280/551] 10.222.0.33 () {56 vars in 1135 bytes} [Fri Sep 16 03:27:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:27:42.358273 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350ab84-47aa-4fb3-a2ce-a9f06fd56c38 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:42.395231 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17f1f3-dbdd-43b0-9a4c-eec656999b38 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:42.455453 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06d59a-8324-47d0-b629-26b07db2565e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:42.456102 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06d59a-8324-47d0-b629-26b07db2565e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:42.456386 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06d59a-8324-47d0-b629-26b07db2565e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:42.456663 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06d59a-8324-47d0-b629-26b07db2565e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:42.469314 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad06d59a-8324-47d0-b629-26b07db2565e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:42.475586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-ad06d59a-8324-47d0-b629-26b07db2565e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 03:27:42.475586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:42.475586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:42.475586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:42.475586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:42.475586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:42.475586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:42.475586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:42.475586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:42.475586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:42.475586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:42.475586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:42.475586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:42.475586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:42.475586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:42.475586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:42.476497 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:42.476497 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:42.476497 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:42.476497 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:42.476497 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:42.476497 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:42.476497 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:42.476497 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:42.476497 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:42.476497 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:42.476497 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:42.476497 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:42.476497 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:42.476497 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:42.476497 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:42.476497 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:42.477299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:42.477299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:42.477299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:42.477299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:42.477299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:42.477299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:42.477299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:42.477299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:42.477299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:42.477299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:42.477299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 03:27:42.477299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:42.477299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 272/552] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 03:27:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:27:42.478237 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3f2c0-9d9d-4c58-add9-72d7bad9fb42 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:42.478487 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3f2c0-9d9d-4c58-add9-72d7bad9fb42 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:42.478781 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3f2c0-9d9d-4c58-add9-72d7bad9fb42 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:42.484013 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 273/553] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:42.484800 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3f2c0-9d9d-4c58-add9-72d7bad9fb42 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:42.506862 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350ab84-47aa-4fb3-a2ce-a9f06fd56c38 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:42.516300 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:42.553418 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074eba9-5b44-4b9b-84dd-cd2a8daa973a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:42.554595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074eba9-5b44-4b9b-84dd-cd2a8daa973a None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:42.554879 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074eba9-5b44-4b9b-84dd-cd2a8daa973a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:42.555152 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074eba9-5b44-4b9b-84dd-cd2a8daa973a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:42.598809 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3f2c0-9d9d-4c58-add9-72d7bad9fb42 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:42.610307 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:42.638926 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f79a0-0c01-4df6-acca-c6b78536b5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:42.639769 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f79a0-0c01-4df6-acca-c6b78536b5d9 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:42.640056 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f79a0-0c01-4df6-acca-c6b78536b5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:42.640335 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f79a0-0c01-4df6-acca-c6b78536b5d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:42.641228 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f79a0-0c01-4df6-acca-c6b78536b5d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:42.641337 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f79a0-0c01-4df6-acca-c6b78536b5d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:42.642703 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f79a0-0c01-4df6-acca-c6b78536b5d9 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:42.651672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 274/554] 10.222.0.33 () {56 vars in 1103 bytes} [Fri Sep 16 03:27:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:42.652931 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb98bf9-9455-4bc9-a468-b517ca23fa48 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:42.653223 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb98bf9-9455-4bc9-a468-b517ca23fa48 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:42.653499 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb98bf9-9455-4bc9-a468-b517ca23fa48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:42.655560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0074eba9-5b44-4b9b-84dd-cd2a8daa973a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:42.657829 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0074eba9-5b44-4b9b-84dd-cd2a8daa973a None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:42.674126 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0eb98bf9-9455-4bc9-a468-b517ca23fa48 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:42.675440 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0eb98bf9-9455-4bc9-a468-b517ca23fa48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:42.758070 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 275/555] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:27:42.759200 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb98bf9-9455-4bc9-a468-b517ca23fa48 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:42.782603 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 281/556] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:27:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 16 03:27:42.788923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074eba9-5b44-4b9b-84dd-cd2a8daa973a None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:42.810013 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:42.872481 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:42.917003 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074eba9-5b44-4b9b-84dd-cd2a8daa973a None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:42.953489 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb98bf9-9455-4bc9-a468-b517ca23fa48 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:42.961655 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae729b5-6747-49cf-83a8-2fc8180bad9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:42.962584 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae729b5-6747-49cf-83a8-2fc8180bad9d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:42.963082 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae729b5-6747-49cf-83a8-2fc8180bad9d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:42.963927 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae729b5-6747-49cf-83a8-2fc8180bad9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:42.980276 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae729b5-6747-49cf-83a8-2fc8180bad9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:42.982791 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae729b5-6747-49cf-83a8-2fc8180bad9d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:42.989476 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e9acc-8fe6-45c1-8622-97746ec5521a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:42.990298 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e9acc-8fe6-45c1-8622-97746ec5521a None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:42.990656 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e9acc-8fe6-45c1-8622-97746ec5521a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:42.991105 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e9acc-8fe6-45c1-8622-97746ec5521a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:43.001810 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-dae729b5-6747-49cf-83a8-2fc8180bad9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:43.001810 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:43.001810 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:43.001810 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:43.001810 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:43.001810 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:43.001810 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:43.001810 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:43.001810 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:43.001810 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:43.001810 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:43.001810 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:43.001810 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:27:43.001810 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:27:43.001810 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:27:43.001810 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:27:43.002784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:43.002784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:43.002784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:43.002784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:43.002784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:43.002784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:43.002784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:43.002784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:43.002784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:43.002784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:43.002784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:43.002784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:43.002784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:43.002784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:43.002784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:43.002784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:43.002784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:27:43.003738 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:27:43.003738 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:43.003738 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:43.003919 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e9acc-8fe6-45c1-8622-97746ec5521a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:43.003919 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e9acc-8fe6-45c1-8622-97746ec5521a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:43.010214 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 282/557] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:27:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:43.012390 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b8fd7-b89b-4189-88b5-4f26789345f3 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:43.012696 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b8fd7-b89b-4189-88b5-4f26789345f3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:43.013023 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b8fd7-b89b-4189-88b5-4f26789345f3 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:43.014571 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 283/558] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:43.015333 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b8fd7-b89b-4189-88b5-4f26789345f3 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:43.028112 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-fe0e9acc-8fe6-45c1-8622-97746ec5521a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:43.028112 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:43.028112 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:43.028112 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:43.028112 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:43.028112 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:43.028112 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:43.028112 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:43.028112 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:43.028112 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:43.028112 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:43.028112 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:43.028112 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:27:43.028112 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:27:43.028112 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:27:43.028112 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:27:43.029223 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:43.029223 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:43.029223 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:43.029223 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:43.029223 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:43.029223 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:43.029223 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:43.029223 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:43.029223 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:43.029223 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:43.029223 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:43.029223 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:43.029223 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:43.029223 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:43.029223 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:43.029223 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:43.029223 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:27:43.030222 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:27:43.030222 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:43.030222 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:43.032222 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 276/559] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:27:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:43.033585 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413336f-2be8-4ea4-a3a9-c5126a38e7a5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:43.034093 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413336f-2be8-4ea4-a3a9-c5126a38e7a5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:43.034553 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413336f-2be8-4ea4-a3a9-c5126a38e7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:43.054532 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b413336f-2be8-4ea4-a3a9-c5126a38e7a5 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:43.056037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b413336f-2be8-4ea4-a3a9-c5126a38e7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:43.128966 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 277/560] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:27:43.129172 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b8fd7-b89b-4189-88b5-4f26789345f3 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:43.130453 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413336f-2be8-4ea4-a3a9-c5126a38e7a5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:43.134382 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:43.239955 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:43.253030 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643b2d3-8b92-44bc-8999-7da878678c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:43.253952 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643b2d3-8b92-44bc-8999-7da878678c66 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:43.254458 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643b2d3-8b92-44bc-8999-7da878678c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:43.254937 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643b2d3-8b92-44bc-8999-7da878678c66 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:43.255779 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6643b2d3-8b92-44bc-8999-7da878678c66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:43.256346 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6643b2d3-8b92-44bc-8999-7da878678c66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:43.257982 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6643b2d3-8b92-44bc-8999-7da878678c66 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:43.271878 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 284/561] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:43.273757 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643b2d3-8b92-44bc-8999-7da878678c66 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:43.323038 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413336f-2be8-4ea4-a3a9-c5126a38e7a5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:43.358665 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d9886-4638-4401-9a02-0828ce90c930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:43.359277 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d9886-4638-4401-9a02-0828ce90c930 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:43.359552 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d9886-4638-4401-9a02-0828ce90c930 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:43.359826 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d9886-4638-4401-9a02-0828ce90c930 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:43.360459 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d9886-4638-4401-9a02-0828ce90c930 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:43.360760 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d9886-4638-4401-9a02-0828ce90c930 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:43.362437 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d9886-4638-4401-9a02-0828ce90c930 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:43.375739 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 278/562] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:43.376705 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d9886-4638-4401-9a02-0828ce90c930 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:43.389167 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643b2d3-8b92-44bc-8999-7da878678c66 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:43.427216 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72398d1-edfe-43ab-a57e-c57bf9de7ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:43.427842 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72398d1-edfe-43ab-a57e-c57bf9de7ef0 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:43.428153 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72398d1-edfe-43ab-a57e-c57bf9de7ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:43.428390 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72398d1-edfe-43ab-a57e-c57bf9de7ef0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:43.439738 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72398d1-edfe-43ab-a57e-c57bf9de7ef0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:43.445072 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-b72398d1-edfe-43ab-a57e-c57bf9de7ef0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 03:27:43.445072 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:43.445072 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:43.445072 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:43.445072 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:43.445072 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:43.445072 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:43.445072 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:43.445072 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:43.445072 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:43.445072 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:43.445072 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:43.445072 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:43.445072 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:43.445072 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:43.445072 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:43.446032 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:43.446032 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:43.446032 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:43.446032 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:43.446032 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:43.446032 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:43.446032 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:43.446032 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:43.446032 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:43.446032 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:43.446032 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:43.446032 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:43.446032 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:43.446032 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:43.446032 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:43.446032 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:43.452000 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:43.452000 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:43.452000 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:43.452000 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:43.452000 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:43.452000 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:43.452000 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:43.452000 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:43.452000 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:43.452000 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:43.452000 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 03:27:43.452000 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:43.452806 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:43.452892 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 285/563] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 03:27:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:43.452892 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72398d1-edfe-43ab-a57e-c57bf9de7ef0 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:43.487957 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d9886-4638-4401-9a02-0828ce90c930 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:43.495600 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:43.521304 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568896ea-30b9-4a7b-8cf5-f231027d98e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:43.522038 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568896ea-30b9-4a7b-8cf5-f231027d98e8 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:43.522782 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568896ea-30b9-4a7b-8cf5-f231027d98e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:43.523054 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568896ea-30b9-4a7b-8cf5-f231027d98e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:43.529436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568896ea-30b9-4a7b-8cf5-f231027d98e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:43.530918 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568896ea-30b9-4a7b-8cf5-f231027d98e8 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:43.542667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-568896ea-30b9-4a7b-8cf5-f231027d98e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:27:43.542667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:43.542667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:43.542667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:43.542667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:43.542667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:43.542667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:43.542667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:43.542667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:43.542667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:43.542667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:43.542667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:43.542667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 03:27:43.542667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 03:27:43.542667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 03:27:43.543568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 03:27:43.543568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:43.543568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:43.543568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:43.543568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:43.543568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:43.543568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:43.543568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:43.543568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:43.543568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:43.543568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:43.543568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:43.543568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:43.543568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:43.543568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:43.543568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:43.543568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:43.544635 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 03:27:43.544635 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 03:27:43.544635 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 03:27:43.544635 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 03:27:43.544635 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 03:27:43.544635 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 03:27:43.544635 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:27:43.544635 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:43.544635 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 279/564] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:27:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:43.544635 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568896ea-30b9-4a7b-8cf5-f231027d98e8 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:43.554120 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72398d1-edfe-43ab-a57e-c57bf9de7ef0 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:43.589647 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684dacee-968e-43ec-898f-70735b130126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:43.590291 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684dacee-968e-43ec-898f-70735b130126 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:43.590569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684dacee-968e-43ec-898f-70735b130126 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:43.590835 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684dacee-968e-43ec-898f-70735b130126 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:43.597649 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684dacee-968e-43ec-898f-70735b130126 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:43.599095 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684dacee-968e-43ec-898f-70735b130126 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:43.611336 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-684dacee-968e-43ec-898f-70735b130126 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 16 03:27:43.611336 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:43.611336 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:43.611336 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:43.611336 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:43.611336 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:43.611336 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:43.611336 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:43.611336 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:43.611336 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:43.611336 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:43.611336 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:43.611336 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 03:27:43.611336 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 03:27:43.611336 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 03:27:43.611336 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 03:27:43.612373 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:43.612373 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:43.612373 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 03:27:43.612373 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:27:43.612373 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 03:27:43.612373 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:27:43.612373 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:43.612373 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:43.612373 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:43.612373 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:43.612373 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:43.612373 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:43.612373 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:43.612373 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:43.612373 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:43.612373 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:43.612373 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:43.612373 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:43.613333 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:43.613333 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:43.613333 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 03:27:43.613333 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 03:27:43.613333 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 03:27:43.613333 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 03:27:43.613333 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 03:27:43.613333 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 03:27:43.613333 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 16 03:27:43.613333 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:43.613333 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 286/565] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:27:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:43.614449 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684dacee-968e-43ec-898f-70735b130126 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:43.643463 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568896ea-30b9-4a7b-8cf5-f231027d98e8 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:43.666193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:43.676464 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba173ca0-39be-4932-9bb3-69256503fbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:43.682188 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba173ca0-39be-4932-9bb3-69256503fbb4 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:43.682188 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba173ca0-39be-4932-9bb3-69256503fbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:43.682188 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba173ca0-39be-4932-9bb3-69256503fbb4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:43.688290 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba173ca0-39be-4932-9bb3-69256503fbb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:43.693466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-ba173ca0-39be-4932-9bb3-69256503fbb4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 03:27:43.693466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:43.693466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:43.693466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:43.693466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:43.693466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:43.693466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:43.693466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:43.693466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:43.693466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:43.693466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:43.693466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:43.693466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:43.693466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:43.693466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:43.693466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:43.695208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:43.695208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:43.695208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:43.695208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:43.695208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:43.695208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:43.695208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:43.695208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:43.695208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:43.695208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:43.695208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:43.695208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:43.695208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:43.695208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:43.695208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:43.695208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:43.696222 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:43.696222 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:43.696222 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:43.696222 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:43.696222 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:43.696222 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:43.696222 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:43.696222 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:43.696222 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:43.696222 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:43.696222 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 03:27:43.696222 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:43.696222 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 280/566] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 03:27:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:43.702160 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbef85b-f842-462c-b2f8-bd3abe7c3f60 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:43.702160 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbef85b-f842-462c-b2f8-bd3abe7c3f60 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:43.702160 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbef85b-f842-462c-b2f8-bd3abe7c3f60 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:43.702160 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 281/567] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:43.702160 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbef85b-f842-462c-b2f8-bd3abe7c3f60 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:43.719068 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684dacee-968e-43ec-898f-70735b130126 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:43.720600 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:43.754026 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89817400-c3e0-4e27-ae19-c5472fb7acf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:43.754626 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89817400-c3e0-4e27-ae19-c5472fb7acf1 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:43.754905 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89817400-c3e0-4e27-ae19-c5472fb7acf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:43.755175 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89817400-c3e0-4e27-ae19-c5472fb7acf1 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:43.755832 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89817400-c3e0-4e27-ae19-c5472fb7acf1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:43.756133 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89817400-c3e0-4e27-ae19-c5472fb7acf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:43.758035 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89817400-c3e0-4e27-ae19-c5472fb7acf1 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:43.765621 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 287/568] 10.222.0.33 () {56 vars in 1103 bytes} [Fri Sep 16 03:27:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:43.766514 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89817400-c3e0-4e27-ae19-c5472fb7acf1 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:43.804564 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbef85b-f842-462c-b2f8-bd3abe7c3f60 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:43.839095 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca4767-c6f6-4c62-9092-20583af5a949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:43.839697 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca4767-c6f6-4c62-9092-20583af5a949 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:43.839981 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca4767-c6f6-4c62-9092-20583af5a949 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:43.840268 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca4767-c6f6-4c62-9092-20583af5a949 None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:43.841286 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca4767-c6f6-4c62-9092-20583af5a949 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:43.841593 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca4767-c6f6-4c62-9092-20583af5a949 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:43.843348 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca4767-c6f6-4c62-9092-20583af5a949 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:43.855300 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 282/569] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 03:27:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:43.856095 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca4767-c6f6-4c62-9092-20583af5a949 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:43.863503 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89817400-c3e0-4e27-ae19-c5472fb7acf1 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:43.896027 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca6fdb-b95d-45af-b2cc-262fa5bfe1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:43.896745 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca6fdb-b95d-45af-b2cc-262fa5bfe1ae None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:43.897022 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca6fdb-b95d-45af-b2cc-262fa5bfe1ae None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:43.897353 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca6fdb-b95d-45af-b2cc-262fa5bfe1ae None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:43.898103 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca6fdb-b95d-45af-b2cc-262fa5bfe1ae None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:43.898404 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca6fdb-b95d-45af-b2cc-262fa5bfe1ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:43.899816 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca6fdb-b95d-45af-b2cc-262fa5bfe1ae None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:43.901843 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:43.916981 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 288/570] 10.222.0.33 () {56 vars in 1137 bytes} [Fri Sep 16 03:27:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:43.918224 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057b4ad-7ed7-44fd-bb72-09007d67dd7a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:43.918576 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057b4ad-7ed7-44fd-bb72-09007d67dd7a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:43.918849 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057b4ad-7ed7-44fd-bb72-09007d67dd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:43.937548 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3057b4ad-7ed7-44fd-bb72-09007d67dd7a None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:43.938799 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3057b4ad-7ed7-44fd-bb72-09007d67dd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:43.955555 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:43.961247 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca4767-c6f6-4c62-9092-20583af5a949 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:43.995456 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942dcc32-1665-4fa6-9cbb-2a4c8134eb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:43.996064 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942dcc32-1665-4fa6-9cbb-2a4c8134eb81 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:43.996348 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942dcc32-1665-4fa6-9cbb-2a4c8134eb81 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:43.996622 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942dcc32-1665-4fa6-9cbb-2a4c8134eb81 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:43.997274 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942dcc32-1665-4fa6-9cbb-2a4c8134eb81 None admin] RBAC: Adding query filter params (name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:43.997579 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942dcc32-1665-4fa6-9cbb-2a4c8134eb81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:43.998984 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942dcc32-1665-4fa6-9cbb-2a4c8134eb81 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:44.005500 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 289/571] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:27:44.006347 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057b4ad-7ed7-44fd-bb72-09007d67dd7a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:44.007003 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 283/572] 10.222.0.33 () {56 vars in 1103 bytes} [Fri Sep 16 03:27:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:44.007827 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942dcc32-1665-4fa6-9cbb-2a4c8134eb81 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:44.118252 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057b4ad-7ed7-44fd-bb72-09007d67dd7a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:44.125282 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942dcc32-1665-4fa6-9cbb-2a4c8134eb81 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:44.133694 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:44.154523 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfbbc2-bf4a-45a5-9f13-7343671ca251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:44.155156 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfbbc2-bf4a-45a5-9f13-7343671ca251 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:44.155437 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfbbc2-bf4a-45a5-9f13-7343671ca251 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:44.155706 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfbbc2-bf4a-45a5-9f13-7343671ca251 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:44.160555 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606a7c4-bb25-4997-aec5-f287369597fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:44.161223 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606a7c4-bb25-4997-aec5-f287369597fa None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:44.161569 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606a7c4-bb25-4997-aec5-f287369597fa None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:44.161936 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606a7c4-bb25-4997-aec5-f287369597fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:44.162726 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4606a7c4-bb25-4997-aec5-f287369597fa None admin] RBAC: Adding query filter params (role.id=8a338e321ece4061b4b30d6231167b4e, scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2, user.id=9f784d98d5f440c681f53ae70f6d1cc7) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:44.163190 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4606a7c4-bb25-4997-aec5-f287369597fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:44.164753 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4606a7c4-bb25-4997-aec5-f287369597fa None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:44.167318 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dfbbc2-bf4a-45a5-9f13-7343671ca251 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:44.169047 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dfbbc2-bf4a-45a5-9f13-7343671ca251 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:44.170737 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 284/573] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:27:44 2022] GET /identity/v3/role_assignments?user.id=9f784d98d5f440c681f53ae70f6d1cc7&scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2&role.id=8a338e321ece4061b4b30d6231167b4e => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:44.171506 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606a7c4-bb25-4997-aec5-f287369597fa None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:44.199097 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-f6dfbbc2-bf4a-45a5-9f13-7343671ca251 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:44.199097 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:44.199097 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:44.199097 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:44.199097 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:44.199097 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:44.199097 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:44.199097 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:44.199097 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:44.199097 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:44.199097 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:44.199097 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:44.199097 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:27:44.199097 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:27:44.199097 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:27:44.199097 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:27:44.200137 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:44.200137 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:44.200137 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:44.200137 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:44.200137 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:44.200137 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:44.200137 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:44.200137 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:44.200137 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:44.200137 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:44.200137 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:44.200137 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:44.200137 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:44.200137 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:44.200137 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:44.200137 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:44.200137 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:27:44.201012 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:27:44.201012 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:44.201012 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:44.203503 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 290/574] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:27:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:44.204543 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfbbc2-bf4a-45a5-9f13-7343671ca251 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:44.208928 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:44.301519 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606a7c4-bb25-4997-aec5-f287369597fa None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:44.329390 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfbbc2-bf4a-45a5-9f13-7343671ca251 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:44.337804 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957fad2-9ee3-4e12-b2f4-ad96a6b8271d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:44.338455 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957fad2-9ee3-4e12-b2f4-ad96a6b8271d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:44.339153 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957fad2-9ee3-4e12-b2f4-ad96a6b8271d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:44.339153 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957fad2-9ee3-4e12-b2f4-ad96a6b8271d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:44.351662 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e957fad2-9ee3-4e12-b2f4-ad96a6b8271d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:44.353318 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e957fad2-9ee3-4e12-b2f4-ad96a6b8271d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:44.367176 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0b73a-7880-4c23-b48d-df3802337084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:44.367803 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0b73a-7880-4c23-b48d-df3802337084 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:44.368080 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0b73a-7880-4c23-b48d-df3802337084 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:44.368397 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0b73a-7880-4c23-b48d-df3802337084 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:44.369672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-e957fad2-9ee3-4e12-b2f4-ad96a6b8271d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:44.369672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:44.369672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:44.369672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:44.369672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:44.369672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:44.369672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:44.369672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:44.369672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:44.369672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:44.369672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:44.369672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:44.369672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:27:44.369672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:27:44.369672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:27:44.369672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:27:44.370771 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:44.370771 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:44.370771 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:44.370771 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:44.370771 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:44.370771 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:44.370771 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:44.370771 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:44.370771 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:44.370771 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:44.370771 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:44.370771 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:44.370771 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:44.370771 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:44.370771 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:44.370771 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:44.370771 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:27:44.371822 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:27:44.371822 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:44.371822 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:44.374990 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 285/575] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:27:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:44.374990 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957fad2-9ee3-4e12-b2f4-ad96a6b8271d None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:44.380716 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db0b73a-7880-4c23-b48d-df3802337084 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:44.382812 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db0b73a-7880-4c23-b48d-df3802337084 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:44.401504 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:44.403312 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-3db0b73a-7880-4c23-b48d-df3802337084 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:44.403312 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:44.403312 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:44.403312 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:44.403312 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:44.403312 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:44.403312 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:44.403312 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:44.403312 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:44.403312 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:44.403312 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:44.403312 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:44.403312 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:27:44.403312 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:27:44.403312 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:27:44.403312 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:27:44.404276 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:44.404276 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:44.404276 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:44.404276 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:44.404276 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:44.404276 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:44.404276 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:44.404276 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:44.404276 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:44.404276 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:44.404276 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:44.404276 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:44.404276 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:44.404276 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:44.404276 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:44.404276 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:44.404276 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:27:44.405139 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:27:44.405139 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:44.405139 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:44.405139 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 291/576] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:27:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:44.405386 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0b73a-7880-4c23-b48d-df3802337084 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:44.465074 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:44.485933 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957fad2-9ee3-4e12-b2f4-ad96a6b8271d None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:44.510214 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0b73a-7880-4c23-b48d-df3802337084 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:44.522091 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7f374-07c6-4067-8ef0-e51ee81ec60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:44.523055 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7f374-07c6-4067-8ef0-e51ee81ec60d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:44.523454 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7f374-07c6-4067-8ef0-e51ee81ec60d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:44.523805 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7f374-07c6-4067-8ef0-e51ee81ec60d None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:44.524558 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7f374-07c6-4067-8ef0-e51ee81ec60d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:44.524964 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7f374-07c6-4067-8ef0-e51ee81ec60d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:44.526450 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7f374-07c6-4067-8ef0-e51ee81ec60d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:44.539395 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 286/577] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:27:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:44.543855 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7f374-07c6-4067-8ef0-e51ee81ec60d None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:44.548455 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03baf5-603e-4ff9-b232-962098611b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:44.549087 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03baf5-603e-4ff9-b232-962098611b6c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:44.549366 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03baf5-603e-4ff9-b232-962098611b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:44.549661 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03baf5-603e-4ff9-b232-962098611b6c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:44.561032 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d03baf5-603e-4ff9-b232-962098611b6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:44.566323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-5d03baf5-603e-4ff9-b232-962098611b6c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 03:27:44.566323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:44.566323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:44.566323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:44.566323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:44.566323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:44.566323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:44.566323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:44.566323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:44.566323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:44.566323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:44.566323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:44.566323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:44.566323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:44.566323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:44.566323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:44.567409 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:44.567409 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:44.567409 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:44.567409 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:44.567409 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:44.567409 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:44.567409 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:44.567409 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:44.567409 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:44.567409 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:44.567409 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:44.567409 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:44.567409 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:44.567409 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:44.567409 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:44.567409 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:44.568401 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:44.568401 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:44.568401 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:44.568401 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:44.568401 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:44.568401 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:44.568401 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:44.568401 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:44.568401 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:44.568401 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:44.568401 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 03:27:44.568401 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:44.572768 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 292/578] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 03:27:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:44.573603 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03baf5-603e-4ff9-b232-962098611b6c None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:44.634338 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:44.654154 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7f374-07c6-4067-8ef0-e51ee81ec60d None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:44.674158 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03baf5-603e-4ff9-b232-962098611b6c None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:44.694164 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:44.700734 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba54b6f-89bd-449d-ab4e-223aa792c7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:44.701681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba54b6f-89bd-449d-ab4e-223aa792c7bf None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:44.702298 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba54b6f-89bd-449d-ab4e-223aa792c7bf None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:44.702298 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba54b6f-89bd-449d-ab4e-223aa792c7bf None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:44.702929 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba54b6f-89bd-449d-ab4e-223aa792c7bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:44.703236 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba54b6f-89bd-449d-ab4e-223aa792c7bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:44.704821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba54b6f-89bd-449d-ab4e-223aa792c7bf None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:44.716119 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85787781-40cc-48d4-b578-1a0852052429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:44.716808 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85787781-40cc-48d4-b578-1a0852052429 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:44.717157 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85787781-40cc-48d4-b578-1a0852052429 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:44.717499 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85787781-40cc-48d4-b578-1a0852052429 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:44.718301 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85787781-40cc-48d4-b578-1a0852052429 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:44.718671 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85787781-40cc-48d4-b578-1a0852052429 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:44.720098 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85787781-40cc-48d4-b578-1a0852052429 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:44.722123 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 287/579] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:27:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:44.723338 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba54b6f-89bd-449d-ab4e-223aa792c7bf None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:44.734703 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 293/580] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:27:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:44.739704 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85787781-40cc-48d4-b578-1a0852052429 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:44.824946 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba54b6f-89bd-449d-ab4e-223aa792c7bf None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:44.850262 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85787781-40cc-48d4-b578-1a0852052429 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:44.857433 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d400777-45f0-4a89-8dd5-0c29d52aae05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:44.858095 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d400777-45f0-4a89-8dd5-0c29d52aae05 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:44.858377 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d400777-45f0-4a89-8dd5-0c29d52aae05 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:44.858782 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d400777-45f0-4a89-8dd5-0c29d52aae05 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:44.866778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d400777-45f0-4a89-8dd5-0c29d52aae05 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:44.868226 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d400777-45f0-4a89-8dd5-0c29d52aae05 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:44.879609 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-8d400777-45f0-4a89-8dd5-0c29d52aae05 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 03:27:44.879609 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:44.879609 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:44.879609 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:44.879609 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:44.879609 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:44.879609 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:44.879609 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:44.879609 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:44.879609 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:44.879609 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:44.879609 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:44.879609 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 03:27:44.879609 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 03:27:44.879609 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 03:27:44.879609 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 03:27:44.880554 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:44.880554 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:44.880554 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 03:27:44.880554 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:27:44.880554 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 03:27:44.880554 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:27:44.880554 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:44.880554 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:44.880554 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:44.880554 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:44.880554 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:44.880554 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:44.880554 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:44.880554 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:44.880554 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:44.880554 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:44.880554 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:44.880554 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:44.882248 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:44.882248 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:44.882248 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 03:27:44.882248 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 03:27:44.882248 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 03:27:44.882248 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 03:27:44.882248 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 03:27:44.882248 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 03:27:44.882248 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 03:27:44.882248 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:44.882248 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 288/581] 10.222.0.33 () {56 vars in 1093 bytes} [Fri Sep 16 03:27:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:44.882248 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d400777-45f0-4a89-8dd5-0c29d52aae05 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:44.885576 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:44.893800 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b4213c-3180-419e-950f-c331e00af749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:44.895773 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4213c-3180-419e-950f-c331e00af749 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:44.895773 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4213c-3180-419e-950f-c331e00af749 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:44.895773 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4213c-3180-419e-950f-c331e00af749 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:44.895773 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b4213c-3180-419e-950f-c331e00af749 None admin] RBAC: Adding query filter params (name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:44.896141 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b4213c-3180-419e-950f-c331e00af749 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:44.897289 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b4213c-3180-419e-950f-c331e00af749 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:44.906323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 294/582] 10.222.0.33 () {56 vars in 1103 bytes} [Fri Sep 16 03:27:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:44.911240 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b4213c-3180-419e-950f-c331e00af749 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:44.954623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:44.990356 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d400777-45f0-4a89-8dd5-0c29d52aae05 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:45.019160 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b4213c-3180-419e-950f-c331e00af749 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:45.027594 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adda135f-643b-40b6-b3b1-7c4014ba7d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:45.028231 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda135f-643b-40b6-b3b1-7c4014ba7d00 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:45.028520 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda135f-643b-40b6-b3b1-7c4014ba7d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:45.028799 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda135f-643b-40b6-b3b1-7c4014ba7d00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:45.035946 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adda135f-643b-40b6-b3b1-7c4014ba7d00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:45.037387 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adda135f-643b-40b6-b3b1-7c4014ba7d00 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:45.048834 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-adda135f-643b-40b6-b3b1-7c4014ba7d00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:27:45.048834 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:45.048834 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:45.048834 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:45.048834 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:45.048834 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:45.048834 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:45.048834 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:45.048834 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:45.048834 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:45.048834 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:45.048834 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:45.048834 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 03:27:45.048834 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 03:27:45.048834 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 03:27:45.049729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 03:27:45.049729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:45.049729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:45.049729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:45.049729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:45.049729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:45.049729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:45.049729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:45.049729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:45.049729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:45.049729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:45.049729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:45.049729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:45.049729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:45.049729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:45.049729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:45.049729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:45.050617 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 03:27:45.050617 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 03:27:45.050617 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 03:27:45.050617 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 03:27:45.050617 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 03:27:45.050617 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 03:27:45.050617 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:27:45.050617 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:45.050617 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 289/583] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:27:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:45.055213 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adda135f-643b-40b6-b3b1-7c4014ba7d00 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:45.057006 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfebc79-b058-4492-bf18-718ec072b041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:45.057738 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfebc79-b058-4492-bf18-718ec072b041 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:45.057944 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfebc79-b058-4492-bf18-718ec072b041 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:45.058219 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfebc79-b058-4492-bf18-718ec072b041 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:45.066057 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfebc79-b058-4492-bf18-718ec072b041 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:45.067547 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfebc79-b058-4492-bf18-718ec072b041 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:45.081053 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-ddfebc79-b058-4492-bf18-718ec072b041 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 16 03:27:45.081053 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:45.081053 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:45.081053 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:45.081053 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:45.081053 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:45.081053 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:45.081053 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:45.081053 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:45.081053 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:45.081053 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:45.081053 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:45.081053 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 03:27:45.081053 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 03:27:45.081053 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 03:27:45.081053 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 03:27:45.082106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:45.082106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:45.082106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 03:27:45.082106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:27:45.082106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 03:27:45.082106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:27:45.082106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:45.082106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:45.082106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:45.082106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:45.082106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:45.082106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:45.082106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:45.082106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:45.082106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:45.082106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:45.082106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:45.082106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:45.083029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:45.083029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:45.083029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 03:27:45.083029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 03:27:45.083029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 03:27:45.083029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 03:27:45.083029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 03:27:45.083029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 03:27:45.083029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 16 03:27:45.083029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:45.083029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 295/584] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 03:27:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:45.084285 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfebc79-b058-4492-bf18-718ec072b041 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:45.127742 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:45.166687 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adda135f-643b-40b6-b3b1-7c4014ba7d00 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:45.184999 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:45.189048 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfebc79-b058-4492-bf18-718ec072b041 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:45.200169 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a70237-610e-4005-989b-5709f344078a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:45.201035 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a70237-610e-4005-989b-5709f344078a None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:45.201383 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a70237-610e-4005-989b-5709f344078a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:45.201764 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a70237-610e-4005-989b-5709f344078a None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:45.202493 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a70237-610e-4005-989b-5709f344078a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:45.202799 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a70237-610e-4005-989b-5709f344078a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:45.204225 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a70237-610e-4005-989b-5709f344078a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:45.223614 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8dc6c2-001f-45ec-b137-a4fc41f300c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:45.224249 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dc6c2-001f-45ec-b137-a4fc41f300c2 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:45.224536 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dc6c2-001f-45ec-b137-a4fc41f300c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:45.224808 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dc6c2-001f-45ec-b137-a4fc41f300c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:45.235594 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8dc6c2-001f-45ec-b137-a4fc41f300c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:45.237024 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8dc6c2-001f-45ec-b137-a4fc41f300c2 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:45.245861 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 290/585] 10.222.0.33 () {56 vars in 1133 bytes} [Fri Sep 16 03:27:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:45.245861 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a70237-610e-4005-989b-5709f344078a None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:45.254923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-2b8dc6c2-001f-45ec-b137-a4fc41f300c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:45.254923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:45.254923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:45.254923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:45.254923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:45.254923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:45.254923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:45.254923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:45.254923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:45.254923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:45.254923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:45.254923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:45.254923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:27:45.254923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:27:45.254923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:27:45.254923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:27:45.255851 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:45.255851 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:45.255851 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:45.255851 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:45.255851 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:45.255851 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:45.255851 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:45.255851 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:45.255851 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:45.255851 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:45.255851 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:45.255851 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:45.255851 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:45.255851 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:45.255851 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:45.255851 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:45.255851 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:27:45.257265 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:27:45.257265 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:45.257265 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:45.257265 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 296/586] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:27:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:45.262328 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8dc6c2-001f-45ec-b137-a4fc41f300c2 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:45.358191 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a70237-610e-4005-989b-5709f344078a None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:45.364923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8dc6c2-001f-45ec-b137-a4fc41f300c2 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:45.379074 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:45.395097 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a291c-07b8-4453-90d3-8fa7d20f7e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:45.411669 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a291c-07b8-4453-90d3-8fa7d20f7e60 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:45.411669 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a291c-07b8-4453-90d3-8fa7d20f7e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:45.411669 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a291c-07b8-4453-90d3-8fa7d20f7e60 None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:45.411669 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a291c-07b8-4453-90d3-8fa7d20f7e60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:45.411669 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a291c-07b8-4453-90d3-8fa7d20f7e60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:45.411669 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a291c-07b8-4453-90d3-8fa7d20f7e60 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:45.412113 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49f1a1-b7d0-4f5d-aeec-fc2bea88a509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:45.412113 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49f1a1-b7d0-4f5d-aeec-fc2bea88a509 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:45.412113 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49f1a1-b7d0-4f5d-aeec-fc2bea88a509 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:45.412113 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49f1a1-b7d0-4f5d-aeec-fc2bea88a509 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:45.412375 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49f1a1-b7d0-4f5d-aeec-fc2bea88a509 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:45.412375 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49f1a1-b7d0-4f5d-aeec-fc2bea88a509 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:45.412375 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49f1a1-b7d0-4f5d-aeec-fc2bea88a509 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:45.412564 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 291/587] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 03:27:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:45.413688 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a291c-07b8-4453-90d3-8fa7d20f7e60 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:45.434954 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 297/588] 10.222.0.33 () {56 vars in 1139 bytes} [Fri Sep 16 03:27:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:45.434954 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49f1a1-b7d0-4f5d-aeec-fc2bea88a509 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:45.443406 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:45.517661 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a291c-07b8-4453-90d3-8fa7d20f7e60 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:45.533879 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49f1a1-b7d0-4f5d-aeec-fc2bea88a509 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:45.552545 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494ee9c-5df4-41ba-8992-4de30b00f01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:45.553186 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494ee9c-5df4-41ba-8992-4de30b00f01a None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:45.554012 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494ee9c-5df4-41ba-8992-4de30b00f01a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:45.554338 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494ee9c-5df4-41ba-8992-4de30b00f01a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:45.564659 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6494ee9c-5df4-41ba-8992-4de30b00f01a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:45.566145 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6494ee9c-5df4-41ba-8992-4de30b00f01a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:45.575727 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0cf282-d28f-45a0-98a6-5c49f24a0215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:45.576408 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0cf282-d28f-45a0-98a6-5c49f24a0215 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:45.576759 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0cf282-d28f-45a0-98a6-5c49f24a0215 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:45.577099 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0cf282-d28f-45a0-98a6-5c49f24a0215 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:45.577839 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0cf282-d28f-45a0-98a6-5c49f24a0215 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:45.578207 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0cf282-d28f-45a0-98a6-5c49f24a0215 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:45.579625 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0cf282-d28f-45a0-98a6-5c49f24a0215 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:45.580459 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-6494ee9c-5df4-41ba-8992-4de30b00f01a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:45.580459 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:45.580459 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:45.580459 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:45.580459 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:45.580459 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:45.580459 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:45.580459 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:45.580459 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:45.580459 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:45.580459 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:45.580459 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:45.580459 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:27:45.580459 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:27:45.580459 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:27:45.580459 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:27:45.581887 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:45.581887 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:45.581887 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:45.581887 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:45.581887 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:45.581887 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:45.581887 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:45.581887 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:45.581887 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:45.581887 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:45.581887 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:45.581887 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:45.581887 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:45.581887 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:45.581887 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:45.581887 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:45.581887 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:27:45.582865 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:27:45.582865 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:45.582865 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:45.582865 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 292/589] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:27:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:45.582865 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494ee9c-5df4-41ba-8992-4de30b00f01a None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:45.595638 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 298/590] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:45.596692 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0cf282-d28f-45a0-98a6-5c49f24a0215 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:45.623414 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:45.666329 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:45.706866 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494ee9c-5df4-41ba-8992-4de30b00f01a None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:45.707316 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0cf282-d28f-45a0-98a6-5c49f24a0215 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:45.742885 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe7e65-c7f3-453f-8a00-b78ae1a1a214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:45.743841 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe7e65-c7f3-453f-8a00-b78ae1a1a214 None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:45.744162 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe7e65-c7f3-453f-8a00-b78ae1a1a214 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:45.744397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe7e65-c7f3-453f-8a00-b78ae1a1a214 None admin] PATH_INFO: `/v3/projects/a0e46c2a2c62402dbf6d8461204b47d2/users/aafb065e06c3481bbed8d98e893766ee/roles/8a338e321ece4061b4b30d6231167b4e` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:45.744773 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19432ab-09fc-4eb1-95b3-8c3afb5f1f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:45.745403 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19432ab-09fc-4eb1-95b3-8c3afb5f1f2b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:45.745713 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19432ab-09fc-4eb1-95b3-8c3afb5f1f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:45.745993 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19432ab-09fc-4eb1-95b3-8c3afb5f1f2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:45.756505 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19432ab-09fc-4eb1-95b3-8c3afb5f1f2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:45.758023 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19432ab-09fc-4eb1-95b3-8c3afb5f1f2b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:45.763528 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe7e65-c7f3-453f-8a00-b78ae1a1a214 None admin] RBAC: Authorizing `identity:create_grant(project_id=a0e46c2a2c62402dbf6d8461204b47d2, user_id=aafb065e06c3481bbed8d98e893766ee, role_id=8a338e321ece4061b4b30d6231167b4e)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:45.765076 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe7e65-c7f3-453f-8a00-b78ae1a1a214 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:45.773980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-d19432ab-09fc-4eb1-95b3-8c3afb5f1f2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:45.773980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:45.773980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:45.773980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:45.773980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:45.773980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:45.773980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:45.773980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:45.773980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:45.773980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:45.773980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:45.773980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:45.773980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:27:45.773980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:27:45.773980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:27:45.773980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:27:45.775085 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:45.775085 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:45.775085 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:45.775085 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:45.775085 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:45.775085 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:45.775085 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:45.775085 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:45.775085 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:45.775085 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:45.775085 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:45.775085 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:45.775085 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:45.775085 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:45.775085 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:45.775085 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:45.775085 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:27:45.775984 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:27:45.775984 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:45.775984 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:45.775984 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 299/591] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:27:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:45.776299 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19432ab-09fc-4eb1-95b3-8c3afb5f1f2b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:45.859761 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 293/592] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 03:27:45 2022] PUT /identity/v3/projects/a0e46c2a2c62402dbf6d8461204b47d2/users/aafb065e06c3481bbed8d98e893766ee/roles/8a338e321ece4061b4b30d6231167b4e => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:27:45.859761 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe7e65-c7f3-453f-8a00-b78ae1a1a214 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:45.882843 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19432ab-09fc-4eb1-95b3-8c3afb5f1f2b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:45.909180 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:45.926898 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80b6ef-07d0-4fc8-ab49-c13f33fefd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:45.927545 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80b6ef-07d0-4fc8-ab49-c13f33fefd9d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:45.927825 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80b6ef-07d0-4fc8-ab49-c13f33fefd9d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:45.928095 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80b6ef-07d0-4fc8-ab49-c13f33fefd9d None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:45.929113 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80b6ef-07d0-4fc8-ab49-c13f33fefd9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:45.929447 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80b6ef-07d0-4fc8-ab49-c13f33fefd9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:45.930882 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80b6ef-07d0-4fc8-ab49-c13f33fefd9d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:45.950733 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 300/593] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:45.950733 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80b6ef-07d0-4fc8-ab49-c13f33fefd9d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:45.977215 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:45.997453 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe7e65-c7f3-453f-8a00-b78ae1a1a214 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:46.042715 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139de90-261e-4c41-8204-de1f02cd7ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:46.043650 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139de90-261e-4c41-8204-de1f02cd7ec0 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:46.044090 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139de90-261e-4c41-8204-de1f02cd7ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:46.044569 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139de90-261e-4c41-8204-de1f02cd7ec0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:46.053154 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f139de90-261e-4c41-8204-de1f02cd7ec0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:46.055837 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f139de90-261e-4c41-8204-de1f02cd7ec0 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:46.073024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-f139de90-261e-4c41-8204-de1f02cd7ec0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 03:27:46.073024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:46.073024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:46.073024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:46.073024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:46.073024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:46.073024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:46.073024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:46.073024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:46.073024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:46.073024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:46.073024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:46.073024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 03:27:46.073024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 03:27:46.073024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 03:27:46.073024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 03:27:46.074157 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:46.074157 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:46.074157 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 03:27:46.074157 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:27:46.074157 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 03:27:46.074157 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:27:46.074157 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:46.074157 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:46.074157 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:46.074157 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:46.074157 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:46.074157 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:46.074157 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:46.074157 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:46.074157 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:46.074157 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:46.074157 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:46.074157 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:46.075605 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:46.075605 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:46.075605 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 03:27:46.075605 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 03:27:46.075605 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 03:27:46.075605 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 03:27:46.075605 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 03:27:46.075605 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 03:27:46.075605 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 03:27:46.075605 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:46.076417 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80b6ef-07d0-4fc8-ab49-c13f33fefd9d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:46.076492 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 294/594] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:27:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:46.076492 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139de90-261e-4c41-8204-de1f02cd7ec0 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:46.116857 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec0569-458f-4b4a-b570-160e3d88d01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:46.118130 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec0569-458f-4b4a-b570-160e3d88d01a None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:46.119045 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec0569-458f-4b4a-b570-160e3d88d01a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:46.119820 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec0569-458f-4b4a-b570-160e3d88d01a None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:46.120669 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec0569-458f-4b4a-b570-160e3d88d01a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:46.121174 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec0569-458f-4b4a-b570-160e3d88d01a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:46.122954 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec0569-458f-4b4a-b570-160e3d88d01a None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:46.136492 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 301/595] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:46.137776 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec0569-458f-4b4a-b570-160e3d88d01a None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:46.190162 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:46.201113 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139de90-261e-4c41-8204-de1f02cd7ec0 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:46.242755 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b25fc-a808-477e-a26b-2043bb619e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:46.243339 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b25fc-a808-477e-a26b-2043bb619e8d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:46.243616 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b25fc-a808-477e-a26b-2043bb619e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:46.243890 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b25fc-a808-477e-a26b-2043bb619e8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:46.253116 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b25fc-a808-477e-a26b-2043bb619e8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:46.254927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b25fc-a808-477e-a26b-2043bb619e8d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:46.256011 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec0569-458f-4b4a-b570-160e3d88d01a None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:46.269396 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-396b25fc-a808-477e-a26b-2043bb619e8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:27:46.269396 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:46.269396 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:46.269396 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:46.269396 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:46.269396 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:46.269396 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:46.269396 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:46.269396 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:46.269396 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:46.269396 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:46.269396 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:46.269396 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 03:27:46.269396 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 03:27:46.269396 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 03:27:46.270696 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 03:27:46.270696 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:46.270696 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:46.270696 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:46.270696 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:46.270696 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:46.270696 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:46.270696 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:46.270696 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:46.270696 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:46.270696 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:46.270696 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:46.270696 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:46.270696 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:46.270696 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:46.270696 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:46.270696 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:46.277415 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 03:27:46.277415 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 03:27:46.277415 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 03:27:46.277415 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 03:27:46.277415 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 03:27:46.277415 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 03:27:46.277415 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:27:46.277415 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:46.277415 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 295/596] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:27:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:46.277415 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b25fc-a808-477e-a26b-2043bb619e8d None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:46.279766 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:46.313941 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd115646-6f31-4d47-b776-8ee1be0fd716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:46.314656 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd115646-6f31-4d47-b776-8ee1be0fd716 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:46.315229 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd115646-6f31-4d47-b776-8ee1be0fd716 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:46.315557 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd115646-6f31-4d47-b776-8ee1be0fd716 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:46.316559 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd115646-6f31-4d47-b776-8ee1be0fd716 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:46.316866 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd115646-6f31-4d47-b776-8ee1be0fd716 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:46.318821 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd115646-6f31-4d47-b776-8ee1be0fd716 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:46.341350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 302/597] 10.222.0.33 () {56 vars in 1137 bytes} [Fri Sep 16 03:27:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:46.342614 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd115646-6f31-4d47-b776-8ee1be0fd716 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:46.408218 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b25fc-a808-477e-a26b-2043bb619e8d None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:46.442947 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071f51a-6901-4176-88d7-b9495cefd387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:46.443580 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071f51a-6901-4176-88d7-b9495cefd387 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:46.443859 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071f51a-6901-4176-88d7-b9495cefd387 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:46.444705 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071f51a-6901-4176-88d7-b9495cefd387 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:46.451347 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4071f51a-6901-4176-88d7-b9495cefd387 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:46.452800 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4071f51a-6901-4176-88d7-b9495cefd387 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:46.455375 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:46.459544 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd115646-6f31-4d47-b776-8ee1be0fd716 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:46.463980 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-4071f51a-6901-4176-88d7-b9495cefd387 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:27:46.463980 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:46.463980 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:46.463980 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:46.463980 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:46.463980 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:46.463980 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:46.463980 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:46.463980 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:46.463980 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:46.463980 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:46.463980 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:46.463980 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 03:27:46.463980 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 03:27:46.463980 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 03:27:46.470778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 03:27:46.470778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:46.470778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:46.470778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:46.470778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:46.470778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:46.470778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:46.470778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:46.470778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:46.470778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:46.470778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:46.470778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:46.470778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:46.470778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:46.470778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:46.470778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:46.470778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:46.471687 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 03:27:46.471687 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 03:27:46.471687 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 03:27:46.471687 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 03:27:46.471687 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 03:27:46.471687 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 03:27:46.471687 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:27:46.471687 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:46.471687 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 296/598] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:27:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:46.471687 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071f51a-6901-4176-88d7-b9495cefd387 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:46.497314 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c37ea1-eada-4135-b805-b9ae7d3de670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:46.497890 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c37ea1-eada-4135-b805-b9ae7d3de670 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:46.498179 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c37ea1-eada-4135-b805-b9ae7d3de670 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:46.498458 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c37ea1-eada-4135-b805-b9ae7d3de670 None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:46.499153 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c37ea1-eada-4135-b805-b9ae7d3de670 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:46.499467 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c37ea1-eada-4135-b805-b9ae7d3de670 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:46.500912 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c37ea1-eada-4135-b805-b9ae7d3de670 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:46.512574 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 303/599] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 03:27:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:46.513766 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680bec2-a340-44db-9ff1-e348318f7d07 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:46.514053 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680bec2-a340-44db-9ff1-e348318f7d07 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:46.514327 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680bec2-a340-44db-9ff1-e348318f7d07 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:46.519517 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 304/600] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:46.520272 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680bec2-a340-44db-9ff1-e348318f7d07 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:46.541028 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:46.582513 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071f51a-6901-4176-88d7-b9495cefd387 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:46.617502 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9a302-2f47-4c5a-b6b1-3f662701785f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:46.618295 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9a302-2f47-4c5a-b6b1-3f662701785f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:46.618584 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9a302-2f47-4c5a-b6b1-3f662701785f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:46.618977 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9a302-2f47-4c5a-b6b1-3f662701785f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:46.625567 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680bec2-a340-44db-9ff1-e348318f7d07 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:46.630303 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c9a302-2f47-4c5a-b6b1-3f662701785f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:46.632278 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c9a302-2f47-4c5a-b6b1-3f662701785f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:46.647546 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-d0c9a302-2f47-4c5a-b6b1-3f662701785f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:46.647546 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:46.647546 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:46.647546 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:46.647546 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:46.647546 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:46.647546 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:46.647546 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:46.647546 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:46.647546 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:46.647546 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:46.647546 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:46.647546 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:27:46.647546 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:27:46.647546 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:27:46.647546 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:27:46.653253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:46.653253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:46.653253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:46.653253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:46.653253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:46.653253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:46.653253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:46.653253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:46.653253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:46.653253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:46.653253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:46.653253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:46.653253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:46.653253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:46.653253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:46.653253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:46.653253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:27:46.654425 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:27:46.654425 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:46.654425 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:46.654425 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 297/601] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:27:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:46.654425 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9a302-2f47-4c5a-b6b1-3f662701785f None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:46.669884 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fb0c9-7d1c-4682-8b6c-f46aec92cef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:46.670624 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fb0c9-7d1c-4682-8b6c-f46aec92cef3 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:46.670758 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fb0c9-7d1c-4682-8b6c-f46aec92cef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:46.671005 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fb0c9-7d1c-4682-8b6c-f46aec92cef3 None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:46.671687 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05fb0c9-7d1c-4682-8b6c-f46aec92cef3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:46.671989 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05fb0c9-7d1c-4682-8b6c-f46aec92cef3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:46.673423 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05fb0c9-7d1c-4682-8b6c-f46aec92cef3 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:46.685765 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 305/602] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 03:27:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:46.686930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7a39f-c3c6-42d4-b4fa-a34d45216d49 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:46.687213 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7a39f-c3c6-42d4-b4fa-a34d45216d49 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:46.687486 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7a39f-c3c6-42d4-b4fa-a34d45216d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:46.707246 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c0c7a39f-c3c6-42d4-b4fa-a34d45216d49 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:46.708429 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c0c7a39f-c3c6-42d4-b4fa-a34d45216d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:46.722396 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:46.765004 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9a302-2f47-4c5a-b6b1-3f662701785f None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:46.778544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:46.778707 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 306/603] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:27:46.779544 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7a39f-c3c6-42d4-b4fa-a34d45216d49 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:46.814450 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b43ef-25a0-440b-8710-076f530555e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:46.815566 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b43ef-25a0-440b-8710-076f530555e8 None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:46.816058 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b43ef-25a0-440b-8710-076f530555e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:46.816578 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b43ef-25a0-440b-8710-076f530555e8 None admin] PATH_INFO: `/v3/projects/a0e46c2a2c62402dbf6d8461204b47d2/users/c09d1a4ac8b64921a6b05fcd567bb770/roles/8a338e321ece4061b4b30d6231167b4e` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:46.832309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b43ef-25a0-440b-8710-076f530555e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=a0e46c2a2c62402dbf6d8461204b47d2, user_id=c09d1a4ac8b64921a6b05fcd567bb770, role_id=8a338e321ece4061b4b30d6231167b4e)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:46.834180 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b43ef-25a0-440b-8710-076f530555e8 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:46.893212 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7a39f-c3c6-42d4-b4fa-a34d45216d49 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:46.904152 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 298/604] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 03:27:46 2022] PUT /identity/v3/projects/a0e46c2a2c62402dbf6d8461204b47d2/users/c09d1a4ac8b64921a6b05fcd567bb770/roles/8a338e321ece4061b4b30d6231167b4e => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:27:46.905856 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b43ef-25a0-440b-8710-076f530555e8 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:46.951497 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b2fcb-9395-4ebb-aee7-4bac0c17d102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:46.952128 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b2fcb-9395-4ebb-aee7-4bac0c17d102 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:46.952414 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b2fcb-9395-4ebb-aee7-4bac0c17d102 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:46.952692 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b2fcb-9395-4ebb-aee7-4bac0c17d102 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:46.953344 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b2fcb-9395-4ebb-aee7-4bac0c17d102 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:46.953661 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b2fcb-9395-4ebb-aee7-4bac0c17d102 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:46.958615 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b2fcb-9395-4ebb-aee7-4bac0c17d102 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:46.979715 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 307/605] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:27:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:46.985921 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b2fcb-9395-4ebb-aee7-4bac0c17d102 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:46.998060 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:47.041762 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b43ef-25a0-440b-8710-076f530555e8 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:47.089602 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107afbc-8f1b-4c1b-aa52-7274d77f4bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:47.091288 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107afbc-8f1b-4c1b-aa52-7274d77f4bf3 None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:47.091929 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107afbc-8f1b-4c1b-aa52-7274d77f4bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:47.092511 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107afbc-8f1b-4c1b-aa52-7274d77f4bf3 None admin] PATH_INFO: `/v3/projects/a0e46c2a2c62402dbf6d8461204b47d2/users/ae04099495a24a04801563cf18dc5626/roles/8a338e321ece4061b4b30d6231167b4e` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:47.115343 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c107afbc-8f1b-4c1b-aa52-7274d77f4bf3 None admin] RBAC: Authorizing `identity:create_grant(project_id=a0e46c2a2c62402dbf6d8461204b47d2, user_id=ae04099495a24a04801563cf18dc5626, role_id=8a338e321ece4061b4b30d6231167b4e)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:47.117590 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c107afbc-8f1b-4c1b-aa52-7274d77f4bf3 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:47.145066 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b2fcb-9395-4ebb-aee7-4bac0c17d102 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:47.183855 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4b983-20bc-49d1-b43b-3c0b72e7d38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:47.184507 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4b983-20bc-49d1-b43b-3c0b72e7d38b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:47.184774 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4b983-20bc-49d1-b43b-3c0b72e7d38b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:47.185047 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4b983-20bc-49d1-b43b-3c0b72e7d38b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:47.192053 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4b983-20bc-49d1-b43b-3c0b72e7d38b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:47.193484 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4b983-20bc-49d1-b43b-3c0b72e7d38b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:47.204905 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-cec4b983-20bc-49d1-b43b-3c0b72e7d38b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:27:47.204905 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:47.204905 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:47.204905 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:47.204905 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:47.204905 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:47.204905 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:47.204905 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:47.204905 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:47.204905 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:47.204905 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:47.204905 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:47.204905 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 03:27:47.204905 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 03:27:47.204905 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 03:27:47.206070 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 03:27:47.206070 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:47.206070 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:47.206070 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:47.206070 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:47.206070 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:47.206070 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:47.206070 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:47.206070 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:47.206070 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:47.206070 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:47.206070 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:47.206070 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:47.206070 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:47.206070 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:47.206070 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:47.206070 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:47.207612 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 03:27:47.207612 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 03:27:47.207612 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 03:27:47.207612 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 03:27:47.207612 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 03:27:47.207612 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 03:27:47.207612 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:27:47.207612 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:47.207612 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 308/606] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:27:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:47.207612 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4b983-20bc-49d1-b43b-3c0b72e7d38b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:47.219771 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 299/607] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 03:27:46 2022] PUT /identity/v3/projects/a0e46c2a2c62402dbf6d8461204b47d2/users/ae04099495a24a04801563cf18dc5626/roles/8a338e321ece4061b4b30d6231167b4e => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:27:47.220726 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107afbc-8f1b-4c1b-aa52-7274d77f4bf3 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:47.258013 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:47.289849 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:47.327839 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4b983-20bc-49d1-b43b-3c0b72e7d38b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:47.367615 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff353b5-e135-4a5a-b1b0-2c481f4aa277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:47.368268 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff353b5-e135-4a5a-b1b0-2c481f4aa277 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:47.368555 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff353b5-e135-4a5a-b1b0-2c481f4aa277 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:47.368833 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff353b5-e135-4a5a-b1b0-2c481f4aa277 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:47.382146 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff353b5-e135-4a5a-b1b0-2c481f4aa277 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:47.388816 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-9ff353b5-e135-4a5a-b1b0-2c481f4aa277 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 03:27:47.388816 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:47.388816 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:47.388816 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:47.388816 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:47.388816 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:47.388816 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:47.388816 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:47.388816 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:47.388816 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:47.388816 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:47.388816 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:47.388816 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:47.388816 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:47.388816 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:47.388816 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:47.389826 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:47.389826 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:47.389826 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:47.389826 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:47.389826 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:47.389826 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:47.389826 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:47.389826 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:47.389826 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:47.389826 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:47.389826 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:47.389826 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:47.389826 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:47.389826 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:47.389826 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:47.389826 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:47.390745 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:47.390745 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:47.390745 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:47.390745 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:47.390745 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:47.390745 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:47.390745 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:47.390745 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:47.390745 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:47.390745 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:47.390745 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 03:27:47.390745 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:47.390745 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 309/608] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 03:27:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:47.398789 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff353b5-e135-4a5a-b1b0-2c481f4aa277 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:47.441544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107afbc-8f1b-4c1b-aa52-7274d77f4bf3 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:47.498398 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81301731-c187-4300-ba69-7fc5c5814ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:47.499021 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81301731-c187-4300-ba69-7fc5c5814ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:47.499301 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81301731-c187-4300-ba69-7fc5c5814ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:47.499575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81301731-c187-4300-ba69-7fc5c5814ee2 None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:47.500269 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81301731-c187-4300-ba69-7fc5c5814ee2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:47.500574 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81301731-c187-4300-ba69-7fc5c5814ee2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:47.504167 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81301731-c187-4300-ba69-7fc5c5814ee2 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:47.516251 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 300/609] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 03:27:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:47.522500 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81301731-c187-4300-ba69-7fc5c5814ee2 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:47.589951 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff353b5-e135-4a5a-b1b0-2c481f4aa277 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:47.646022 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:47.664505 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f2e51-27b7-4744-be51-59ce6fd03f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:47.664788 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:47.665382 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f2e51-27b7-4744-be51-59ce6fd03f1d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:47.665909 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f2e51-27b7-4744-be51-59ce6fd03f1d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:47.666288 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f2e51-27b7-4744-be51-59ce6fd03f1d None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:47.667063 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f2e51-27b7-4744-be51-59ce6fd03f1d None admin] RBAC: Adding query filter params (name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:47.667473 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f2e51-27b7-4744-be51-59ce6fd03f1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:47.669000 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f2e51-27b7-4744-be51-59ce6fd03f1d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:47.682532 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 310/610] 10.222.0.33 () {56 vars in 1103 bytes} [Fri Sep 16 03:27:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:47.692270 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f2e51-27b7-4744-be51-59ce6fd03f1d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:47.726814 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81301731-c187-4300-ba69-7fc5c5814ee2 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:47.771536 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463da1ab-687a-46a5-a69b-fc4c85d97b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:47.772269 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463da1ab-687a-46a5-a69b-fc4c85d97b85 None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:47.772557 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463da1ab-687a-46a5-a69b-fc4c85d97b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:47.772832 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463da1ab-687a-46a5-a69b-fc4c85d97b85 None admin] PATH_INFO: `/v3/projects/a0e46c2a2c62402dbf6d8461204b47d2/users/d193a353763e43d0b5e8b49702f09faa/roles/8a338e321ece4061b4b30d6231167b4e` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:47.810523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463da1ab-687a-46a5-a69b-fc4c85d97b85 None admin] RBAC: Authorizing `identity:create_grant(project_id=a0e46c2a2c62402dbf6d8461204b47d2, user_id=d193a353763e43d0b5e8b49702f09faa, role_id=8a338e321ece4061b4b30d6231167b4e)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:47.812155 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463da1ab-687a-46a5-a69b-fc4c85d97b85 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:47.839713 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f2e51-27b7-4744-be51-59ce6fd03f1d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:47.875275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e058f-dea1-4dd6-9157-9ac6aa9819f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:47.875830 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e058f-dea1-4dd6-9157-9ac6aa9819f8 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:47.876107 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e058f-dea1-4dd6-9157-9ac6aa9819f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:47.876376 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e058f-dea1-4dd6-9157-9ac6aa9819f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:47.887829 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e058f-dea1-4dd6-9157-9ac6aa9819f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:47.889276 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e058f-dea1-4dd6-9157-9ac6aa9819f8 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:47.906188 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-260e058f-dea1-4dd6-9157-9ac6aa9819f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:47.906188 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:47.906188 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:47.906188 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:47.906188 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:47.906188 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:47.906188 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:47.906188 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:47.906188 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:47.906188 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:47.906188 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:47.906188 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:47.906188 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:27:47.906188 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:27:47.906188 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:27:47.906188 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:27:47.911096 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:47.911096 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:47.911096 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:47.911096 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:47.911096 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:47.911096 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:47.911096 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:47.911096 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:47.911096 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:47.911096 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:47.911096 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:47.911096 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:47.911096 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:47.911096 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:47.911096 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:47.911096 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:47.911096 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:27:47.912004 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:27:47.912004 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:47.912004 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:47.912004 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 311/612] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:27:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:47.912236 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 301/612] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 03:27:47 2022] PUT /identity/v3/projects/a0e46c2a2c62402dbf6d8461204b47d2/users/d193a353763e43d0b5e8b49702f09faa/roles/8a338e321ece4061b4b30d6231167b4e => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:27:47.924367 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e058f-dea1-4dd6-9157-9ac6aa9819f8 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:47.991763 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:48.071628 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e058f-dea1-4dd6-9157-9ac6aa9819f8 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:48.122857 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a303a1d-8852-4cbf-8bc7-8ba355330379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:48.123479 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a303a1d-8852-4cbf-8bc7-8ba355330379 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:48.123757 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a303a1d-8852-4cbf-8bc7-8ba355330379 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:48.124034 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a303a1d-8852-4cbf-8bc7-8ba355330379 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:48.124677 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a303a1d-8852-4cbf-8bc7-8ba355330379 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:48.124979 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a303a1d-8852-4cbf-8bc7-8ba355330379 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:48.126489 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a303a1d-8852-4cbf-8bc7-8ba355330379 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:48.140208 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 312/613] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:48.146270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463da1ab-687a-46a5-a69b-fc4c85d97b85 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:48.270292 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463da1ab-687a-46a5-a69b-fc4c85d97b85 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:48.307008 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:48.321427 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276fd378-19ac-4ff4-bf75-8d8a19c3822d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:48.327897 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fd378-19ac-4ff4-bf75-8d8a19c3822d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:48.327897 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fd378-19ac-4ff4-bf75-8d8a19c3822d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:48.327897 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fd378-19ac-4ff4-bf75-8d8a19c3822d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:48.333146 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276fd378-19ac-4ff4-bf75-8d8a19c3822d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:48.334733 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276fd378-19ac-4ff4-bf75-8d8a19c3822d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:48.354519 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-276fd378-19ac-4ff4-bf75-8d8a19c3822d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 16 03:27:48.354519 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:48.354519 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:48.354519 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:48.354519 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:48.354519 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:48.354519 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:48.354519 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:48.354519 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:48.354519 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:48.354519 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:48.354519 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:48.354519 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 03:27:48.354519 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 03:27:48.354519 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 03:27:48.354519 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 03:27:48.355763 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:48.355763 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:48.355763 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 03:27:48.355763 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:27:48.355763 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 03:27:48.355763 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:27:48.355763 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:48.355763 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:48.355763 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:48.355763 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:48.355763 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:48.355763 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:48.355763 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:48.355763 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:48.355763 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:48.355763 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:48.355763 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:48.355763 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:48.356949 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:48.356949 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:48.356949 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 03:27:48.356949 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 03:27:48.356949 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 03:27:48.356949 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 03:27:48.356949 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 03:27:48.356949 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 03:27:48.356949 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 16 03:27:48.356949 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:48.356949 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 302/614] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 03:27:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:48.364156 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a303a1d-8852-4cbf-8bc7-8ba355330379 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:48.403699 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116010e3-98af-436a-a824-927f66ad4bde None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:48.403900 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116010e3-98af-436a-a824-927f66ad4bde None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:48.404158 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116010e3-98af-436a-a824-927f66ad4bde None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:48.405830 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 303/615] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:48.423451 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34642ed0-17e6-4027-be84-7df5498f36c5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:48.423940 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34642ed0-17e6-4027-be84-7df5498f36c5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:48.424387 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34642ed0-17e6-4027-be84-7df5498f36c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:48.451802 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-34642ed0-17e6-4027-be84-7df5498f36c5 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:48.453743 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-34642ed0-17e6-4027-be84-7df5498f36c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:48.520644 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a303a1d-8852-4cbf-8bc7-8ba355330379 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:48.522894 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:48.525231 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 304/616] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:27:48.565107 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a0291-cc79-4342-acd4-dc69fb6f93f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:48.565821 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a0291-cc79-4342-acd4-dc69fb6f93f0 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:48.566029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a0291-cc79-4342-acd4-dc69fb6f93f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:48.566303 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a0291-cc79-4342-acd4-dc69fb6f93f0 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:48.567031 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a0291-cc79-4342-acd4-dc69fb6f93f0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:48.567334 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a0291-cc79-4342-acd4-dc69fb6f93f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:48.568768 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a0291-cc79-4342-acd4-dc69fb6f93f0 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:48.596541 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 313/617] 10.222.0.33 () {56 vars in 1135 bytes} [Fri Sep 16 03:27:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:48.598246 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34642ed0-17e6-4027-be84-7df5498f36c5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:48.740401 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34642ed0-17e6-4027-be84-7df5498f36c5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:48.755110 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:48.776389 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c892c28-2a38-4cfb-843e-319453cc7577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:48.777026 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c892c28-2a38-4cfb-843e-319453cc7577 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:48.777308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c892c28-2a38-4cfb-843e-319453cc7577 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:48.777582 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c892c28-2a38-4cfb-843e-319453cc7577 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:48.787959 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c892c28-2a38-4cfb-843e-319453cc7577 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:48.789557 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c892c28-2a38-4cfb-843e-319453cc7577 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:48.805376 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-0c892c28-2a38-4cfb-843e-319453cc7577 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:48.805376 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:48.805376 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:48.805376 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:48.805376 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:48.805376 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:48.805376 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:48.805376 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:48.805376 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:48.805376 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:48.805376 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:48.805376 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:48.805376 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:27:48.805376 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:27:48.805376 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:27:48.805376 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:27:48.806534 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:48.806534 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:48.806534 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:48.806534 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:48.806534 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:48.806534 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:48.806534 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:48.806534 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:48.806534 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:48.806534 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:48.806534 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:48.806534 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:48.806534 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:48.806534 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:48.806534 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:48.806534 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:48.806534 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:27:48.807392 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:27:48.807392 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:48.807392 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:48.807392 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 305/618] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:27:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:48.812417 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a0291-cc79-4342-acd4-dc69fb6f93f0 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:48.921624 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c892c28-2a38-4cfb-843e-319453cc7577 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:48.939485 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a0291-cc79-4342-acd4-dc69fb6f93f0 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:48.979369 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cf64b-7adc-4c53-bc1b-6cfc7341da21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:48.980137 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cf64b-7adc-4c53-bc1b-6cfc7341da21 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:48.980489 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cf64b-7adc-4c53-bc1b-6cfc7341da21 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:48.980836 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cf64b-7adc-4c53-bc1b-6cfc7341da21 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:48.981566 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4cf64b-7adc-4c53-bc1b-6cfc7341da21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:48.982107 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4cf64b-7adc-4c53-bc1b-6cfc7341da21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:48.984471 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4cf64b-7adc-4c53-bc1b-6cfc7341da21 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:48.999380 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 314/619] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:49.005436 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cf64b-7adc-4c53-bc1b-6cfc7341da21 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:49.031744 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:49.125085 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c892c28-2a38-4cfb-843e-319453cc7577 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:49.173204 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cf64b-7adc-4c53-bc1b-6cfc7341da21 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:49.195337 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e68f7-22df-4726-8e39-eff7f7878c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:49.196345 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e68f7-22df-4726-8e39-eff7f7878c45 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:49.196835 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e68f7-22df-4726-8e39-eff7f7878c45 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:49.197416 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e68f7-22df-4726-8e39-eff7f7878c45 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:49.212072 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ebc06-d70c-47df-ac39-8f9e9d6c2f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:49.213089 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ebc06-d70c-47df-ac39-8f9e9d6c2f5b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:49.213562 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ebc06-d70c-47df-ac39-8f9e9d6c2f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:49.214057 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ebc06-d70c-47df-ac39-8f9e9d6c2f5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:49.221785 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ebc06-d70c-47df-ac39-8f9e9d6c2f5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:49.222214 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e68f7-22df-4726-8e39-eff7f7878c45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:49.223686 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ebc06-d70c-47df-ac39-8f9e9d6c2f5b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:49.228639 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-989e68f7-22df-4726-8e39-eff7f7878c45 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 03:27:49.228639 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:49.228639 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:49.228639 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:49.228639 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:49.228639 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:49.228639 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:49.228639 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:49.228639 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:49.228639 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:49.228639 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:49.228639 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:49.228639 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:49.228639 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:49.228639 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:49.228639 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:49.229599 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:49.229599 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:49.229599 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:49.229599 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:49.229599 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:49.229599 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:49.229599 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:49.229599 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:49.229599 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:49.229599 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:49.229599 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:49.229599 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:49.229599 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:49.229599 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:49.229599 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:49.229599 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:49.230461 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:49.230461 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:49.230461 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:49.230461 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:49.230461 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:49.230461 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:49.230461 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:49.230461 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:49.230461 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:49.230461 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:49.230461 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 03:27:49.230461 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:49.230461 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 306/620] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 03:27:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:27:49.235322 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e68f7-22df-4726-8e39-eff7f7878c45 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:49.239111 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-0c2ebc06-d70c-47df-ac39-8f9e9d6c2f5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:27:49.239111 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:49.239111 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:49.239111 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:49.239111 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:49.239111 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:49.239111 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:49.239111 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:49.239111 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:49.239111 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:49.239111 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:49.239111 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:49.239111 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 03:27:49.239111 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 03:27:49.239111 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 03:27:49.239966 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 03:27:49.239966 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:49.239966 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:49.239966 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:49.239966 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:49.239966 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:49.239966 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:49.239966 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:49.239966 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:49.239966 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:49.239966 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:49.239966 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:49.239966 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:49.239966 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:49.239966 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:49.239966 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:49.239966 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:49.241396 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 03:27:49.241396 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 03:27:49.241396 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 03:27:49.241396 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 03:27:49.241396 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 03:27:49.241396 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 03:27:49.241396 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:27:49.241396 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:49.243730 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 315/621] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:27:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:27:49.245333 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ddd20-19c9-449f-af9b-d2de96f5de2e None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:49.245864 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ddd20-19c9-449f-af9b-d2de96f5de2e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:49.246362 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ddd20-19c9-449f-af9b-d2de96f5de2e None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:49.248067 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 316/622] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:49.248938 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ddd20-19c9-449f-af9b-d2de96f5de2e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:49.274959 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:49.335227 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:49.349926 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e68f7-22df-4726-8e39-eff7f7878c45 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:49.357672 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ddd20-19c9-449f-af9b-d2de96f5de2e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:49.384637 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f8762-f25e-4e85-a72c-b68bd1df8eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:49.385295 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f8762-f25e-4e85-a72c-b68bd1df8eea None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:49.385575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f8762-f25e-4e85-a72c-b68bd1df8eea None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:49.385889 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f8762-f25e-4e85-a72c-b68bd1df8eea None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:49.386624 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f8762-f25e-4e85-a72c-b68bd1df8eea None admin] RBAC: Adding query filter params (name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:49.386881 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f8762-f25e-4e85-a72c-b68bd1df8eea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:49.388320 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f8762-f25e-4e85-a72c-b68bd1df8eea None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:49.396116 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f83745-4a70-431a-b991-b5b0603ee02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:49.397478 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f83745-4a70-431a-b991-b5b0603ee02f None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:49.398043 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 307/623] 10.222.0.33 () {56 vars in 1103 bytes} [Fri Sep 16 03:27:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:27:49.398533 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f83745-4a70-431a-b991-b5b0603ee02f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:49.399105 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958e812-3e25-49e5-be9b-7fecdebcea4b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:49.399319 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f83745-4a70-431a-b991-b5b0603ee02f None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:49.399419 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958e812-3e25-49e5-be9b-7fecdebcea4b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:49.399643 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958e812-3e25-49e5-be9b-7fecdebcea4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:49.400637 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f83745-4a70-431a-b991-b5b0603ee02f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:49.401180 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f83745-4a70-431a-b991-b5b0603ee02f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:49.403452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f83745-4a70-431a-b991-b5b0603ee02f None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:49.417767 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 317/624] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 03:27:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:49.418041 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8958e812-3e25-49e5-be9b-7fecdebcea4b None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:49.419131 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f83745-4a70-431a-b991-b5b0603ee02f None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:49.419310 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8958e812-3e25-49e5-be9b-7fecdebcea4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:49.486784 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 308/625] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:27:49.487578 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958e812-3e25-49e5-be9b-7fecdebcea4b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:49.514602 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:49.583607 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f83745-4a70-431a-b991-b5b0603ee02f None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:49.587566 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958e812-3e25-49e5-be9b-7fecdebcea4b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:49.621897 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0af73-636b-4ad2-8e0b-96e47a358bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:49.622555 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0af73-636b-4ad2-8e0b-96e47a358bf0 None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:49.622833 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0af73-636b-4ad2-8e0b-96e47a358bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:49.623102 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0af73-636b-4ad2-8e0b-96e47a358bf0 None admin] PATH_INFO: `/v3/projects/a0e46c2a2c62402dbf6d8461204b47d2/users/9f784d98d5f440c681f53ae70f6d1cc7/roles/8a338e321ece4061b4b30d6231167b4e` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:49.638245 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c0af73-636b-4ad2-8e0b-96e47a358bf0 None admin] RBAC: Authorizing `identity:create_grant(project_id=a0e46c2a2c62402dbf6d8461204b47d2, user_id=9f784d98d5f440c681f53ae70f6d1cc7, role_id=8a338e321ece4061b4b30d6231167b4e)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:49.639682 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c0af73-636b-4ad2-8e0b-96e47a358bf0 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:49.669311 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ee43e-3c0c-4fd8-aeba-5c606da275b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:49.669991 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ee43e-3c0c-4fd8-aeba-5c606da275b3 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:49.670243 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ee43e-3c0c-4fd8-aeba-5c606da275b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:49.670512 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ee43e-3c0c-4fd8-aeba-5c606da275b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:49.681019 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:49.683674 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ee43e-3c0c-4fd8-aeba-5c606da275b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:49.685241 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ee43e-3c0c-4fd8-aeba-5c606da275b3 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:49.702450 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-c54ee43e-3c0c-4fd8-aeba-5c606da275b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:49.702450 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:49.702450 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:49.702450 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:49.702450 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:49.702450 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:49.702450 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:49.702450 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:49.702450 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:49.702450 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:49.702450 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:49.702450 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:49.702450 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:27:49.702450 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:27:49.702450 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:27:49.702450 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:27:49.703667 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:49.703667 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:49.703667 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:49.703667 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:49.703667 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:49.703667 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:49.703667 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:49.703667 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:49.703667 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:49.703667 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:49.703667 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:49.703667 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:49.703667 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:49.703667 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:49.703667 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:49.703667 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:49.703667 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:27:49.704546 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:27:49.704546 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:49.704546 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:49.704546 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 318/626] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:27:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:49.708971 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ee43e-3c0c-4fd8-aeba-5c606da275b3 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:49.718896 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 309/627] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 03:27:49 2022] PUT /identity/v3/projects/a0e46c2a2c62402dbf6d8461204b47d2/users/9f784d98d5f440c681f53ae70f6d1cc7/roles/8a338e321ece4061b4b30d6231167b4e => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:27:49.828088 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ee43e-3c0c-4fd8-aeba-5c606da275b3 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:49.835170 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0af73-636b-4ad2-8e0b-96e47a358bf0 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:49.867907 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254ad42-f237-4f33-9aa8-99a1ca76ceb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:49.868605 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254ad42-f237-4f33-9aa8-99a1ca76ceb4 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:49.868882 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254ad42-f237-4f33-9aa8-99a1ca76ceb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:49.869154 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254ad42-f237-4f33-9aa8-99a1ca76ceb4 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:49.870204 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254ad42-f237-4f33-9aa8-99a1ca76ceb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:49.870512 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254ad42-f237-4f33-9aa8-99a1ca76ceb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:49.871926 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254ad42-f237-4f33-9aa8-99a1ca76ceb4 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:49.886704 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 319/628] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:49.891445 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254ad42-f237-4f33-9aa8-99a1ca76ceb4 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:49.955976 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:49.971454 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:50.009843 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0af73-636b-4ad2-8e0b-96e47a358bf0 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:50.019561 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254ad42-f237-4f33-9aa8-99a1ca76ceb4 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:50.049953 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8e8e8-dcd3-4ba9-b4e1-73013dd90bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:50.050687 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8e8e8-dcd3-4ba9-b4e1-73013dd90bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:50.050997 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8e8e8-dcd3-4ba9-b4e1-73013dd90bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:50.051229 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8e8e8-dcd3-4ba9-b4e1-73013dd90bd8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:50.058521 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7c362-7bd8-49bd-84ea-b2fb1689cc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:50.059157 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7c362-7bd8-49bd-84ea-b2fb1689cc7e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:50.059433 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7c362-7bd8-49bd-84ea-b2fb1689cc7e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:50.059706 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7c362-7bd8-49bd-84ea-b2fb1689cc7e None admin] PATH_INFO: `/v3/users/glance` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:50.062686 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8e8e8-dcd3-4ba9-b4e1-73013dd90bd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:50.067247 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7c362-7bd8-49bd-84ea-b2fb1689cc7e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:50.067626 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-5fa8e8e8-dcd3-4ba9-b4e1-73013dd90bd8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 03:27:50.067626 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:50.067626 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:50.067626 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:50.067626 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:50.067626 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:50.067626 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:50.067626 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:50.067626 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:50.067626 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:50.067626 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:50.067626 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:50.067626 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:50.067626 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:50.067626 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:50.067626 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:50.068508 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:50.068508 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:50.068508 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:50.068508 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:50.068508 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:50.068508 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:50.068508 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:50.068508 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:50.068508 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:50.068508 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:50.068508 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:50.068508 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:50.068508 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:50.068508 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:50.068508 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:50.068508 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:50.070299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:50.070299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:50.070299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:50.070299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:50.070299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:50.070299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:50.070299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:50.070299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:50.070299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:50.070299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:50.070299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 03:27:50.070299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:50.071137 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7c362-7bd8-49bd-84ea-b2fb1689cc7e None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:50.071216 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 310/629] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 03:27:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:27:50.075236 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdbddd-6e0d-427d-9a85-cb4a25a1f69b None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:50.075575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdbddd-6e0d-427d-9a85-cb4a25a1f69b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:50.075853 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdbddd-6e0d-427d-9a85-cb4a25a1f69b None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:50.077146 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 311/630] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:50.079308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bdbddd-6e0d-427d-9a85-cb4a25a1f69b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:50.081982 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-19e7c362-7bd8-49bd-84ea-b2fb1689cc7e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 16 03:27:50.081982 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:50.081982 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:50.081982 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:50.081982 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:50.081982 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:50.081982 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:50.081982 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:50.081982 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:50.081982 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:50.081982 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:50.081982 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:50.081982 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 03:27:50.081982 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 03:27:50.081982 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 03:27:50.081982 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 03:27:50.084198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:50.084198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:50.084198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 03:27:50.084198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:27:50.084198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 03:27:50.084198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:27:50.084198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:50.084198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:50.084198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:50.084198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:50.084198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:50.084198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:50.084198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:50.084198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:50.084198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:50.084198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:50.084198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:50.084198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:50.086531 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:50.086531 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:50.086531 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 03:27:50.086531 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 03:27:50.086531 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 03:27:50.086531 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 03:27:50.086531 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 03:27:50.086531 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 03:27:50.086531 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 16 03:27:50.086531 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:50.086531 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 320/631] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:27:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:50.086531 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5c60e-2a71-4691-9c40-1fbca57983bf None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:50.086531 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5c60e-2a71-4691-9c40-1fbca57983bf None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:50.088190 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5c60e-2a71-4691-9c40-1fbca57983bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:50.111445 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9ce5c60e-2a71-4691-9c40-1fbca57983bf None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:50.112903 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9ce5c60e-2a71-4691-9c40-1fbca57983bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:50.195780 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 321/632] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:27:50.196634 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5c60e-2a71-4691-9c40-1fbca57983bf None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:50.203917 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bdbddd-6e0d-427d-9a85-cb4a25a1f69b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:50.255298 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:50.268952 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8090bbb-cd32-4896-bd74-3c96f7bde3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:50.269565 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8090bbb-cd32-4896-bd74-3c96f7bde3ee None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:50.269864 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8090bbb-cd32-4896-bd74-3c96f7bde3ee None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:50.270273 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8090bbb-cd32-4896-bd74-3c96f7bde3ee None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:50.271193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8090bbb-cd32-4896-bd74-3c96f7bde3ee None admin] RBAC: Adding query filter params (name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:50.271489 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8090bbb-cd32-4896-bd74-3c96f7bde3ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:50.274104 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8090bbb-cd32-4896-bd74-3c96f7bde3ee None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:50.283704 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:50.292601 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 312/633] 10.222.0.33 () {56 vars in 1103 bytes} [Fri Sep 16 03:27:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:27:50.299154 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8090bbb-cd32-4896-bd74-3c96f7bde3ee None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:50.360555 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5c60e-2a71-4691-9c40-1fbca57983bf None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:50.398765 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa2766-6ae2-462a-b02a-a524d52850f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:50.399375 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa2766-6ae2-462a-b02a-a524d52850f5 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:50.399652 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa2766-6ae2-462a-b02a-a524d52850f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:50.399923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa2766-6ae2-462a-b02a-a524d52850f5 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:50.400637 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa2766-6ae2-462a-b02a-a524d52850f5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:50.400937 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa2766-6ae2-462a-b02a-a524d52850f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:50.402734 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa2766-6ae2-462a-b02a-a524d52850f5 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:50.426035 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 322/634] 10.222.0.33 () {56 vars in 1137 bytes} [Fri Sep 16 03:27:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:50.427362 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa2766-6ae2-462a-b02a-a524d52850f5 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:50.501672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8090bbb-cd32-4896-bd74-3c96f7bde3ee None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:50.533402 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:50.536386 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa2766-6ae2-462a-b02a-a524d52850f5 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:50.542745 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8877f8-8de8-4e61-841c-26f62e392b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:50.543390 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8877f8-8de8-4e61-841c-26f62e392b11 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:50.543734 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8877f8-8de8-4e61-841c-26f62e392b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:50.544024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8877f8-8de8-4e61-841c-26f62e392b11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:50.556106 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8877f8-8de8-4e61-841c-26f62e392b11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:50.557562 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8877f8-8de8-4e61-841c-26f62e392b11 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:50.572631 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-fa8877f8-8de8-4e61-841c-26f62e392b11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:50.572631 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:50.572631 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:50.572631 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:50.572631 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:50.572631 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:50.572631 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:50.572631 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:50.572631 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:50.572631 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:50.572631 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:50.572631 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:50.572631 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:27:50.572631 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:27:50.572631 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:27:50.572631 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:27:50.573825 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:50.573825 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:50.573825 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:50.573825 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:50.573825 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:50.573825 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:50.573825 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:50.573825 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:50.573825 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:50.573825 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:50.573825 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:50.573825 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:50.573825 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:50.573825 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:50.573825 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:50.573825 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:50.573825 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:27:50.575019 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:27:50.575019 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:50.575019 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:50.575019 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 313/635] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:27:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:27:50.575019 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8877f8-8de8-4e61-841c-26f62e392b11 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:50.583583 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91976fc-c8c3-4e50-ab02-8991ddc14ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:50.584204 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91976fc-c8c3-4e50-ab02-8991ddc14ee4 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:50.584567 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91976fc-c8c3-4e50-ab02-8991ddc14ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:50.585136 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91976fc-c8c3-4e50-ab02-8991ddc14ee4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:50.637812 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:50.675761 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91976fc-c8c3-4e50-ab02-8991ddc14ee4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:50.677450 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91976fc-c8c3-4e50-ab02-8991ddc14ee4 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:50.696864 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8877f8-8de8-4e61-841c-26f62e392b11 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:50.732208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c402f4-bee5-4067-9151-9c1cb4079047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:50.732839 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c402f4-bee5-4067-9151-9c1cb4079047 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:50.733116 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c402f4-bee5-4067-9151-9c1cb4079047 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:50.733386 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c402f4-bee5-4067-9151-9c1cb4079047 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:50.743388 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c402f4-bee5-4067-9151-9c1cb4079047 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:50.748778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-35c402f4-bee5-4067-9151-9c1cb4079047 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 03:27:50.748778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:50.748778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:50.748778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:50.748778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:50.748778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:50.748778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:50.748778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:50.748778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:50.748778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:50.748778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:50.748778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:50.748778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:50.748778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:50.748778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:50.748778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:50.749922 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:50.749922 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:50.749922 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:50.749922 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:50.749922 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:50.749922 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:50.749922 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:50.749922 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:50.749922 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:50.749922 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:50.749922 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:50.749922 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:50.749922 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:50.749922 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:50.749922 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:50.749922 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:50.750950 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:50.750950 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:50.750950 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:50.750950 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:50.750950 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:50.750950 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:50.750950 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:50.750950 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:50.750950 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:50.750950 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:50.750950 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 03:27:50.750950 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:50.750950 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 314/636] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 03:27:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:50.750950 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c402f4-bee5-4067-9151-9c1cb4079047 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:50.796324 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:50.799820 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 323/637] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:27:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 16 03:27:50.801048 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad96679-8540-4114-b3fa-b9953d44546c None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:50.801331 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad96679-8540-4114-b3fa-b9953d44546c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:50.801603 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad96679-8540-4114-b3fa-b9953d44546c None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:50.802988 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 324/638] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:50.807646 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad96679-8540-4114-b3fa-b9953d44546c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:50.869009 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c402f4-bee5-4067-9151-9c1cb4079047 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:50.870704 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:50.903726 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13c0bf-d50c-4315-86f8-ff7774422eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:50.904707 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13c0bf-d50c-4315-86f8-ff7774422eb7 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:50.905185 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13c0bf-d50c-4315-86f8-ff7774422eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:50.905683 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13c0bf-d50c-4315-86f8-ff7774422eb7 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:50.906672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13c0bf-d50c-4315-86f8-ff7774422eb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:50.906978 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13c0bf-d50c-4315-86f8-ff7774422eb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:50.908339 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13c0bf-d50c-4315-86f8-ff7774422eb7 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:50.914268 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad96679-8540-4114-b3fa-b9953d44546c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:50.924917 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 315/639] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:50.924917 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13c0bf-d50c-4315-86f8-ff7774422eb7 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:50.954768 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f29ba-65a8-4af6-abce-f17fde58827c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:50.955372 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f29ba-65a8-4af6-abce-f17fde58827c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:50.955648 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f29ba-65a8-4af6-abce-f17fde58827c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:50.955916 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f29ba-65a8-4af6-abce-f17fde58827c None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:50.956596 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500f29ba-65a8-4af6-abce-f17fde58827c None admin] RBAC: Adding query filter params (name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:50.956896 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500f29ba-65a8-4af6-abce-f17fde58827c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:50.958282 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500f29ba-65a8-4af6-abce-f17fde58827c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:50.967567 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 325/640] 10.222.0.33 () {56 vars in 1103 bytes} [Fri Sep 16 03:27:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:50.968738 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb850c8-ae1f-4d8a-a27d-8d4e0ba82a13 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:50.969039 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb850c8-ae1f-4d8a-a27d-8d4e0ba82a13 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:50.969291 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb850c8-ae1f-4d8a-a27d-8d4e0ba82a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:50.988873 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-afb850c8-ae1f-4d8a-a27d-8d4e0ba82a13 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:50.990127 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-afb850c8-ae1f-4d8a-a27d-8d4e0ba82a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:51.031690 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13c0bf-d50c-4315-86f8-ff7774422eb7 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:51.050215 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:51.061374 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 326/641] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:27:51.062052 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb850c8-ae1f-4d8a-a27d-8d4e0ba82a13 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:51.078319 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da1893-9124-4b33-9881-a36ff4b3fa3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:51.079034 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da1893-9124-4b33-9881-a36ff4b3fa3b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:51.079612 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da1893-9124-4b33-9881-a36ff4b3fa3b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:51.079723 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da1893-9124-4b33-9881-a36ff4b3fa3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:51.091937 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da1893-9124-4b33-9881-a36ff4b3fa3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:51.093443 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da1893-9124-4b33-9881-a36ff4b3fa3b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:51.110760 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-08da1893-9124-4b33-9881-a36ff4b3fa3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:51.110760 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:51.110760 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:51.110760 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:51.110760 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:51.110760 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:51.110760 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:51.110760 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:51.110760 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:51.110760 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:51.110760 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:51.110760 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:51.110760 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:27:51.110760 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:27:51.110760 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:27:51.110760 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:27:51.111703 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:51.111703 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:51.111703 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:51.111703 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:51.111703 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:51.111703 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:51.111703 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:51.111703 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:51.111703 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:51.111703 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:51.111703 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:51.111703 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:51.111703 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:51.111703 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:51.111703 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:51.111703 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:51.111703 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:27:51.112627 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:27:51.112627 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:51.112627 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:51.117287 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 316/642] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:27:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:51.118207 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da1893-9124-4b33-9881-a36ff4b3fa3b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:51.143740 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:51.191154 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb850c8-ae1f-4d8a-a27d-8d4e0ba82a13 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:51.229157 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758197f-82ce-4687-b8b6-5bc44e1fb295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:51.229839 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758197f-82ce-4687-b8b6-5bc44e1fb295 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:51.230119 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758197f-82ce-4687-b8b6-5bc44e1fb295 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:51.230443 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758197f-82ce-4687-b8b6-5bc44e1fb295 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:51.238840 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758197f-82ce-4687-b8b6-5bc44e1fb295 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:51.241533 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758197f-82ce-4687-b8b6-5bc44e1fb295 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:51.243441 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da1893-9124-4b33-9881-a36ff4b3fa3b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:51.253425 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-d758197f-82ce-4687-b8b6-5bc44e1fb295 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 03:27:51.253425 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:51.253425 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:51.253425 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:51.253425 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:51.253425 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:51.253425 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:51.253425 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:51.253425 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:51.253425 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:51.253425 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:51.253425 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:51.253425 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 03:27:51.253425 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 03:27:51.253425 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 03:27:51.253425 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 03:27:51.254575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:51.254575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:51.254575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 03:27:51.254575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:27:51.254575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 03:27:51.254575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:27:51.254575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:51.254575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:51.254575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:51.254575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:51.254575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:51.254575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:51.254575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:51.254575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:51.254575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:51.254575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:51.254575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:51.254575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:51.255972 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:51.255972 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:51.255972 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 03:27:51.255972 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 03:27:51.255972 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 03:27:51.255972 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 03:27:51.255972 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 03:27:51.255972 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 03:27:51.255972 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 03:27:51.255972 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:51.259381 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 327/643] 10.222.0.33 () {56 vars in 1093 bytes} [Fri Sep 16 03:27:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:51.260254 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758197f-82ce-4687-b8b6-5bc44e1fb295 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:51.282804 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6454e-bea8-4220-afaf-51ee5b447271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:51.283746 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6454e-bea8-4220-afaf-51ee5b447271 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:51.284224 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6454e-bea8-4220-afaf-51ee5b447271 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:51.284716 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6454e-bea8-4220-afaf-51ee5b447271 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:51.296311 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed6454e-bea8-4220-afaf-51ee5b447271 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:51.298081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed6454e-bea8-4220-afaf-51ee5b447271 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:51.312600 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-fed6454e-bea8-4220-afaf-51ee5b447271 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:51.312600 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:51.312600 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:51.312600 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:51.312600 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:51.312600 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:51.312600 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:51.312600 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:51.312600 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:51.312600 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:51.312600 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:51.312600 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:51.312600 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:27:51.312600 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:27:51.312600 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:27:51.312600 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:27:51.313575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:51.313575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:51.313575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:51.313575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:51.313575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:51.313575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:51.313575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:51.313575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:51.313575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:51.313575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:51.313575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:51.313575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:51.313575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:51.313575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:51.313575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:51.313575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:51.313575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:27:51.314652 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:27:51.314652 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:51.314652 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:51.316368 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 317/644] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:27:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:51.317406 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6454e-bea8-4220-afaf-51ee5b447271 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:51.325097 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:51.379465 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758197f-82ce-4687-b8b6-5bc44e1fb295 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:51.384982 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:51.416918 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586204a2-d9c7-4ec1-9055-42ede21e495b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:51.417522 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586204a2-d9c7-4ec1-9055-42ede21e495b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:51.417827 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586204a2-d9c7-4ec1-9055-42ede21e495b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:51.418099 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586204a2-d9c7-4ec1-9055-42ede21e495b None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:51.418728 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586204a2-d9c7-4ec1-9055-42ede21e495b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:51.419028 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586204a2-d9c7-4ec1-9055-42ede21e495b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:51.420200 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6454e-bea8-4220-afaf-51ee5b447271 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:51.420384 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586204a2-d9c7-4ec1-9055-42ede21e495b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:51.433109 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 328/645] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:51.438198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586204a2-d9c7-4ec1-9055-42ede21e495b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:51.456448 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c98672-2c72-40a3-a8a5-1c67c82f6d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:51.457056 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c98672-2c72-40a3-a8a5-1c67c82f6d7b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:51.457469 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c98672-2c72-40a3-a8a5-1c67c82f6d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:51.457598 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c98672-2c72-40a3-a8a5-1c67c82f6d7b None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:51.458331 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c98672-2c72-40a3-a8a5-1c67c82f6d7b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:51.458636 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c98672-2c72-40a3-a8a5-1c67c82f6d7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:51.460767 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c98672-2c72-40a3-a8a5-1c67c82f6d7b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:51.482687 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 318/646] 10.222.0.33 () {56 vars in 1133 bytes} [Fri Sep 16 03:27:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:51.482687 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c98672-2c72-40a3-a8a5-1c67c82f6d7b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:51.547800 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586204a2-d9c7-4ec1-9055-42ede21e495b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:51.561950 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:51.583152 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe6198-4041-494a-8d58-64a54c589123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:51.583764 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe6198-4041-494a-8d58-64a54c589123 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:51.584046 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe6198-4041-494a-8d58-64a54c589123 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:51.584224 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c98672-2c72-40a3-a8a5-1c67c82f6d7b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:51.585185 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe6198-4041-494a-8d58-64a54c589123 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:51.585463 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe6198-4041-494a-8d58-64a54c589123 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:51.585802 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe6198-4041-494a-8d58-64a54c589123 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:51.587418 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe6198-4041-494a-8d58-64a54c589123 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:51.603526 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 329/647] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:51.603526 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe6198-4041-494a-8d58-64a54c589123 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:51.612357 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:51.623158 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0874325-4f14-4c2a-b105-24c335a25cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:51.623792 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0874325-4f14-4c2a-b105-24c335a25cca None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:51.634119 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0874325-4f14-4c2a-b105-24c335a25cca None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:51.634119 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0874325-4f14-4c2a-b105-24c335a25cca None admin] PATH_INFO: `/v3/roles/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:51.634119 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0874325-4f14-4c2a-b105-24c335a25cca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:51.638756 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-f0874325-4f14-4c2a-b105-24c335a25cca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 03:27:51.638756 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:51.638756 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:51.638756 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:51.638756 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:51.638756 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:51.638756 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:51.638756 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:51.638756 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:51.638756 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:51.638756 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:51.638756 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:51.638756 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:51.638756 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:51.638756 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:51.638756 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:51.639669 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:51.639669 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:51.639669 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:51.639669 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:51.639669 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:51.639669 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:51.639669 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:51.639669 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:51.639669 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:51.639669 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:51.639669 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:51.639669 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:51.639669 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:51.639669 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:51.639669 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:51.639669 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:51.640480 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:51.640480 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:51.640480 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:51.640480 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:51.640480 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:51.640480 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:51.640480 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:51.640480 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:51.640480 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:51.640480 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:51.640480 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 03:27:51.640480 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:51.640480 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 319/648] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 03:27:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:51.641163 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0874325-4f14-4c2a-b105-24c335a25cca None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:51.718613 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe6198-4041-494a-8d58-64a54c589123 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:51.752333 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab5577-1dc2-47b6-9ed9-bfe01372507b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:51.753147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab5577-1dc2-47b6-9ed9-bfe01372507b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:51.753431 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab5577-1dc2-47b6-9ed9-bfe01372507b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:51.754020 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab5577-1dc2-47b6-9ed9-bfe01372507b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:51.756242 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0874325-4f14-4c2a-b105-24c335a25cca None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:51.761606 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab5577-1dc2-47b6-9ed9-bfe01372507b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:51.763045 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab5577-1dc2-47b6-9ed9-bfe01372507b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:51.774795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-b6ab5577-1dc2-47b6-9ed9-bfe01372507b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:27:51.774795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:51.774795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:51.774795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:51.774795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:51.774795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:51.774795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:51.774795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:51.774795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:51.774795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:51.774795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:51.774795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:51.774795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 03:27:51.774795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 03:27:51.774795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 03:27:51.775915 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 03:27:51.775915 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:51.775915 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:51.775915 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:51.775915 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:51.775915 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:51.775915 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:51.775915 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:51.775915 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:51.775915 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:51.775915 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:51.775915 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:51.775915 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:51.775915 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:51.775915 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:51.775915 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:51.775915 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:51.777246 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 03:27:51.777246 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 03:27:51.777246 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 03:27:51.777246 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 03:27:51.777246 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 03:27:51.777246 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 03:27:51.777246 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:27:51.777246 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:51.780396 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 330/649] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:27:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:51.781228 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab5577-1dc2-47b6-9ed9-bfe01372507b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:51.795473 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f3683-143a-42aa-8366-02ab2e01280a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:51.796078 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f3683-143a-42aa-8366-02ab2e01280a None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:51.796356 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f3683-143a-42aa-8366-02ab2e01280a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:51.796625 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f3683-143a-42aa-8366-02ab2e01280a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:51.815985 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:51.851060 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:51.870237 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f3683-143a-42aa-8366-02ab2e01280a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:51.872568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f3683-143a-42aa-8366-02ab2e01280a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:51.888690 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab5577-1dc2-47b6-9ed9-bfe01372507b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:51.927967 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d96f1-bc51-4182-b0bb-1cc46bd62a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:51.928683 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d96f1-bc51-4182-b0bb-1cc46bd62a65 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:51.928965 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d96f1-bc51-4182-b0bb-1cc46bd62a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:51.929240 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d96f1-bc51-4182-b0bb-1cc46bd62a65 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:51.936767 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d96f1-bc51-4182-b0bb-1cc46bd62a65 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:51.938394 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d96f1-bc51-4182-b0bb-1cc46bd62a65 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:51.954138 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-fc2d96f1-bc51-4182-b0bb-1cc46bd62a65 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 16 03:27:51.954138 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:51.954138 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:51.954138 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:51.954138 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:51.954138 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:51.954138 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:51.954138 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:51.954138 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:51.954138 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:51.954138 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:51.954138 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:51.954138 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 03:27:51.954138 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 03:27:51.954138 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 03:27:51.954138 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 03:27:51.955110 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:51.955110 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:51.955110 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 03:27:51.955110 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:27:51.955110 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 03:27:51.955110 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:27:51.955110 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:51.955110 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:51.955110 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:51.955110 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:51.955110 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:51.955110 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:51.955110 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:51.955110 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:51.955110 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:51.955110 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:51.955110 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:51.955110 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:51.956087 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:51.956087 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:51.956087 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 03:27:51.956087 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 03:27:51.956087 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 03:27:51.956087 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 03:27:51.956087 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 03:27:51.956087 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 03:27:51.956087 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 16 03:27:51.956087 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:51.956087 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 331/650] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 03:27:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:51.956728 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d96f1-bc51-4182-b0bb-1cc46bd62a65 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:51.990445 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 320/651] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:27:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 03:27:51.990445 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f3683-143a-42aa-8366-02ab2e01280a None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:52.061429 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:52.074959 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:52.075720 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d96f1-bc51-4182-b0bb-1cc46bd62a65 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:52.090219 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f3683-143a-42aa-8366-02ab2e01280a None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:52.110817 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e98e3-9193-4704-bb6e-f636b0b54c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:52.111689 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e98e3-9193-4704-bb6e-f636b0b54c88 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:52.112141 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e98e3-9193-4704-bb6e-f636b0b54c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:52.112613 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e98e3-9193-4704-bb6e-f636b0b54c88 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:52.113437 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26e98e3-9193-4704-bb6e-f636b0b54c88 None admin] RBAC: Adding query filter params (name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:52.113942 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26e98e3-9193-4704-bb6e-f636b0b54c88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:52.115469 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26e98e3-9193-4704-bb6e-f636b0b54c88 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:52.124553 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32953014-75a1-40bb-b77b-1dbf523b38f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:52.124833 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 332/652] 10.222.0.33 () {56 vars in 1103 bytes} [Fri Sep 16 03:27:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:52.125311 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32953014-75a1-40bb-b77b-1dbf523b38f9 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:52.125612 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32953014-75a1-40bb-b77b-1dbf523b38f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:52.125938 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32953014-75a1-40bb-b77b-1dbf523b38f9 None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:52.126356 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e98e3-9193-4704-bb6e-f636b0b54c88 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:52.126632 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32953014-75a1-40bb-b77b-1dbf523b38f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:52.126941 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32953014-75a1-40bb-b77b-1dbf523b38f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:52.128356 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32953014-75a1-40bb-b77b-1dbf523b38f9 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:52.141396 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 321/653] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 03:27:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:52.142257 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32953014-75a1-40bb-b77b-1dbf523b38f9 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:52.232931 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e98e3-9193-4704-bb6e-f636b0b54c88 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:52.239840 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32953014-75a1-40bb-b77b-1dbf523b38f9 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:52.266964 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27186584-c7bd-490d-8640-117f1eaf9349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:52.267504 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27186584-c7bd-490d-8640-117f1eaf9349 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:52.267782 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27186584-c7bd-490d-8640-117f1eaf9349 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:52.268061 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27186584-c7bd-490d-8640-117f1eaf9349 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:52.268775 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27186584-c7bd-490d-8640-117f1eaf9349 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:52.269076 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27186584-c7bd-490d-8640-117f1eaf9349 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:52.270784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27186584-c7bd-490d-8640-117f1eaf9349 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:52.272928 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de188e4-5f51-4a4b-accb-1418f747a33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:52.273588 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de188e4-5f51-4a4b-accb-1418f747a33c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:52.273902 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de188e4-5f51-4a4b-accb-1418f747a33c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:52.274177 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de188e4-5f51-4a4b-accb-1418f747a33c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:52.284475 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de188e4-5f51-4a4b-accb-1418f747a33c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:52.285936 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de188e4-5f51-4a4b-accb-1418f747a33c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:52.287777 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 333/654] 10.222.0.33 () {56 vars in 1139 bytes} [Fri Sep 16 03:27:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:52.288424 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:52.288896 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27186584-c7bd-490d-8640-117f1eaf9349 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:52.301704 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-9de188e4-5f51-4a4b-accb-1418f747a33c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:52.301704 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:52.301704 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:52.301704 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:52.301704 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:52.301704 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:52.301704 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:52.301704 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:52.301704 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:52.301704 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:52.301704 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:52.301704 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:52.301704 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:27:52.301704 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:27:52.301704 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:27:52.301704 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:27:52.302955 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:52.302955 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:52.302955 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:52.302955 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:52.302955 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:52.302955 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:52.302955 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:52.302955 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:52.302955 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:52.302955 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:52.302955 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:52.302955 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:52.302955 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:52.302955 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:52.302955 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:52.302955 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:52.302955 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:27:52.304331 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:27:52.304331 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:52.304331 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:52.304331 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 322/655] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:27:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:52.304560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:52.304628 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de188e4-5f51-4a4b-accb-1418f747a33c None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:52.388573 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27186584-c7bd-490d-8640-117f1eaf9349 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:52.403246 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de188e4-5f51-4a4b-accb-1418f747a33c None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:52.422311 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1e04e-f288-44b6-b215-79e7a9750873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:52.422932 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1e04e-f288-44b6-b215-79e7a9750873 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:52.423208 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1e04e-f288-44b6-b215-79e7a9750873 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:52.423476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1e04e-f288-44b6-b215-79e7a9750873 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:52.433606 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1e04e-f288-44b6-b215-79e7a9750873 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:52.435071 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1e04e-f288-44b6-b215-79e7a9750873 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:52.435654 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc6d5a-48ff-43b7-922d-ea551ce3b3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:52.436247 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc6d5a-48ff-43b7-922d-ea551ce3b3e8 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:52.436534 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc6d5a-48ff-43b7-922d-ea551ce3b3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:52.436805 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc6d5a-48ff-43b7-922d-ea551ce3b3e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:52.437521 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc6d5a-48ff-43b7-922d-ea551ce3b3e8 None admin] RBAC: Adding query filter params (role.id=8a338e321ece4061b4b30d6231167b4e, scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2, user.id=aafb065e06c3481bbed8d98e893766ee) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:52.437853 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc6d5a-48ff-43b7-922d-ea551ce3b3e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:52.439265 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc6d5a-48ff-43b7-922d-ea551ce3b3e8 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:52.444888 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 323/656] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:27:52 2022] GET /identity/v3/role_assignments?user.id=aafb065e06c3481bbed8d98e893766ee&scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2&role.id=8a338e321ece4061b4b30d6231167b4e => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:52.446115 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c3d01-4db8-49c6-afbe-502f152b55a8 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:52.446406 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c3d01-4db8-49c6-afbe-502f152b55a8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:52.446684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c3d01-4db8-49c6-afbe-502f152b55a8 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:52.449834 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 324/657] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:52.449834 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c3d01-4db8-49c6-afbe-502f152b55a8 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:52.450041 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-bdc1e04e-f288-44b6-b215-79e7a9750873 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:52.450041 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:52.450041 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:52.450041 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:52.450041 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:52.450041 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:52.450041 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:52.450041 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:52.450041 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:52.450041 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:52.450041 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:52.450041 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:52.450041 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:27:52.450041 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:27:52.450041 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:27:52.450041 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:27:52.450961 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:52.450961 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:52.450961 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:52.450961 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:52.450961 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:52.450961 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:52.450961 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:52.450961 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:52.450961 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:52.450961 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:52.450961 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:52.450961 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:52.450961 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:52.450961 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:52.450961 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:52.450961 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:52.450961 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:27:52.451961 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:27:52.451961 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:52.451961 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:52.455937 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 334/658] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:27:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:52.457004 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1e04e-f288-44b6-b215-79e7a9750873 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:52.523915 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:52.530058 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:52.570438 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1e04e-f288-44b6-b215-79e7a9750873 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:52.570649 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c3d01-4db8-49c6-afbe-502f152b55a8 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:52.608018 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113841a4-a468-4d77-b810-28fb484164c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:52.608668 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113841a4-a468-4d77-b810-28fb484164c3 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:52.608907 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113841a4-a468-4d77-b810-28fb484164c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:52.609206 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113841a4-a468-4d77-b810-28fb484164c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:52.614779 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f9b6c-ef2b-402a-a5eb-790a95469556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:52.615392 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f9b6c-ef2b-402a-a5eb-790a95469556 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:52.615668 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f9b6c-ef2b-402a-a5eb-790a95469556 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:52.615940 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f9b6c-ef2b-402a-a5eb-790a95469556 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:52.616577 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f9b6c-ef2b-402a-a5eb-790a95469556 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:52.616877 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f9b6c-ef2b-402a-a5eb-790a95469556 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:52.618272 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f9b6c-ef2b-402a-a5eb-790a95469556 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:52.637396 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 335/659] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:52.637396 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443990c0-ee23-45d7-9606-b542bbc48b79 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:52.637396 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443990c0-ee23-45d7-9606-b542bbc48b79 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:52.637396 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443990c0-ee23-45d7-9606-b542bbc48b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:52.654632 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-443990c0-ee23-45d7-9606-b542bbc48b79 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:52.655837 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-443990c0-ee23-45d7-9606-b542bbc48b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:52.694294 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113841a4-a468-4d77-b810-28fb484164c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:52.696790 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113841a4-a468-4d77-b810-28fb484164c3 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:52.740228 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 336/660] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:27:52.741681 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443990c0-ee23-45d7-9606-b542bbc48b79 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:52.773326 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:52.816993 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:52.821888 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 325/661] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:27:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 03:27:52.823154 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113841a4-a468-4d77-b810-28fb484164c3 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:52.858142 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443990c0-ee23-45d7-9606-b542bbc48b79 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:52.900078 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44b866-9fc5-4aaf-8634-ba1a3d9dcd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:52.900801 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44b866-9fc5-4aaf-8634-ba1a3d9dcd20 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:52.901167 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44b866-9fc5-4aaf-8634-ba1a3d9dcd20 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:52.901514 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44b866-9fc5-4aaf-8634-ba1a3d9dcd20 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:52.902347 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44b866-9fc5-4aaf-8634-ba1a3d9dcd20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:52.902722 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44b866-9fc5-4aaf-8634-ba1a3d9dcd20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:52.904306 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44b866-9fc5-4aaf-8634-ba1a3d9dcd20 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:52.921866 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 337/662] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:52.922849 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44b866-9fc5-4aaf-8634-ba1a3d9dcd20 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:52.934048 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113841a4-a468-4d77-b810-28fb484164c3 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:52.968899 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41639a-6da5-44b2-97c0-aeb0f923cec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:52.969849 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41639a-6da5-44b2-97c0-aeb0f923cec9 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:52.970329 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41639a-6da5-44b2-97c0-aeb0f923cec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:52.970935 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41639a-6da5-44b2-97c0-aeb0f923cec9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:52.978835 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f41639a-6da5-44b2-97c0-aeb0f923cec9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:52.980508 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f41639a-6da5-44b2-97c0-aeb0f923cec9 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:52.993707 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-8f41639a-6da5-44b2-97c0-aeb0f923cec9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:27:52.993707 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:52.993707 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:52.993707 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:52.993707 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:52.993707 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:52.993707 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:52.993707 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:52.993707 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:52.993707 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:52.993707 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:52.993707 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:52.993707 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 03:27:52.993707 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 03:27:52.993707 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 03:27:52.994655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 03:27:52.994655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:52.994655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:52.994655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:52.994655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:52.994655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:52.994655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:52.994655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:52.994655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:52.994655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:52.994655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:52.994655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:52.994655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:52.994655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:52.994655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:52.994655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:52.994655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:52.995591 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 03:27:52.995591 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 03:27:52.995591 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 03:27:52.995591 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 03:27:52.995591 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 03:27:52.995591 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 03:27:52.995591 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:27:52.995591 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:52.998441 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 326/663] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:27:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:52.999455 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41639a-6da5-44b2-97c0-aeb0f923cec9 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:53.023094 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:53.044463 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44b866-9fc5-4aaf-8634-ba1a3d9dcd20 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:53.061287 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:53.081898 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b1011-8fcf-4b20-bd1a-63558821b5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:53.082452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b1011-8fcf-4b20-bd1a-63558821b5e7 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:53.082725 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b1011-8fcf-4b20-bd1a-63558821b5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:53.083001 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b1011-8fcf-4b20-bd1a-63558821b5e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:53.094214 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59b1011-8fcf-4b20-bd1a-63558821b5e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:53.095643 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59b1011-8fcf-4b20-bd1a-63558821b5e7 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:53.111763 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41639a-6da5-44b2-97c0-aeb0f923cec9 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:53.111997 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-f59b1011-8fcf-4b20-bd1a-63558821b5e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:53.111997 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:53.111997 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:53.111997 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:53.111997 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:53.111997 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:53.111997 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:53.111997 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:53.111997 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:53.111997 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:53.111997 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:53.111997 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:53.111997 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:27:53.111997 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:27:53.111997 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:27:53.111997 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:27:53.112861 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:53.112861 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:53.112861 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:53.112861 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:53.112861 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:53.112861 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:53.112861 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:53.112861 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:53.112861 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:53.112861 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:53.112861 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:53.112861 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:53.112861 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:53.112861 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:53.112861 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:53.112861 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:53.112861 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:27:53.114183 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:27:53.114183 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:53.114183 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:53.116747 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 338/664] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:27:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:53.117819 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b1011-8fcf-4b20-bd1a-63558821b5e7 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:53.152265 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bcd208-e2c9-433b-be31-b1975ba27a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:53.152891 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcd208-e2c9-433b-be31-b1975ba27a4d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:53.153166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcd208-e2c9-433b-be31-b1975ba27a4d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:53.153436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcd208-e2c9-433b-be31-b1975ba27a4d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:53.160903 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bcd208-e2c9-433b-be31-b1975ba27a4d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:53.162568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bcd208-e2c9-433b-be31-b1975ba27a4d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:53.175317 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-85bcd208-e2c9-433b-be31-b1975ba27a4d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 03:27:53.175317 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:53.175317 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:53.175317 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:53.175317 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:53.175317 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:53.175317 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:53.175317 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:53.175317 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:53.175317 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:53.175317 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:53.175317 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:53.175317 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 03:27:53.175317 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 03:27:53.175317 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 03:27:53.175317 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 03:27:53.176514 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:53.176514 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:53.176514 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 03:27:53.176514 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:27:53.176514 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 03:27:53.176514 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:27:53.176514 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:53.176514 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:53.176514 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:53.176514 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:53.176514 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:53.176514 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:53.176514 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:53.176514 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:53.176514 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:53.176514 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:53.176514 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:53.176514 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:53.177835 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:53.177835 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:53.177835 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 03:27:53.177835 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 03:27:53.177835 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 03:27:53.177835 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 03:27:53.177835 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 03:27:53.177835 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 03:27:53.177835 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 03:27:53.177835 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:53.177835 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 327/665] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:27:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:53.177835 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bcd208-e2c9-433b-be31-b1975ba27a4d None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:53.225394 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b1011-8fcf-4b20-bd1a-63558821b5e7 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:53.261097 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1b9c93-a9d2-422a-a15f-b4c15d2f0677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:53.261730 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b9c93-a9d2-422a-a15f-b4c15d2f0677 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:53.262099 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b9c93-a9d2-422a-a15f-b4c15d2f0677 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:53.262343 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b9c93-a9d2-422a-a15f-b4c15d2f0677 None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:53.262959 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1b9c93-a9d2-422a-a15f-b4c15d2f0677 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:53.263259 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1b9c93-a9d2-422a-a15f-b4c15d2f0677 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:53.263987 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:53.265871 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1b9c93-a9d2-422a-a15f-b4c15d2f0677 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:53.284171 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 339/666] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 03:27:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:53.284171 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1b9c93-a9d2-422a-a15f-b4c15d2f0677 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:53.288357 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bcd208-e2c9-433b-be31-b1975ba27a4d None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:53.311475 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:53.322039 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dec779-00e9-4bb5-a50d-4f5b373ae5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:53.322672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dec779-00e9-4bb5-a50d-4f5b373ae5e2 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:53.322952 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dec779-00e9-4bb5-a50d-4f5b373ae5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:53.323224 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dec779-00e9-4bb5-a50d-4f5b373ae5e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:53.339155 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dec779-00e9-4bb5-a50d-4f5b373ae5e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:53.344332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-59dec779-00e9-4bb5-a50d-4f5b373ae5e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 03:27:53.344332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:53.344332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:53.344332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:53.344332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:53.344332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:53.344332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:53.344332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:53.344332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:53.344332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:53.344332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:53.344332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:53.344332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:53.344332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:53.344332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:53.344332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:53.345245 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:53.345245 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:53.345245 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:53.345245 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:53.345245 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:53.345245 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:53.345245 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:53.345245 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:53.345245 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:53.345245 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:53.345245 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:53.345245 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:53.345245 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:53.345245 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:53.345245 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:53.345245 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:53.346585 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:53.346585 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:53.346585 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:53.346585 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:53.346585 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:53.346585 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:53.346585 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:53.346585 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:53.346585 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:53.346585 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:53.346585 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 03:27:53.346585 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:53.346585 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 328/667] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 03:27:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:53.346585 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dec779-00e9-4bb5-a50d-4f5b373ae5e2 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:53.394243 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1b9c93-a9d2-422a-a15f-b4c15d2f0677 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:53.432180 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9851d1-4cd5-4a86-a193-31e1a8962499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:53.432851 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9851d1-4cd5-4a86-a193-31e1a8962499 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:53.433136 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9851d1-4cd5-4a86-a193-31e1a8962499 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:53.433408 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9851d1-4cd5-4a86-a193-31e1a8962499 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:53.434073 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9851d1-4cd5-4a86-a193-31e1a8962499 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:53.434378 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9851d1-4cd5-4a86-a193-31e1a8962499 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:53.435726 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9851d1-4cd5-4a86-a193-31e1a8962499 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:53.447684 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 340/668] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:27:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:53.450518 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9851d1-4cd5-4a86-a193-31e1a8962499 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:53.455936 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dec779-00e9-4bb5-a50d-4f5b373ae5e2 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:53.493831 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914823f1-d294-4d73-b50d-8665c5bff252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:53.494437 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914823f1-d294-4d73-b50d-8665c5bff252 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:53.494719 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914823f1-d294-4d73-b50d-8665c5bff252 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:53.494993 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914823f1-d294-4d73-b50d-8665c5bff252 None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:53.495710 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914823f1-d294-4d73-b50d-8665c5bff252 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:53.496017 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914823f1-d294-4d73-b50d-8665c5bff252 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:53.497457 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914823f1-d294-4d73-b50d-8665c5bff252 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:53.507506 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:53.519627 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 329/669] 10.222.0.33 () {56 vars in 1137 bytes} [Fri Sep 16 03:27:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:53.519627 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914823f1-d294-4d73-b50d-8665c5bff252 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:53.550949 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:53.567969 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9851d1-4cd5-4a86-a193-31e1a8962499 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:53.605927 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325e298-cd79-44f0-9c61-1b9283a7b9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:53.606461 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325e298-cd79-44f0-9c61-1b9283a7b9a3 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:53.606739 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325e298-cd79-44f0-9c61-1b9283a7b9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:53.607011 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325e298-cd79-44f0-9c61-1b9283a7b9a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:53.607731 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325e298-cd79-44f0-9c61-1b9283a7b9a3 None admin] RBAC: Adding query filter params (role.id=8a338e321ece4061b4b30d6231167b4e, scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2, user.id=c09d1a4ac8b64921a6b05fcd567bb770) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:53.608043 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325e298-cd79-44f0-9c61-1b9283a7b9a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:53.609457 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325e298-cd79-44f0-9c61-1b9283a7b9a3 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:53.616069 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 341/670] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:27:53 2022] GET /identity/v3/role_assignments?user.id=c09d1a4ac8b64921a6b05fcd567bb770&scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2&role.id=8a338e321ece4061b4b30d6231167b4e => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:53.616850 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325e298-cd79-44f0-9c61-1b9283a7b9a3 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:53.630687 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914823f1-d294-4d73-b50d-8665c5bff252 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:53.671278 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b92f2-39ac-41d5-b5a1-9af95176e2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:53.672176 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b92f2-39ac-41d5-b5a1-9af95176e2f8 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:53.672597 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b92f2-39ac-41d5-b5a1-9af95176e2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:53.673023 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b92f2-39ac-41d5-b5a1-9af95176e2f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:53.674057 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66b92f2-39ac-41d5-b5a1-9af95176e2f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:53.674544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66b92f2-39ac-41d5-b5a1-9af95176e2f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:53.676280 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66b92f2-39ac-41d5-b5a1-9af95176e2f8 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:53.691982 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 330/671] 10.222.0.33 () {56 vars in 1103 bytes} [Fri Sep 16 03:27:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:53.693382 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b92f2-39ac-41d5-b5a1-9af95176e2f8 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:53.755446 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325e298-cd79-44f0-9c61-1b9283a7b9a3 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:53.766061 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:53.797498 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdbf95-249c-4fab-83d2-10ed5b643554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:53.798171 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdbf95-249c-4fab-83d2-10ed5b643554 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:53.798449 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdbf95-249c-4fab-83d2-10ed5b643554 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:53.798720 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdbf95-249c-4fab-83d2-10ed5b643554 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:53.807645 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefdbf95-249c-4fab-83d2-10ed5b643554 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:53.809263 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefdbf95-249c-4fab-83d2-10ed5b643554 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:53.812715 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b92f2-39ac-41d5-b5a1-9af95176e2f8 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:53.822412 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-aefdbf95-249c-4fab-83d2-10ed5b643554 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:27:53.822412 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:53.822412 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:53.822412 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:53.822412 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:53.822412 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:53.822412 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:53.822412 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:53.822412 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:53.822412 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:53.822412 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:53.822412 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:53.822412 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 03:27:53.822412 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 03:27:53.822412 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 03:27:53.823314 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 03:27:53.823314 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:53.823314 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:53.823314 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:53.823314 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:53.823314 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:53.823314 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:53.823314 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:53.823314 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:53.823314 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:53.823314 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:53.823314 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:53.823314 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:53.823314 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:53.823314 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:53.823314 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:53.823314 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:53.824305 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 03:27:53.824305 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 03:27:53.824305 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 03:27:53.824305 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 03:27:53.824305 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 03:27:53.824305 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 03:27:53.824305 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:27:53.824305 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:53.824305 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 342/672] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:27:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:53.824305 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdbf95-249c-4fab-83d2-10ed5b643554 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:53.837785 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:53.861727 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e5e3d-f1a2-4aa5-9e45-3d9c58879d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:53.862255 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e5e3d-f1a2-4aa5-9e45-3d9c58879d39 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:53.862539 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e5e3d-f1a2-4aa5-9e45-3d9c58879d39 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:53.862815 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e5e3d-f1a2-4aa5-9e45-3d9c58879d39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:53.942159 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e5e3d-f1a2-4aa5-9e45-3d9c58879d39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:53.943819 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e5e3d-f1a2-4aa5-9e45-3d9c58879d39 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:53.951019 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdbf95-249c-4fab-83d2-10ed5b643554 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:53.994505 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0703fe-4547-4633-8a1a-636d31174ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:53.995481 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0703fe-4547-4633-8a1a-636d31174ff5 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:53.995762 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0703fe-4547-4633-8a1a-636d31174ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:53.996336 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0703fe-4547-4633-8a1a-636d31174ff5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:54.008641 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0703fe-4547-4633-8a1a-636d31174ff5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:54.010200 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0703fe-4547-4633-8a1a-636d31174ff5 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:54.017406 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:54.026463 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-0e0703fe-4547-4633-8a1a-636d31174ff5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:54.026463 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:54.026463 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:54.026463 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:54.026463 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:54.026463 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:54.026463 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:54.026463 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:54.026463 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:54.026463 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:54.026463 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:54.026463 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:54.026463 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:27:54.026463 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:27:54.026463 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:27:54.026463 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:27:54.027476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:54.027476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:54.027476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:54.027476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:54.027476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:54.027476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:54.027476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:54.027476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:54.027476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:54.027476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:54.027476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:54.027476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:54.027476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:54.027476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:54.027476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:54.027476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:54.027476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:27:54.028460 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:27:54.028460 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:54.028460 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:54.028460 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 343/673] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:27:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:54.030560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0703fe-4547-4633-8a1a-636d31174ff5 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:54.057593 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 331/674] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:27:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 03:27:54.058668 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e5e3d-f1a2-4aa5-9e45-3d9c58879d39 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:54.093313 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:54.133313 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0703fe-4547-4633-8a1a-636d31174ff5 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:54.167826 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f9c3a-5dd3-46ea-8d7d-88db8ff72e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:54.168545 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f9c3a-5dd3-46ea-8d7d-88db8ff72e07 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:54.168888 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f9c3a-5dd3-46ea-8d7d-88db8ff72e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:54.169229 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f9c3a-5dd3-46ea-8d7d-88db8ff72e07 None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:54.170066 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f9c3a-5dd3-46ea-8d7d-88db8ff72e07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:54.170492 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f9c3a-5dd3-46ea-8d7d-88db8ff72e07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:54.171989 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f9c3a-5dd3-46ea-8d7d-88db8ff72e07 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:54.184109 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e5e3d-f1a2-4aa5-9e45-3d9c58879d39 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:54.188997 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 344/675] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 03:27:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:54.190004 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f9c3a-5dd3-46ea-8d7d-88db8ff72e07 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:54.226663 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef721c-21e4-412a-9b1e-4781e5193fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:54.227578 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef721c-21e4-412a-9b1e-4781e5193fbf None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:54.228034 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef721c-21e4-412a-9b1e-4781e5193fbf None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:54.228502 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef721c-21e4-412a-9b1e-4781e5193fbf None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:54.229328 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebef721c-21e4-412a-9b1e-4781e5193fbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:54.229836 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebef721c-21e4-412a-9b1e-4781e5193fbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:54.231899 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebef721c-21e4-412a-9b1e-4781e5193fbf None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:54.250494 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 332/676] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:27:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:54.251364 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef721c-21e4-412a-9b1e-4781e5193fbf None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:54.287235 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:54.302735 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f9c3a-5dd3-46ea-8d7d-88db8ff72e07 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:54.334038 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:54.349805 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b779edd-b53a-4b82-b6e5-d65be11b2d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:54.351603 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b779edd-b53a-4b82-b6e5-d65be11b2d46 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:54.352083 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b779edd-b53a-4b82-b6e5-d65be11b2d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:54.352570 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b779edd-b53a-4b82-b6e5-d65be11b2d46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:54.365679 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef721c-21e4-412a-9b1e-4781e5193fbf None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:54.367062 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b779edd-b53a-4b82-b6e5-d65be11b2d46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:54.369845 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b779edd-b53a-4b82-b6e5-d65be11b2d46 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:54.388482 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-0b779edd-b53a-4b82-b6e5-d65be11b2d46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:54.388482 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:54.388482 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:54.388482 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:54.388482 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:54.388482 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:54.388482 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:54.388482 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:54.388482 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:54.388482 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:54.388482 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:54.388482 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:54.388482 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:27:54.388482 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:27:54.388482 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:27:54.388482 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:27:54.389420 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:54.389420 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:54.389420 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:54.389420 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:54.389420 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:54.389420 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:54.389420 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:54.389420 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:54.389420 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:54.389420 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:54.389420 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:54.389420 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:54.389420 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:54.389420 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:54.389420 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:54.389420 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:54.389420 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:27:54.390343 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:27:54.390343 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:54.390343 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:54.393010 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 345/677] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:27:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:54.394065 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b779edd-b53a-4b82-b6e5-d65be11b2d46 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:54.403261 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378037c5-7ad3-4c8d-b6f8-c33f278e233c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:54.403872 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378037c5-7ad3-4c8d-b6f8-c33f278e233c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:54.404152 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378037c5-7ad3-4c8d-b6f8-c33f278e233c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:54.404424 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378037c5-7ad3-4c8d-b6f8-c33f278e233c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:54.405142 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378037c5-7ad3-4c8d-b6f8-c33f278e233c None admin] RBAC: Adding query filter params (role.id=8a338e321ece4061b4b30d6231167b4e, scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2, user.id=ae04099495a24a04801563cf18dc5626) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:54.405453 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378037c5-7ad3-4c8d-b6f8-c33f278e233c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:54.407020 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378037c5-7ad3-4c8d-b6f8-c33f278e233c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:54.414317 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 333/678] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:27:54 2022] GET /identity/v3/role_assignments?user.id=ae04099495a24a04801563cf18dc5626&scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2&role.id=8a338e321ece4061b4b30d6231167b4e => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:54.418707 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378037c5-7ad3-4c8d-b6f8-c33f278e233c None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:54.511265 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b779edd-b53a-4b82-b6e5-d65be11b2d46 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:54.551306 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf16e6-8a75-40b0-aa6d-f2cfa7d17f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:54.552335 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf16e6-8a75-40b0-aa6d-f2cfa7d17f8a None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:54.552810 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf16e6-8a75-40b0-aa6d-f2cfa7d17f8a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:54.553837 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf16e6-8a75-40b0-aa6d-f2cfa7d17f8a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:54.563449 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf16e6-8a75-40b0-aa6d-f2cfa7d17f8a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:54.565234 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf16e6-8a75-40b0-aa6d-f2cfa7d17f8a None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:54.577830 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-0eaf16e6-8a75-40b0-aa6d-f2cfa7d17f8a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 16 03:27:54.577830 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:54.577830 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:54.577830 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:54.577830 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:54.577830 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:54.577830 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:54.577830 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:54.577830 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:54.577830 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:54.577830 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:54.577830 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:54.577830 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 03:27:54.577830 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 03:27:54.577830 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 03:27:54.577830 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 03:27:54.578848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:54.578848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:54.578848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 03:27:54.578848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:27:54.578848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 03:27:54.578848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:27:54.578848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:54.578848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:54.578848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:54.578848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:54.578848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:54.578848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:54.578848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:54.578848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:54.578848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:54.578848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:54.578848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:54.578848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:54.579786 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:54.579786 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:54.579786 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 03:27:54.579786 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 03:27:54.579786 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 03:27:54.579786 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 03:27:54.579786 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 03:27:54.579786 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 03:27:54.579786 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 16 03:27:54.579786 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:54.582194 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 346/679] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 03:27:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:54.588740 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf16e6-8a75-40b0-aa6d-f2cfa7d17f8a None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:54.611826 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:54.646116 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:54.653172 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378037c5-7ad3-4c8d-b6f8-c33f278e233c None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:54.721214 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf16e6-8a75-40b0-aa6d-f2cfa7d17f8a None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:54.754383 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4ba59-1bb9-4fcf-88ae-bd89c9410dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:54.755395 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4ba59-1bb9-4fcf-88ae-bd89c9410dbd None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:54.755998 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4ba59-1bb9-4fcf-88ae-bd89c9410dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:54.756354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4ba59-1bb9-4fcf-88ae-bd89c9410dbd None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:54.757030 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4ba59-1bb9-4fcf-88ae-bd89c9410dbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:54.757340 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4ba59-1bb9-4fcf-88ae-bd89c9410dbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:54.759211 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4ba59-1bb9-4fcf-88ae-bd89c9410dbd None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:54.762004 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb40de1-2503-462b-8342-eb1b4fca8320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:54.762621 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb40de1-2503-462b-8342-eb1b4fca8320 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:54.762897 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb40de1-2503-462b-8342-eb1b4fca8320 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:54.763166 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb40de1-2503-462b-8342-eb1b4fca8320 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:54.763886 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb40de1-2503-462b-8342-eb1b4fca8320 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:54.764188 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb40de1-2503-462b-8342-eb1b4fca8320 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:54.765592 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb40de1-2503-462b-8342-eb1b4fca8320 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:54.774139 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 334/680] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:27:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:54.775537 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913b191-22f9-42dd-8153-87cc8c0bc2db None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:54.775894 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913b191-22f9-42dd-8153-87cc8c0bc2db None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:54.776176 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913b191-22f9-42dd-8153-87cc8c0bc2db None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:54.777691 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 335/681] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:54.779556 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6913b191-22f9-42dd-8153-87cc8c0bc2db None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:54.787652 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 347/682] 10.222.0.33 () {56 vars in 1135 bytes} [Fri Sep 16 03:27:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:54.789000 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f454a-7b0b-4394-9193-eba0eecef1f8 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:54.789288 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f454a-7b0b-4394-9193-eba0eecef1f8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:54.789562 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f454a-7b0b-4394-9193-eba0eecef1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:54.808110 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0e6f454a-7b0b-4394-9193-eba0eecef1f8 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:54.809480 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0e6f454a-7b0b-4394-9193-eba0eecef1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:54.893273 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6913b191-22f9-42dd-8153-87cc8c0bc2db None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:54.901799 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 348/683] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:27:54.902667 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f454a-7b0b-4394-9193-eba0eecef1f8 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:54.955133 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9277bde-d04f-45d3-b85b-b1c8e65da7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:54.955849 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9277bde-d04f-45d3-b85b-b1c8e65da7cd None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:54.956135 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9277bde-d04f-45d3-b85b-b1c8e65da7cd None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:54.956408 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9277bde-d04f-45d3-b85b-b1c8e65da7cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:54.957335 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:54.969820 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9277bde-d04f-45d3-b85b-b1c8e65da7cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:54.971281 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9277bde-d04f-45d3-b85b-b1c8e65da7cd None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:54.995336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-c9277bde-d04f-45d3-b85b-b1c8e65da7cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:27:54.995336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:54.995336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:54.995336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:54.995336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:54.995336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:54.995336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:54.995336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:54.995336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:54.995336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:54.995336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:54.995336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:54.995336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 03:27:54.995336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 03:27:54.995336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 03:27:54.998884 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 03:27:54.998884 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:54.998884 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:54.998884 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:54.998884 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:54.998884 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:54.998884 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:54.998884 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:54.998884 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:54.998884 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:54.998884 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:54.998884 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:54.998884 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:54.998884 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:54.998884 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:54.998884 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:54.998884 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:54.999964 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 03:27:54.999964 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 03:27:54.999964 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 03:27:54.999964 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 03:27:54.999964 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 03:27:54.999964 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 03:27:54.999964 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:27:54.999964 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:55.003452 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 336/684] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:27:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:55.005471 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9277bde-d04f-45d3-b85b-b1c8e65da7cd None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:55.015370 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:55.092328 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f454a-7b0b-4394-9193-eba0eecef1f8 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:55.128769 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1949f-83e9-46fc-a89d-f0d7885d61f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:55.129526 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1949f-83e9-46fc-a89d-f0d7885d61f1 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:55.129923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1949f-83e9-46fc-a89d-f0d7885d61f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:55.130285 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1949f-83e9-46fc-a89d-f0d7885d61f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:55.215841 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9277bde-d04f-45d3-b85b-b1c8e65da7cd None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:55.229900 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1949f-83e9-46fc-a89d-f0d7885d61f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:55.231359 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1949f-83e9-46fc-a89d-f0d7885d61f1 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:55.262360 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:55.271728 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353fe2f-cba7-4069-8a43-7858d57d204f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:55.272908 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353fe2f-cba7-4069-8a43-7858d57d204f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:55.273245 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353fe2f-cba7-4069-8a43-7858d57d204f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:55.273523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353fe2f-cba7-4069-8a43-7858d57d204f None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:55.274242 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353fe2f-cba7-4069-8a43-7858d57d204f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:55.274581 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353fe2f-cba7-4069-8a43-7858d57d204f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:55.276012 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353fe2f-cba7-4069-8a43-7858d57d204f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:55.288954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 337/685] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 03:27:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:55.289892 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353fe2f-cba7-4069-8a43-7858d57d204f None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:55.350915 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 349/686] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:27:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 03:27:55.351932 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1949f-83e9-46fc-a89d-f0d7885d61f1 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:55.357832 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:55.400702 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353fe2f-cba7-4069-8a43-7858d57d204f None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:55.437302 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451c789-0466-4ef9-a8de-1f994f91131b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:55.438048 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451c789-0466-4ef9-a8de-1f994f91131b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:55.438329 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451c789-0466-4ef9-a8de-1f994f91131b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:55.438605 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451c789-0466-4ef9-a8de-1f994f91131b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:55.450853 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6451c789-0466-4ef9-a8de-1f994f91131b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:55.452488 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6451c789-0466-4ef9-a8de-1f994f91131b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:55.461056 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1949f-83e9-46fc-a89d-f0d7885d61f1 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:55.468162 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-6451c789-0466-4ef9-a8de-1f994f91131b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:55.468162 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:55.468162 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:55.468162 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:55.468162 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:55.468162 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:55.468162 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:55.468162 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:55.468162 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:55.468162 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:55.468162 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:55.468162 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:55.468162 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:27:55.468162 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:27:55.468162 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:27:55.468162 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:27:55.469100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:55.469100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:55.469100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:55.469100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:55.469100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:55.469100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:55.469100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:55.469100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:55.469100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:55.469100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:55.469100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:55.469100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:55.469100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:55.469100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:55.469100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:55.469100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:55.469100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:27:55.469999 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:27:55.469999 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:55.469999 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:55.469999 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 338/687] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:27:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:55.470714 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451c789-0466-4ef9-a8de-1f994f91131b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:55.494920 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:55.507744 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a9357-5dcc-4b37-a62b-5db8cd19584f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:55.508406 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a9357-5dcc-4b37-a62b-5db8cd19584f None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:55.508690 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a9357-5dcc-4b37-a62b-5db8cd19584f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:55.508957 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a9357-5dcc-4b37-a62b-5db8cd19584f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:55.509854 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a9357-5dcc-4b37-a62b-5db8cd19584f None admin] RBAC: Adding query filter params (role.id=8a338e321ece4061b4b30d6231167b4e, scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2, user.id=d193a353763e43d0b5e8b49702f09faa) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:55.510164 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a9357-5dcc-4b37-a62b-5db8cd19584f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:55.511693 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a9357-5dcc-4b37-a62b-5db8cd19584f None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:55.518699 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 350/688] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:27:55 2022] GET /identity/v3/role_assignments?user.id=d193a353763e43d0b5e8b49702f09faa&scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2&role.id=8a338e321ece4061b4b30d6231167b4e => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:55.519650 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a9357-5dcc-4b37-a62b-5db8cd19584f None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:55.586577 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451c789-0466-4ef9-a8de-1f994f91131b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:55.605263 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:55.624198 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd758b2-c9f4-4d44-bbae-b1a9f24f9f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:55.624842 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd758b2-c9f4-4d44-bbae-b1a9f24f9f95 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:55.627454 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd758b2-c9f4-4d44-bbae-b1a9f24f9f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:55.627454 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd758b2-c9f4-4d44-bbae-b1a9f24f9f95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:55.637360 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd758b2-c9f4-4d44-bbae-b1a9f24f9f95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:55.638880 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd758b2-c9f4-4d44-bbae-b1a9f24f9f95 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:55.639084 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a9357-5dcc-4b37-a62b-5db8cd19584f None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:55.655175 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-8fd758b2-c9f4-4d44-bbae-b1a9f24f9f95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:55.655175 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:55.655175 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:55.655175 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:55.655175 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:55.655175 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:55.655175 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:55.655175 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:55.655175 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:55.655175 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:55.655175 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:55.655175 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:55.655175 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:27:55.655175 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:27:55.655175 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:27:55.655175 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:27:55.657684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:55.657684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:55.657684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:55.657684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:55.657684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:55.657684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:55.657684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:55.657684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:55.657684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:55.657684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:55.657684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:55.657684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:55.657684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:55.657684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:55.657684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:55.657684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:55.657684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:27:55.658586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:27:55.658586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:55.658586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:55.658586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 339/689] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:27:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:55.671626 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd758b2-c9f4-4d44-bbae-b1a9f24f9f95 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:55.685415 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b8564-91db-40af-a3dc-9529d1bf4ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:55.686085 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b8564-91db-40af-a3dc-9529d1bf4ac0 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:55.686448 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b8564-91db-40af-a3dc-9529d1bf4ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:55.686728 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b8564-91db-40af-a3dc-9529d1bf4ac0 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:55.687425 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b8564-91db-40af-a3dc-9529d1bf4ac0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:55.687735 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b8564-91db-40af-a3dc-9529d1bf4ac0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:55.695249 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b8564-91db-40af-a3dc-9529d1bf4ac0 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:55.709599 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 351/690] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:55.719968 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b8564-91db-40af-a3dc-9529d1bf4ac0 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:55.774629 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:55.864884 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b8564-91db-40af-a3dc-9529d1bf4ac0 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:55.867166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd758b2-c9f4-4d44-bbae-b1a9f24f9f95 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:55.903048 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da499c90-2b57-42e8-9d92-a0fc0b8717bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:55.903663 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da499c90-2b57-42e8-9d92-a0fc0b8717bf None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:55.903941 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da499c90-2b57-42e8-9d92-a0fc0b8717bf None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:55.904220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da499c90-2b57-42e8-9d92-a0fc0b8717bf None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:55.904862 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da499c90-2b57-42e8-9d92-a0fc0b8717bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:55.905161 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da499c90-2b57-42e8-9d92-a0fc0b8717bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:55.906572 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da499c90-2b57-42e8-9d92-a0fc0b8717bf None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:55.910010 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34812434-c826-406d-928e-0ce7e1679af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:55.910619 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34812434-c826-406d-928e-0ce7e1679af6 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:55.910896 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34812434-c826-406d-928e-0ce7e1679af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:55.911164 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34812434-c826-406d-928e-0ce7e1679af6 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:55.911822 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34812434-c826-406d-928e-0ce7e1679af6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:55.913797 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34812434-c826-406d-928e-0ce7e1679af6 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:55.922650 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 340/691] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:27:55.932416 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da499c90-2b57-42e8-9d92-a0fc0b8717bf None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:55.963890 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:56.011177 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 352/692] 10.222.0.33 () {60 vars in 1132 bytes} [Fri Sep 16 03:27:55 2022] POST /identity/v3/users => generated 254 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:27:56.061143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da499c90-2b57-42e8-9d92-a0fc0b8717bf None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:56.104534 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824acd2-c005-466a-98b1-51b781b510ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:56.105455 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824acd2-c005-466a-98b1-51b781b510ee None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:56.105928 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824acd2-c005-466a-98b1-51b781b510ee None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:56.106349 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824acd2-c005-466a-98b1-51b781b510ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:56.116462 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e824acd2-c005-466a-98b1-51b781b510ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:56.118365 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e824acd2-c005-466a-98b1-51b781b510ee None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:56.134746 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-e824acd2-c005-466a-98b1-51b781b510ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:27:56.134746 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:56.134746 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:56.134746 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:56.134746 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:56.134746 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:56.134746 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:56.134746 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:56.134746 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:56.134746 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:56.134746 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:56.134746 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:56.134746 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 03:27:56.134746 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 03:27:56.134746 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 03:27:56.136028 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 03:27:56.136028 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:56.136028 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:56.136028 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:56.136028 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:56.136028 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:56.136028 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:56.136028 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:56.136028 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:56.136028 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:56.136028 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:56.136028 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:56.136028 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:56.136028 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:56.136028 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:56.136028 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:56.136028 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:56.137156 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 03:27:56.137156 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 03:27:56.137156 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 03:27:56.137156 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 03:27:56.137156 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 03:27:56.137156 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 03:27:56.137156 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:27:56.137156 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:56.139392 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 341/693] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:27:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:56.146313 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34812434-c826-406d-928e-0ce7e1679af6 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:56.292274 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34812434-c826-406d-928e-0ce7e1679af6 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:56.294309 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:56.331321 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e145fb-55fb-4b87-8bc9-fe9b642bb460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:56.331992 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e145fb-55fb-4b87-8bc9-fe9b642bb460 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:56.332279 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e145fb-55fb-4b87-8bc9-fe9b642bb460 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:56.332543 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e145fb-55fb-4b87-8bc9-fe9b642bb460 None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:56.333239 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e145fb-55fb-4b87-8bc9-fe9b642bb460 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:56.333544 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e145fb-55fb-4b87-8bc9-fe9b642bb460 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:56.335625 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e145fb-55fb-4b87-8bc9-fe9b642bb460 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:56.347779 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 353/694] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 03:27:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:56.353927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824acd2-c005-466a-98b1-51b781b510ee None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:56.408435 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6981e-c637-4f1b-9653-29a7dd6fbb8a None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:56.408780 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6981e-c637-4f1b-9653-29a7dd6fbb8a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:56.408997 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6981e-c637-4f1b-9653-29a7dd6fbb8a None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:56.410593 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 354/695] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 03:27:56.421999 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0a783-1e2c-4b27-9a82-4c1cdd0caf80 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:56.422419 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0a783-1e2c-4b27-9a82-4c1cdd0caf80 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:56.422803 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0a783-1e2c-4b27-9a82-4c1cdd0caf80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:56.450786 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ffc0a783-1e2c-4b27-9a82-4c1cdd0caf80 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:56.451981 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ffc0a783-1e2c-4b27-9a82-4c1cdd0caf80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:56.473826 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:56.493556 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824acd2-c005-466a-98b1-51b781b510ee None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:56.535991 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a9085e-8a84-4137-9ef4-a1d2f8342a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:56.536636 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9085e-8a84-4137-9ef4-a1d2f8342a70 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:56.536920 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9085e-8a84-4137-9ef4-a1d2f8342a70 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:56.537194 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9085e-8a84-4137-9ef4-a1d2f8342a70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:56.538261 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a9085e-8a84-4137-9ef4-a1d2f8342a70 None admin] RBAC: Adding query filter params (role.id=8a338e321ece4061b4b30d6231167b4e, scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2, user.id=9f784d98d5f440c681f53ae70f6d1cc7) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:56.538571 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a9085e-8a84-4137-9ef4-a1d2f8342a70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:56.540696 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a9085e-8a84-4137-9ef4-a1d2f8342a70 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:56.548461 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 342/696] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:27:56 2022] GET /identity/v3/role_assignments?user.id=9f784d98d5f440c681f53ae70f6d1cc7&scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2&role.id=8a338e321ece4061b4b30d6231167b4e => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:56.549495 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 355/697] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:27:56.823141 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a9085e-8a84-4137-9ef4-a1d2f8342a70 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:56.934585 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a9085e-8a84-4137-9ef4-a1d2f8342a70 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:56.978237 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d368aa-4965-4749-a580-ab281f5caaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:56.978939 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d368aa-4965-4749-a580-ab281f5caaf6 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:56.979187 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d368aa-4965-4749-a580-ab281f5caaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:56.979466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d368aa-4965-4749-a580-ab281f5caaf6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:56.996965 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d368aa-4965-4749-a580-ab281f5caaf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:57.002803 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-34d368aa-4965-4749-a580-ab281f5caaf6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:27:57.002803 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:57.002803 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:57.002803 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:57.002803 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:57.002803 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:57.002803 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:57.002803 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:57.002803 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:57.002803 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:57.002803 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:57.002803 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:57.002803 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:57.002803 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:57.002803 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:57.002803 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:57.003849 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:57.003849 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:57.003849 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:57.003849 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:57.003849 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:57.003849 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:57.003849 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:57.003849 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:57.003849 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:57.003849 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:57.003849 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:57.003849 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:57.003849 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:57.003849 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:57.003849 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:57.003849 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:57.004745 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:57.004745 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:57.004745 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:57.004745 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:57.004745 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:57.004745 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:57.004745 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:57.004745 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:57.004745 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:57.004745 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:57.004745 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:27:57.004745 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:57.004745 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 343/698] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 03:27:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:57.010327 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0a783-1e2c-4b27-9a82-4c1cdd0caf80 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:57.110729 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:57.119501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5ae02-87dd-48ff-9818-65ca16271d9e None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:57.119776 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5ae02-87dd-48ff-9818-65ca16271d9e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:57.120047 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5ae02-87dd-48ff-9818-65ca16271d9e None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:57.120213 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0a783-1e2c-4b27-9a82-4c1cdd0caf80 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:57.121712 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 344/699] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 03:27:57.130470 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0430f-8aa4-4c94-8f39-39bc962fcdfd None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:57.130470 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0430f-8aa4-4c94-8f39-39bc962fcdfd None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:57.130470 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0430f-8aa4-4c94-8f39-39bc962fcdfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:57.149981 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5ca0430f-8aa4-4c94-8f39-39bc962fcdfd None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:57.151226 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5ca0430f-8aa4-4c94-8f39-39bc962fcdfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:57.158905 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2b283-3736-4765-90ed-53b8ebe6a381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:57.159516 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2b283-3736-4765-90ed-53b8ebe6a381 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:57.159792 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2b283-3736-4765-90ed-53b8ebe6a381 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:57.160064 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2b283-3736-4765-90ed-53b8ebe6a381 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:57.160220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:57.160724 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2b283-3736-4765-90ed-53b8ebe6a381 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:57.161022 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2b283-3736-4765-90ed-53b8ebe6a381 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:57.162939 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2b283-3736-4765-90ed-53b8ebe6a381 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:57.171853 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 356/700] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:27:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:57.183643 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2b283-3736-4765-90ed-53b8ebe6a381 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:57.250399 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 345/701] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 03:27:57.329341 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2b283-3736-4765-90ed-53b8ebe6a381 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:57.373432 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b1b26-a3ff-4641-9758-7387a6fa7a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:57.374461 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b1b26-a3ff-4641-9758-7387a6fa7a4e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:57.374943 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b1b26-a3ff-4641-9758-7387a6fa7a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:57.375428 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b1b26-a3ff-4641-9758-7387a6fa7a4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:57.391640 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b1b26-a3ff-4641-9758-7387a6fa7a4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:57.393517 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b1b26-a3ff-4641-9758-7387a6fa7a4e None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:57.416853 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-9a2b1b26-a3ff-4641-9758-7387a6fa7a4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:57.416853 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:57.416853 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:57.416853 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:57.416853 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:57.416853 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:57.416853 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:57.416853 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:57.416853 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:57.416853 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:57.416853 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:57.416853 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:57.416853 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:27:57.416853 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:27:57.416853 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:27:57.416853 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:27:57.417907 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:57.417907 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:57.417907 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:57.417907 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:57.417907 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:57.417907 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:57.417907 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:57.417907 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:57.417907 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:57.417907 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:57.417907 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:57.417907 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:57.417907 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:57.417907 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:57.417907 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:57.417907 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:57.417907 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:27:57.418784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:27:57.418784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:57.418784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:57.425522 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 357/702] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:27:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:57.430818 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0430f-8aa4-4c94-8f39-39bc962fcdfd None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:57.564200 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0430f-8aa4-4c94-8f39-39bc962fcdfd None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:57.599488 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec8d51-299c-4e45-bd12-cedc0ff0cc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:57.600593 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec8d51-299c-4e45-bd12-cedc0ff0cc7b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:57.601083 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec8d51-299c-4e45-bd12-cedc0ff0cc7b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:57.601583 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec8d51-299c-4e45-bd12-cedc0ff0cc7b None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:57.602441 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec8d51-299c-4e45-bd12-cedc0ff0cc7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:57.602964 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec8d51-299c-4e45-bd12-cedc0ff0cc7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:57.604540 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec8d51-299c-4e45-bd12-cedc0ff0cc7b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:57.620029 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 346/703] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:57.622862 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b1b26-a3ff-4641-9758-7387a6fa7a4e None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:57.632985 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:57.634361 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec8d51-299c-4e45-bd12-cedc0ff0cc7b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:57.639228 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:57.763927 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b1b26-a3ff-4641-9758-7387a6fa7a4e None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:57.813934 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337cf91c-ebce-4963-9b26-4613e09d35b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:57.814572 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337cf91c-ebce-4963-9b26-4613e09d35b6 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:57.814851 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337cf91c-ebce-4963-9b26-4613e09d35b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:57.815123 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337cf91c-ebce-4963-9b26-4613e09d35b6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:57.820192 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec8d51-299c-4e45-bd12-cedc0ff0cc7b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:57.834272 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337cf91c-ebce-4963-9b26-4613e09d35b6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:57.836242 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337cf91c-ebce-4963-9b26-4613e09d35b6 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:57.852565 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-337cf91c-ebce-4963-9b26-4613e09d35b6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 03:27:57.852565 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:57.852565 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:57.852565 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:57.852565 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:57.852565 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:57.852565 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:57.852565 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:57.852565 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:57.852565 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:57.852565 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:57.852565 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:57.852565 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 03:27:57.852565 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 03:27:57.852565 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 03:27:57.852565 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 03:27:57.853611 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:57.853611 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:57.853611 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 03:27:57.853611 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:27:57.853611 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 03:27:57.853611 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:27:57.853611 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:57.853611 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:57.853611 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:57.853611 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:57.853611 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:57.853611 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:57.853611 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:57.853611 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:57.853611 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:57.853611 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:57.853611 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:57.853611 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:57.854566 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:57.854566 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:57.854566 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 03:27:57.854566 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 03:27:57.854566 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 03:27:57.854566 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 03:27:57.854566 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 03:27:57.854566 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 03:27:57.854566 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 03:27:57.854566 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:57.859352 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 358/704] 10.222.0.33 () {56 vars in 1093 bytes} [Fri Sep 16 03:27:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:57.869424 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337cf91c-ebce-4963-9b26-4613e09d35b6 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:57.893549 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76172e6e-9f18-450d-9ee4-754854050417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:57.894210 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76172e6e-9f18-450d-9ee4-754854050417 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:57.894413 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76172e6e-9f18-450d-9ee4-754854050417 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:57.894686 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76172e6e-9f18-450d-9ee4-754854050417 None admin] PATH_INFO: `/v3/services/network` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:57.895271 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76172e6e-9f18-450d-9ee4-754854050417 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:57.897445 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76172e6e-9f18-450d-9ee4-754854050417 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:57.920680 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-76172e6e-9f18-450d-9ee4-754854050417 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 03:27:57.920680 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:57.920680 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 03:27:57.920680 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 03:27:57.920680 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 03:27:57.920680 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 03:27:57.920680 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 03:27:57.920680 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:27:57.920680 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 03:27:57.920680 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:57.920680 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 03:27:57.920680 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:57.920680 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:57.920680 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:57.920680 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:57.920680 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:57.920680 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:57.921789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:57.921789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:57.921789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:57.921789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:57.921789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:57.921789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:57.921789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 03:27:57.921789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 03:27:57.921789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 03:27:57.921789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 03:27:57.921789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:57.921789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:57.921789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:57.921789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:57.921789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:57.921789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:57.922609 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:57.922609 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:57.922609 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:57.922609 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:57.922609 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:57.922609 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:57.922609 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:57.922609 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:57.922609 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:57.922609 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:57.922609 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 03:27:57.922609 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:27:57.922609 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 03:27:57.922609 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:57.922609 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 347/705] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:27:57 2022] GET /identity/v3/services/network => generated 88 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:27:57.929517 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76172e6e-9f18-450d-9ee4-754854050417 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:57.956030 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:57.994632 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337cf91c-ebce-4963-9b26-4613e09d35b6 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:58.036246 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d0aa2-c8df-45a3-afee-45079dd10198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:58.037020 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d0aa2-c8df-45a3-afee-45079dd10198 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:58.037198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d0aa2-c8df-45a3-afee-45079dd10198 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:58.038176 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d0aa2-c8df-45a3-afee-45079dd10198 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:58.039404 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d0aa2-c8df-45a3-afee-45079dd10198 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:58.039729 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d0aa2-c8df-45a3-afee-45079dd10198 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:58.041488 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d0aa2-c8df-45a3-afee-45079dd10198 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:58.062473 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:58.084866 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 359/706] 10.222.0.33 () {56 vars in 1133 bytes} [Fri Sep 16 03:27:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:58.089174 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d0aa2-c8df-45a3-afee-45079dd10198 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:58.124364 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76172e6e-9f18-450d-9ee4-754854050417 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:58.229936 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d0aa2-c8df-45a3-afee-45079dd10198 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:58.233155 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1298a-0bda-439e-b872-5d3a43365bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:58.233801 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1298a-0bda-439e-b872-5d3a43365bc4 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:58.234085 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1298a-0bda-439e-b872-5d3a43365bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:58.234361 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1298a-0bda-439e-b872-5d3a43365bc4 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:58.234999 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1298a-0bda-439e-b872-5d3a43365bc4 None admin] RBAC: Adding query filter params (name=network) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:58.235299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1298a-0bda-439e-b872-5d3a43365bc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:58.236681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1298a-0bda-439e-b872-5d3a43365bc4 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:58.255857 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 348/707] 10.222.0.33 () {56 vars in 1112 bytes} [Fri Sep 16 03:27:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:27:58.260990 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:58.261252 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1298a-0bda-439e-b872-5d3a43365bc4 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:58.269098 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d37f9-f3c8-4820-81ea-ca6b234da9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:58.275209 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d37f9-f3c8-4820-81ea-ca6b234da9f7 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:58.275500 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d37f9-f3c8-4820-81ea-ca6b234da9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:58.275772 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d37f9-f3c8-4820-81ea-ca6b234da9f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:58.385219 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d37f9-f3c8-4820-81ea-ca6b234da9f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:58.386703 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d37f9-f3c8-4820-81ea-ca6b234da9f7 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:58.499309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1298a-0bda-439e-b872-5d3a43365bc4 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:58.508237 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 360/708] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:27:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 03:27:58.509730 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d059b-f004-4c58-b127-d1ff2d662fe8 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:58.510021 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d059b-f004-4c58-b127-d1ff2d662fe8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:58.510297 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d059b-f004-4c58-b127-d1ff2d662fe8 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:58.516181 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 361/709] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:58.516181 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d059b-f004-4c58-b127-d1ff2d662fe8 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:58.539360 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:58.547012 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63121441-982f-42da-83b6-ab766c26e3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:58.547997 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63121441-982f-42da-83b6-ab766c26e3e1 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:58.548612 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63121441-982f-42da-83b6-ab766c26e3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:58.549124 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63121441-982f-42da-83b6-ab766c26e3e1 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:58.549718 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:58.550769 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63121441-982f-42da-83b6-ab766c26e3e1 None admin] RBAC: Adding query filter params (type=network) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:58.551236 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63121441-982f-42da-83b6-ab766c26e3e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:58.555750 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63121441-982f-42da-83b6-ab766c26e3e1 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:58.566337 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 349/710] 10.222.0.33 () {56 vars in 1112 bytes} [Fri Sep 16 03:27:58 2022] GET /identity/v3/services?type=network => generated 124 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:27:58.569658 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abfc86-8edf-402f-9b91-daf0f3af58f8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:58.569658 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abfc86-8edf-402f-9b91-daf0f3af58f8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:58.569658 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abfc86-8edf-402f-9b91-daf0f3af58f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:58.603406 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-05abfc86-8edf-402f-9b91-daf0f3af58f8 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:58.605486 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-05abfc86-8edf-402f-9b91-daf0f3af58f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:58.695314 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d059b-f004-4c58-b127-d1ff2d662fe8 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:58.754738 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 350/711] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:27:58.763382 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b603f02-f378-4651-b861-c37a1f974bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:58.764023 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b603f02-f378-4651-b861-c37a1f974bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:58.764344 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b603f02-f378-4651-b861-c37a1f974bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:58.764622 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b603f02-f378-4651-b861-c37a1f974bf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:58.776152 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b603f02-f378-4651-b861-c37a1f974bf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:58.777593 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b603f02-f378-4651-b861-c37a1f974bf1 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:58.794011 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-7b603f02-f378-4651-b861-c37a1f974bf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:58.794011 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:58.794011 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:58.794011 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:58.794011 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:58.794011 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:58.794011 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:58.794011 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:58.794011 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:58.794011 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:58.794011 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:58.794011 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:58.794011 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:27:58.794011 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:27:58.794011 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:27:58.794011 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:27:58.795038 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:58.795038 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:58.795038 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:58.795038 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:58.795038 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:58.795038 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:58.795038 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:58.795038 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:58.795038 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:58.795038 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:58.795038 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:58.795038 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:58.795038 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:58.795038 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:58.795038 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:58.795038 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:58.795038 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:27:58.795922 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:27:58.795922 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:27:58.795922 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:58.799633 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 362/712] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:27:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:27:58.800990 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abfc86-8edf-402f-9b91-daf0f3af58f8 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:58.911381 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abfc86-8edf-402f-9b91-daf0f3af58f8 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:58.937011 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:58.942199 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412739d-b4ba-40bc-9ed3-10cacd908753 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:58.942765 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412739d-b4ba-40bc-9ed3-10cacd908753 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:58.949058 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412739d-b4ba-40bc-9ed3-10cacd908753 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:58.949058 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 363/713] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 03:27:58.950308 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c19dde-7bab-46ba-997a-f59a606483e7 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:58.950593 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c19dde-7bab-46ba-997a-f59a606483e7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:58.950977 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c19dde-7bab-46ba-997a-f59a606483e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:58.951441 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe13bef-cb3a-4e09-bb9e-964bbc6cb466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:58.952058 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe13bef-cb3a-4e09-bb9e-964bbc6cb466 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:58.952334 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe13bef-cb3a-4e09-bb9e-964bbc6cb466 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:58.952604 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe13bef-cb3a-4e09-bb9e-964bbc6cb466 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:58.953249 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe13bef-cb3a-4e09-bb9e-964bbc6cb466 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:58.953547 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe13bef-cb3a-4e09-bb9e-964bbc6cb466 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:58.955180 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe13bef-cb3a-4e09-bb9e-964bbc6cb466 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:58.969782 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 351/714] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:27:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:58.978710 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe13bef-cb3a-4e09-bb9e-964bbc6cb466 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:58.980074 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-95c19dde-7bab-46ba-997a-f59a606483e7 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:58.981271 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-95c19dde-7bab-46ba-997a-f59a606483e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:59.097814 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 364/715] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:27:59.098658 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c19dde-7bab-46ba-997a-f59a606483e7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:59.110702 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:59.142794 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe13bef-cb3a-4e09-bb9e-964bbc6cb466 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:59.207318 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad17bc1-4ffe-4295-8193-f4c7033a3db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:59.207958 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad17bc1-4ffe-4295-8193-f4c7033a3db3 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:59.208246 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad17bc1-4ffe-4295-8193-f4c7033a3db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:59.208521 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad17bc1-4ffe-4295-8193-f4c7033a3db3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:59.218213 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad17bc1-4ffe-4295-8193-f4c7033a3db3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:59.219795 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad17bc1-4ffe-4295-8193-f4c7033a3db3 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:59.243691 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-1ad17bc1-4ffe-4295-8193-f4c7033a3db3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:27:59.243691 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:59.243691 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:59.243691 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:59.243691 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:59.243691 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:59.243691 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:59.243691 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:59.243691 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:59.243691 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:59.243691 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:59.243691 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:59.243691 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 03:27:59.243691 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 03:27:59.243691 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 03:27:59.244624 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 03:27:59.244624 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:59.244624 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:59.244624 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:59.244624 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:59.244624 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:59.244624 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:59.244624 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:59.244624 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:59.244624 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:59.244624 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:59.244624 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:59.244624 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:59.244624 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:59.244624 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:59.244624 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:59.244624 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:59.245515 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 03:27:59.245515 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 03:27:59.245515 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 03:27:59.245515 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 03:27:59.245515 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 03:27:59.245515 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 03:27:59.245515 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:27:59.245515 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:27:59.245515 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 352/716] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:27:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:59.251441 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad17bc1-4ffe-4295-8193-f4c7033a3db3 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:59.259268 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c19dde-7bab-46ba-997a-f59a606483e7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:59.299196 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f88c3-49ee-47a4-ae32-334e2d8d46cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:59.300078 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f88c3-49ee-47a4-ae32-334e2d8d46cd None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:59.300563 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f88c3-49ee-47a4-ae32-334e2d8d46cd None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:59.301303 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f88c3-49ee-47a4-ae32-334e2d8d46cd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:59.302428 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f88c3-49ee-47a4-ae32-334e2d8d46cd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:59.304130 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f88c3-49ee-47a4-ae32-334e2d8d46cd None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:59.315430 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-c80f88c3-49ee-47a4-ae32-334e2d8d46cd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 03:27:59.315430 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:59.315430 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 03:27:59.315430 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 03:27:59.315430 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 03:27:59.315430 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 03:27:59.315430 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 03:27:59.315430 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:27:59.315430 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 03:27:59.315430 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:59.315430 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 03:27:59.315430 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:59.315430 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:59.315430 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:59.315430 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:59.315430 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:59.315430 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:59.316429 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:59.316429 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:59.316429 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:59.316429 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:59.316429 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:59.316429 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:59.316429 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 03:27:59.316429 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 03:27:59.316429 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 03:27:59.316429 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 03:27:59.316429 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:59.316429 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:59.316429 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:59.316429 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:59.316429 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:59.316429 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:59.317270 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:59.317270 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:59.317270 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:59.317270 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:59.317270 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:59.317270 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:59.317270 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:59.317270 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:59.317270 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:59.317270 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:59.317270 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 03:27:59.317270 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:27:59.317270 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 03:27:59.317270 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:59.320785 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 365/717] 10.222.0.33 () {56 vars in 1129 bytes} [Fri Sep 16 03:27:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:59.327585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f88c3-49ee-47a4-ae32-334e2d8d46cd None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:59.369902 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:59.406035 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:59.441991 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f88c3-49ee-47a4-ae32-334e2d8d46cd None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:59.473664 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad17bc1-4ffe-4295-8193-f4c7033a3db3 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:59.486278 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1d66d-47b8-477d-a839-3ad7225b2d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:59.487426 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1d66d-47b8-477d-a839-3ad7225b2d95 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:59.487852 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1d66d-47b8-477d-a839-3ad7225b2d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:59.488265 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1d66d-47b8-477d-a839-3ad7225b2d95 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:59.489043 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1d66d-47b8-477d-a839-3ad7225b2d95 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:59.489483 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1d66d-47b8-477d-a839-3ad7225b2d95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:59.491635 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1d66d-47b8-477d-a839-3ad7225b2d95 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:59.497421 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 366/718] 10.222.0.33 () {56 vars in 1124 bytes} [Fri Sep 16 03:27:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:59.502624 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1d66d-47b8-477d-a839-3ad7225b2d95 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:59.517288 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d82ca9-a37b-48dd-a6f4-83fe9800275f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:59.517978 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d82ca9-a37b-48dd-a6f4-83fe9800275f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:59.518205 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d82ca9-a37b-48dd-a6f4-83fe9800275f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:59.518481 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d82ca9-a37b-48dd-a6f4-83fe9800275f None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:59.519173 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d82ca9-a37b-48dd-a6f4-83fe9800275f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:59.519478 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d82ca9-a37b-48dd-a6f4-83fe9800275f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:59.521279 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d82ca9-a37b-48dd-a6f4-83fe9800275f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:59.535656 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 353/719] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 03:27:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:27:59.536688 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d82ca9-a37b-48dd-a6f4-83fe9800275f None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:59.615379 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1d66d-47b8-477d-a839-3ad7225b2d95 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:59.641861 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d82ca9-a37b-48dd-a6f4-83fe9800275f None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:59.644098 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:59.652286 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3afd6-0128-4e97-9d27-078c2e2da5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:59.652928 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3afd6-0128-4e97-9d27-078c2e2da5bc None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:59.653211 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3afd6-0128-4e97-9d27-078c2e2da5bc None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:59.653496 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3afd6-0128-4e97-9d27-078c2e2da5bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:59.655559 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:59.666003 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b3afd6-0128-4e97-9d27-078c2e2da5bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:27:59.671010 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-78b3afd6-0128-4e97-9d27-078c2e2da5bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 03:27:59.671010 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:27:59.671010 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:27:59.671010 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:27:59.671010 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:27:59.671010 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:27:59.671010 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:27:59.671010 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:27:59.671010 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:27:59.671010 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:27:59.671010 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:27:59.671010 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:27:59.671010 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:27:59.671010 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:27:59.671010 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:27:59.671010 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:27:59.671933 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:27:59.671933 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:27:59.671933 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:27:59.671933 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:27:59.671933 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:27:59.671933 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:27:59.671933 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:27:59.671933 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:27:59.671933 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:27:59.671933 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:27:59.671933 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:27:59.671933 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:27:59.671933 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:27:59.671933 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:27:59.671933 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:27:59.671933 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:27:59.674901 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:27:59.674901 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:27:59.674901 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:27:59.674901 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:27:59.674901 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:27:59.674901 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:27:59.674901 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:27:59.674901 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:27:59.674901 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:27:59.674901 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:27:59.674901 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 03:27:59.674901 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:27:59.674901 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 367/720] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 03:27:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:27:59.674901 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3afd6-0128-4e97-9d27-078c2e2da5bc None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:59.680700 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b236d0b8-dc3d-483b-8cf6-783eb2d691de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:59.681567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236d0b8-dc3d-483b-8cf6-783eb2d691de None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:59.682081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236d0b8-dc3d-483b-8cf6-783eb2d691de None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:59.682554 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236d0b8-dc3d-483b-8cf6-783eb2d691de None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:59.683435 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b236d0b8-dc3d-483b-8cf6-783eb2d691de None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:59.683824 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b236d0b8-dc3d-483b-8cf6-783eb2d691de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:59.685571 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b236d0b8-dc3d-483b-8cf6-783eb2d691de None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:59.697734 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 354/721] 10.222.0.33 () {56 vars in 1124 bytes} [Fri Sep 16 03:27:59 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:59.697734 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe509b-3943-451d-81f4-11171d729d2c None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:59.697734 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe509b-3943-451d-81f4-11171d729d2c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:59.697734 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe509b-3943-451d-81f4-11171d729d2c None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:59.700451 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 355/722] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:27:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:27:59.700451 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe509b-3943-451d-81f4-11171d729d2c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:59.815259 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3afd6-0128-4e97-9d27-078c2e2da5bc None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:59.847962 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe509b-3943-451d-81f4-11171d729d2c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:27:59.860173 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b0101-afb1-4045-9eef-f1d70c4dc1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:59.860798 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b0101-afb1-4045-9eef-f1d70c4dc1d8 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:59.861131 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b0101-afb1-4045-9eef-f1d70c4dc1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:59.861407 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b0101-afb1-4045-9eef-f1d70c4dc1d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:59.862252 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b0101-afb1-4045-9eef-f1d70c4dc1d8 None admin] RBAC: Adding query filter params (role.id=4ffac54101e248479bcdc0e54890020f, scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2, user.id=c09d1a4ac8b64921a6b05fcd567bb770) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:59.862595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b0101-afb1-4045-9eef-f1d70c4dc1d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:59.864303 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b0101-afb1-4045-9eef-f1d70c4dc1d8 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:59.878143 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 368/723] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:27:59 2022] GET /identity/v3/role_assignments?user.id=c09d1a4ac8b64921a6b05fcd567bb770&scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2&role.id=4ffac54101e248479bcdc0e54890020f => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:59.879722 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a37ec-a1c8-434c-9af8-023d78660952 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:59.880017 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a37ec-a1c8-434c-9af8-023d78660952 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:59.880350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a37ec-a1c8-434c-9af8-023d78660952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:59.892905 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75dd2a-da59-4c65-8a86-9b80a673ac3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:27:59.893937 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75dd2a-da59-4c65-8a86-9b80a673ac3b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:27:59.894439 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75dd2a-da59-4c65-8a86-9b80a673ac3b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:27:59.894910 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75dd2a-da59-4c65-8a86-9b80a673ac3b None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:27:59.896177 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75dd2a-da59-4c65-8a86-9b80a673ac3b None admin] RBAC: Adding query filter params (name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:27:59.896488 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75dd2a-da59-4c65-8a86-9b80a673ac3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:27:59.898437 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75dd2a-da59-4c65-8a86-9b80a673ac3b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:27:59.908376 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 356/724] 10.222.0.33 () {56 vars in 1103 bytes} [Fri Sep 16 03:27:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:27:59.913936 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-121a37ec-a1c8-434c-9af8-023d78660952 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:27:59.914117 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75dd2a-da59-4c65-8a86-9b80a673ac3b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:27:59.915162 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-121a37ec-a1c8-434c-9af8-023d78660952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:27:59.961522 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:27:59.995885 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:00.012977 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 369/725] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:27:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:28:00.100641 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75dd2a-da59-4c65-8a86-9b80a673ac3b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:00.137808 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfcf058-a910-4f02-a235-fed0d9ab1d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:00.138454 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfcf058-a910-4f02-a235-fed0d9ab1d6f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:00.138735 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfcf058-a910-4f02-a235-fed0d9ab1d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:00.139010 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfcf058-a910-4f02-a235-fed0d9ab1d6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:00.151517 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfcf058-a910-4f02-a235-fed0d9ab1d6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:00.152918 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfcf058-a910-4f02-a235-fed0d9ab1d6f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:00.168305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-6cfcf058-a910-4f02-a235-fed0d9ab1d6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:00.168305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:00.168305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:00.168305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:00.168305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:00.168305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:00.168305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:00.168305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:00.168305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:00.168305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:00.168305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:00.168305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:00.168305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:28:00.168305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:28:00.168305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:28:00.168305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:28:00.169308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:00.169308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:00.169308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:00.169308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:00.169308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:00.169308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:00.169308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:00.169308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:00.169308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:00.169308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:00.169308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:00.169308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:00.169308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:00.169308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:00.169308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:00.169308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:00.169308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:28:00.170267 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:28:00.170267 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:00.170267 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:00.170267 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 357/726] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:27:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:28:00.182787 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a37ec-a1c8-434c-9af8-023d78660952 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:00.314323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a37ec-a1c8-434c-9af8-023d78660952 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:00.364137 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4cc4c7-de30-4a6e-9393-463469954f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:00.364850 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4cc4c7-de30-4a6e-9393-463469954f26 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:00.365130 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4cc4c7-de30-4a6e-9393-463469954f26 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:00.365511 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4cc4c7-de30-4a6e-9393-463469954f26 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:00.366183 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4cc4c7-de30-4a6e-9393-463469954f26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:00.366486 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4cc4c7-de30-4a6e-9393-463469954f26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:00.367954 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4cc4c7-de30-4a6e-9393-463469954f26 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:00.384718 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 370/727] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:28:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:00.393904 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfcf058-a910-4f02-a235-fed0d9ab1d6f None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:00.410642 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4cc4c7-de30-4a6e-9393-463469954f26 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:00.503477 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:00.546702 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:00.577855 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4cc4c7-de30-4a6e-9393-463469954f26 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:00.583645 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfcf058-a910-4f02-a235-fed0d9ab1d6f None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:00.643267 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17479df1-2907-4d25-ad8e-547c4d59403d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:00.643904 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17479df1-2907-4d25-ad8e-547c4d59403d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:00.644183 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17479df1-2907-4d25-ad8e-547c4d59403d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:00.644455 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17479df1-2907-4d25-ad8e-547c4d59403d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:00.650823 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8b04c-e838-49b9-9296-302c72193076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:00.651471 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8b04c-e838-49b9-9296-302c72193076 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:00.651756 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8b04c-e838-49b9-9296-302c72193076 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:00.652030 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8b04c-e838-49b9-9296-302c72193076 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:00.663443 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17479df1-2907-4d25-ad8e-547c4d59403d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:28:00.668711 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-17479df1-2907-4d25-ad8e-547c4d59403d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:28:00.668711 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:00.668711 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:00.668711 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:00.668711 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:00.668711 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:00.668711 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:00.668711 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:00.668711 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:00.668711 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:00.668711 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:00.668711 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:00.668711 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:28:00.668711 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:28:00.668711 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:28:00.668711 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:28:00.669645 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:28:00.669645 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:28:00.669645 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:28:00.669645 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:28:00.669645 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:00.669645 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:00.669645 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:00.669645 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:00.669645 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:00.669645 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:00.669645 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:00.669645 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:00.669645 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:00.669645 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:00.669645 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:00.669645 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:00.670552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:00.670552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:00.670552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:00.670552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:00.670552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:28:00.670552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:28:00.670552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:28:00.670552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:28:00.670552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:28:00.670552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:28:00.670552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:28:00.670552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:00.670552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 371/728] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 03:28:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:00.672762 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c8b04c-e838-49b9-9296-302c72193076 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:00.674571 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c8b04c-e838-49b9-9296-302c72193076 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:00.676124 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17479df1-2907-4d25-ad8e-547c4d59403d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:00.693528 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-36c8b04c-e838-49b9-9296-302c72193076 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 03:28:00.693528 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:00.693528 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:00.693528 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:00.693528 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:00.693528 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:00.693528 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:00.693528 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:00.693528 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:00.693528 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:00.693528 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:00.693528 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:00.693528 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 03:28:00.693528 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 03:28:00.693528 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 03:28:00.693528 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 03:28:00.697172 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:00.697172 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:00.697172 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 03:28:00.697172 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:28:00.697172 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 03:28:00.697172 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:28:00.697172 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:00.697172 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:00.697172 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:00.697172 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:00.697172 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:00.697172 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:00.697172 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:00.697172 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:00.697172 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:00.697172 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:00.697172 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:00.697172 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:00.698143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:00.698143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:00.698143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 03:28:00.698143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 03:28:00.698143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 03:28:00.698143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 03:28:00.698143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 03:28:00.698143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 03:28:00.698143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 03:28:00.698143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:00.698143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 358/729] 10.222.0.33 () {56 vars in 1117 bytes} [Fri Sep 16 03:28:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:00.702436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8b04c-e838-49b9-9296-302c72193076 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:00.861844 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17479df1-2907-4d25-ad8e-547c4d59403d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:00.873501 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:00.887650 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8b04c-e838-49b9-9296-302c72193076 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:00.920570 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097c981-2152-4c2f-bbff-c9b997473a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:00.924425 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097c981-2152-4c2f-bbff-c9b997473a17 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:00.924729 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097c981-2152-4c2f-bbff-c9b997473a17 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:00.925007 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097c981-2152-4c2f-bbff-c9b997473a17 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:00.925717 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4097c981-2152-4c2f-bbff-c9b997473a17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:00.926040 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4097c981-2152-4c2f-bbff-c9b997473a17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:00.927532 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4097c981-2152-4c2f-bbff-c9b997473a17 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:00.937282 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 372/730] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:28:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:00.943992 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097c981-2152-4c2f-bbff-c9b997473a17 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:00.947387 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c3f4a-f74e-4f7d-8779-1d470dae2b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:00.948006 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c3f4a-f74e-4f7d-8779-1d470dae2b7e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:00.948285 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c3f4a-f74e-4f7d-8779-1d470dae2b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:00.950340 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c3f4a-f74e-4f7d-8779-1d470dae2b7e None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:00.950340 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c3f4a-f74e-4f7d-8779-1d470dae2b7e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:00.950340 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c3f4a-f74e-4f7d-8779-1d470dae2b7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:00.951254 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c3f4a-f74e-4f7d-8779-1d470dae2b7e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:00.973997 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:00.981451 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 359/731] 10.222.0.33 () {56 vars in 1149 bytes} [Fri Sep 16 03:28:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:00.994704 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c3f4a-f74e-4f7d-8779-1d470dae2b7e None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:01.106971 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097c981-2152-4c2f-bbff-c9b997473a17 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:01.145989 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c3f4a-f74e-4f7d-8779-1d470dae2b7e None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:01.147574 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc76157-f6a0-494c-9c98-3d625935b17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:01.148437 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc76157-f6a0-494c-9c98-3d625935b17b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:01.148870 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc76157-f6a0-494c-9c98-3d625935b17b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:01.150954 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc76157-f6a0-494c-9c98-3d625935b17b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:01.172257 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc76157-f6a0-494c-9c98-3d625935b17b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:01.175145 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc76157-f6a0-494c-9c98-3d625935b17b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:01.199286 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-9dc76157-f6a0-494c-9c98-3d625935b17b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:01.199286 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:01.199286 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:01.199286 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:01.199286 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:01.199286 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:01.199286 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:01.199286 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:01.199286 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:01.199286 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:01.199286 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:01.199286 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:01.199286 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:28:01.199286 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:28:01.199286 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:28:01.199286 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:28:01.200862 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:01.200862 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:01.200862 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:01.200862 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:01.200862 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:01.200862 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:01.200862 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:01.200862 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:01.200862 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:01.200862 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:01.200862 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:01.200862 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:01.200862 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:01.200862 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:01.200862 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:01.200862 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:01.200862 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:28:01.202013 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:28:01.202013 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:01.202013 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:01.207381 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 373/732] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:28:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:01.213968 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc76157-f6a0-494c-9c98-3d625935b17b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:01.228451 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b57fce-e36c-45e0-bf61-912b9657b5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:01.229336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b57fce-e36c-45e0-bf61-912b9657b5e6 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:01.229797 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b57fce-e36c-45e0-bf61-912b9657b5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:01.230238 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b57fce-e36c-45e0-bf61-912b9657b5e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:01.260938 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:01.313125 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:01.317158 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b57fce-e36c-45e0-bf61-912b9657b5e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:01.318838 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b57fce-e36c-45e0-bf61-912b9657b5e6 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:01.361866 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc76157-f6a0-494c-9c98-3d625935b17b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:01.398077 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac3cd5-b906-4f71-bd29-e93da2af318e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:01.399048 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac3cd5-b906-4f71-bd29-e93da2af318e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:01.399577 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac3cd5-b906-4f71-bd29-e93da2af318e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:01.400102 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac3cd5-b906-4f71-bd29-e93da2af318e None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:01.400949 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac3cd5-b906-4f71-bd29-e93da2af318e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:01.401487 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac3cd5-b906-4f71-bd29-e93da2af318e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:01.403120 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac3cd5-b906-4f71-bd29-e93da2af318e None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:01.415225 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 374/733] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:28:01.416758 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8ccb2-b17e-462f-bc8d-38d20e2bee3a None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:01.417253 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8ccb2-b17e-462f-bc8d-38d20e2bee3a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:01.417752 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8ccb2-b17e-462f-bc8d-38d20e2bee3a None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:01.419584 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 375/734] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:28:01.420483 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8ccb2-b17e-462f-bc8d-38d20e2bee3a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:01.423735 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 360/735] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:28:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 03:28:01.425086 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2faf6-ff5f-4736-a49c-cb9340274dec None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:01.425328 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2faf6-ff5f-4736-a49c-cb9340274dec None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:01.425608 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2faf6-ff5f-4736-a49c-cb9340274dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:01.444816 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8cf2faf6-ff5f-4736-a49c-cb9340274dec None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:01.446131 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8cf2faf6-ff5f-4736-a49c-cb9340274dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:01.509109 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:01.516495 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 361/736] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:28:01.517346 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2faf6-ff5f-4736-a49c-cb9340274dec None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:01.530525 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8ccb2-b17e-462f-bc8d-38d20e2bee3a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:01.550114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:01.567466 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a10e1e-d76b-4878-a3ba-c4925bef6aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:01.568951 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a10e1e-d76b-4878-a3ba-c4925bef6aa7 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:01.569443 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a10e1e-d76b-4878-a3ba-c4925bef6aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:01.569945 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a10e1e-d76b-4878-a3ba-c4925bef6aa7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:01.585659 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a10e1e-d76b-4878-a3ba-c4925bef6aa7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:01.587472 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a10e1e-d76b-4878-a3ba-c4925bef6aa7 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:01.607980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-c3a10e1e-d76b-4878-a3ba-c4925bef6aa7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 16 03:28:01.607980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:01.607980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:01.607980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:01.607980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:01.607980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:01.607980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:01.607980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:01.607980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:01.607980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:01.607980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:01.607980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:01.607980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 03:28:01.607980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 03:28:01.607980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 03:28:01.607980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 03:28:01.608953 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:01.608953 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:01.608953 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 03:28:01.608953 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:28:01.608953 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 03:28:01.608953 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:28:01.608953 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:01.608953 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:01.608953 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:01.608953 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:01.608953 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:01.608953 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:01.608953 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:01.608953 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:01.608953 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:01.608953 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:01.608953 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:01.608953 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:01.609921 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:01.609921 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:01.609921 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 03:28:01.609921 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 03:28:01.609921 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 03:28:01.609921 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 03:28:01.609921 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 03:28:01.609921 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 03:28:01.609921 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 16 03:28:01.609921 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:01.612383 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 376/737] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 03:28:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:01.617857 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a10e1e-d76b-4878-a3ba-c4925bef6aa7 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:01.622174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2faf6-ff5f-4736-a49c-cb9340274dec None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:01.665602 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95657b-7988-43a3-94dd-745b0424b5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:01.666273 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95657b-7988-43a3-94dd-745b0424b5b1 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:01.666552 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95657b-7988-43a3-94dd-745b0424b5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:01.666830 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95657b-7988-43a3-94dd-745b0424b5b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:01.686019 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95657b-7988-43a3-94dd-745b0424b5b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:01.687608 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95657b-7988-43a3-94dd-745b0424b5b1 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:01.732176 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-fa95657b-7988-43a3-94dd-745b0424b5b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:01.732176 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:01.732176 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:01.732176 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:01.732176 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:01.732176 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:01.732176 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:01.732176 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:01.732176 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:01.732176 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:01.732176 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:01.732176 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:01.732176 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:28:01.732176 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:28:01.732176 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:28:01.732176 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:28:01.733174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:01.733174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:01.733174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:01.733174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:01.733174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:01.733174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:01.733174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:01.733174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:01.733174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:01.733174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:01.733174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:01.733174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:01.733174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:01.733174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:01.733174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:01.733174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:01.733174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:28:01.734095 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:28:01.734095 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:01.734095 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:01.743642 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 362/738] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:28:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:01.746543 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95657b-7988-43a3-94dd-745b0424b5b1 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:01.751480 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a10e1e-d76b-4878-a3ba-c4925bef6aa7 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:01.819133 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85ecbb-1f2e-441e-b802-beb15e80dad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:01.820152 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85ecbb-1f2e-441e-b802-beb15e80dad0 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:01.823157 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85ecbb-1f2e-441e-b802-beb15e80dad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:01.823651 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85ecbb-1f2e-441e-b802-beb15e80dad0 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:01.824589 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd85ecbb-1f2e-441e-b802-beb15e80dad0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:01.825119 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd85ecbb-1f2e-441e-b802-beb15e80dad0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:01.826820 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd85ecbb-1f2e-441e-b802-beb15e80dad0 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:01.848846 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:01.859126 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 377/739] 10.222.0.33 () {56 vars in 1135 bytes} [Fri Sep 16 03:28:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:01.860213 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85ecbb-1f2e-441e-b802-beb15e80dad0 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:01.890116 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:01.913162 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95657b-7988-43a3-94dd-745b0424b5b1 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:01.956437 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca541eb-e5e6-41e5-876f-8cd3f267e173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:01.957106 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca541eb-e5e6-41e5-876f-8cd3f267e173 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:01.957406 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca541eb-e5e6-41e5-876f-8cd3f267e173 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:01.957713 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca541eb-e5e6-41e5-876f-8cd3f267e173 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:01.958524 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca541eb-e5e6-41e5-876f-8cd3f267e173 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:01.958837 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca541eb-e5e6-41e5-876f-8cd3f267e173 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:01.961051 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca541eb-e5e6-41e5-876f-8cd3f267e173 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:01.976473 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85ecbb-1f2e-441e-b802-beb15e80dad0 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:01.976646 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 363/740] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:01.977617 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca541eb-e5e6-41e5-876f-8cd3f267e173 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:02.016958 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b6781-85bb-4cf1-a2df-02adfa20c85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:02.017972 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b6781-85bb-4cf1-a2df-02adfa20c85f None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:02.018462 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b6781-85bb-4cf1-a2df-02adfa20c85f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:02.018938 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b6781-85bb-4cf1-a2df-02adfa20c85f None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:02.019815 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b6781-85bb-4cf1-a2df-02adfa20c85f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:02.022264 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b6781-85bb-4cf1-a2df-02adfa20c85f None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:02.101290 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca541eb-e5e6-41e5-876f-8cd3f267e173 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:02.127057 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 378/741] 10.222.0.33 () {60 vars in 1141 bytes} [Fri Sep 16 03:28:01 2022] POST /identity/v3/services => generated 240 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:28:02.129075 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b6781-85bb-4cf1-a2df-02adfa20c85f None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:02.151218 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f91c66-5ebd-4ad6-8671-618cedc89e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:02.151909 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f91c66-5ebd-4ad6-8671-618cedc89e2f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:02.152198 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f91c66-5ebd-4ad6-8671-618cedc89e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:02.152476 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f91c66-5ebd-4ad6-8671-618cedc89e2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:02.165562 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:02.228029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:02.266020 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f91c66-5ebd-4ad6-8671-618cedc89e2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:02.268032 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f91c66-5ebd-4ad6-8671-618cedc89e2f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:02.275569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b6781-85bb-4cf1-a2df-02adfa20c85f None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:02.316884 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9e50c-6e0b-42d3-80ff-82d8b2204d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:02.317732 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9e50c-6e0b-42d3-80ff-82d8b2204d80 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:02.318097 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9e50c-6e0b-42d3-80ff-82d8b2204d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:02.318989 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9e50c-6e0b-42d3-80ff-82d8b2204d80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:02.326808 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d9e50c-6e0b-42d3-80ff-82d8b2204d80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:02.328399 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d9e50c-6e0b-42d3-80ff-82d8b2204d80 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:02.342401 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-52d9e50c-6e0b-42d3-80ff-82d8b2204d80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:28:02.342401 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:02.342401 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:02.342401 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:02.342401 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:02.342401 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:02.342401 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:02.342401 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:02.342401 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:02.342401 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:02.342401 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:02.342401 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:02.342401 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 03:28:02.342401 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 03:28:02.342401 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 03:28:02.343350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 03:28:02.343350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:02.343350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:02.343350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:02.343350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:02.343350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:02.343350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:02.343350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:02.343350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:02.343350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:02.343350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:02.343350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:02.343350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:02.343350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:02.343350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:02.343350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:02.343350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:02.344243 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 03:28:02.344243 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 03:28:02.344243 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 03:28:02.344243 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 03:28:02.344243 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 03:28:02.344243 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 03:28:02.344243 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:28:02.344243 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:02.347064 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 379/742] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:28:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:02.347064 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3e6cd-a4b2-4b5c-9caa-0316fa3c0706 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:02.347331 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3e6cd-a4b2-4b5c-9caa-0316fa3c0706 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:02.347615 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3e6cd-a4b2-4b5c-9caa-0316fa3c0706 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:02.350244 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 380/743] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:28:02.351108 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3e6cd-a4b2-4b5c-9caa-0316fa3c0706 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:02.407311 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 364/744] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:28:01 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 03:28:02.408322 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad6f07-a7da-4dc2-bfea-457815489efd None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:02.408679 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad6f07-a7da-4dc2-bfea-457815489efd None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:02.408963 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad6f07-a7da-4dc2-bfea-457815489efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:02.428515 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1bad6f07-a7da-4dc2-bfea-457815489efd None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:02.430126 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1bad6f07-a7da-4dc2-bfea-457815489efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:02.461053 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:02.473933 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3e6cd-a4b2-4b5c-9caa-0316fa3c0706 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:02.496442 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:02.505431 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 365/745] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:02 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:28:02.505431 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb6db9-cad9-46d0-8d03-c70ae4f4361b None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:02.505431 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb6db9-cad9-46d0-8d03-c70ae4f4361b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:02.505431 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb6db9-cad9-46d0-8d03-c70ae4f4361b None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:02.505431 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 366/746] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:28:02.505431 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb6db9-cad9-46d0-8d03-c70ae4f4361b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:02.520680 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af726268-78de-4f8a-8705-0a1d481a1e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:02.521292 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af726268-78de-4f8a-8705-0a1d481a1e90 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:02.521656 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af726268-78de-4f8a-8705-0a1d481a1e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:02.521940 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af726268-78de-4f8a-8705-0a1d481a1e90 None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:02.522628 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af726268-78de-4f8a-8705-0a1d481a1e90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:02.522935 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af726268-78de-4f8a-8705-0a1d481a1e90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:02.524361 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af726268-78de-4f8a-8705-0a1d481a1e90 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:02.537815 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 381/747] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 03:28:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:02.539079 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06303c48-9802-4b87-8720-3a7903f6a2fd None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:02.539368 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06303c48-9802-4b87-8720-3a7903f6a2fd None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:02.539645 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06303c48-9802-4b87-8720-3a7903f6a2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:02.558713 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-06303c48-9802-4b87-8720-3a7903f6a2fd None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:02.559954 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-06303c48-9802-4b87-8720-3a7903f6a2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:02.630626 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb6db9-cad9-46d0-8d03-c70ae4f4361b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:02.632666 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 382/748] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:02 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 03:28:02.633847 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06303c48-9802-4b87-8720-3a7903f6a2fd None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:02.713662 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5126652-d4a7-4fc4-b905-15b9e947506d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:02.713662 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5126652-d4a7-4fc4-b905-15b9e947506d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:02.713662 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5126652-d4a7-4fc4-b905-15b9e947506d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:02.713662 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5126652-d4a7-4fc4-b905-15b9e947506d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:02.734331 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5126652-d4a7-4fc4-b905-15b9e947506d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:02.735812 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5126652-d4a7-4fc4-b905-15b9e947506d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:02.769939 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-e5126652-d4a7-4fc4-b905-15b9e947506d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:02.769939 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:02.769939 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:02.769939 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:02.769939 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:02.769939 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:02.769939 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:02.769939 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:02.769939 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:02.769939 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:02.769939 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:02.769939 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:02.769939 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:28:02.769939 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:28:02.769939 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:28:02.769939 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:28:02.771165 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:02.771165 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:02.771165 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:02.771165 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:02.771165 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:02.771165 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:02.771165 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:02.771165 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:02.771165 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:02.771165 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:02.771165 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:02.771165 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:02.771165 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:02.771165 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:02.771165 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:02.771165 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:02.771165 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:28:02.772612 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:28:02.772612 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:02.772612 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:02.775617 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 367/749] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:28:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:02.778999 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5126652-d4a7-4fc4-b905-15b9e947506d None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:02.816018 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06303c48-9802-4b87-8720-3a7903f6a2fd None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:02.820970 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:02.842010 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:02.856796 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab59158-9c99-4e7e-9269-7e7b417c32cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:02.857824 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab59158-9c99-4e7e-9269-7e7b417c32cc None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:02.858114 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab59158-9c99-4e7e-9269-7e7b417c32cc None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:02.858442 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab59158-9c99-4e7e-9269-7e7b417c32cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:02.859170 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab59158-9c99-4e7e-9269-7e7b417c32cc None admin] RBAC: Adding query filter params (role.id=8a338e321ece4061b4b30d6231167b4e, scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2, user.id=b0812002d7b14bcb81a42eb380231feb) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:02.859476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab59158-9c99-4e7e-9269-7e7b417c32cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:02.860907 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab59158-9c99-4e7e-9269-7e7b417c32cc None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:02.869112 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 383/750] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:28:02 2022] GET /identity/v3/role_assignments?user.id=b0812002d7b14bcb81a42eb380231feb&scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2&role.id=8a338e321ece4061b4b30d6231167b4e => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:02.870245 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab59158-9c99-4e7e-9269-7e7b417c32cc None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:02.911385 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5126652-d4a7-4fc4-b905-15b9e947506d None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:02.950320 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546387f-9b68-4a5c-90f9-47ef4c542565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:02.951142 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546387f-9b68-4a5c-90f9-47ef4c542565 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:02.951434 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546387f-9b68-4a5c-90f9-47ef4c542565 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:02.951712 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546387f-9b68-4a5c-90f9-47ef4c542565 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:02.952487 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1546387f-9b68-4a5c-90f9-47ef4c542565 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:02.952796 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1546387f-9b68-4a5c-90f9-47ef4c542565 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:02.954279 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1546387f-9b68-4a5c-90f9-47ef4c542565 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:02.969094 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 368/751] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:28:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:02.975850 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546387f-9b68-4a5c-90f9-47ef4c542565 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:02.994881 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab59158-9c99-4e7e-9269-7e7b417c32cc None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:03.042591 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49aa41-0973-4468-a889-599f73305912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:03.043246 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49aa41-0973-4468-a889-599f73305912 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:03.043530 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49aa41-0973-4468-a889-599f73305912 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:03.043914 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49aa41-0973-4468-a889-599f73305912 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:03.044697 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49aa41-0973-4468-a889-599f73305912 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:03.046413 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49aa41-0973-4468-a889-599f73305912 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:03.077013 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:03.097287 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546387f-9b68-4a5c-90f9-47ef4c542565 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:03.125831 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 384/752] 10.222.0.33 () {60 vars in 1141 bytes} [Fri Sep 16 03:28:02 2022] POST /identity/v3/services => generated 251 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:28:03.126765 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49aa41-0973-4468-a889-599f73305912 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:03.165751 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dce945-1d5f-4cf9-9d92-f8c4bf2c4599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:03.166416 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dce945-1d5f-4cf9-9d92-f8c4bf2c4599 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:03.166723 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dce945-1d5f-4cf9-9d92-f8c4bf2c4599 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:03.167004 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dce945-1d5f-4cf9-9d92-f8c4bf2c4599 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:03.186164 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dce945-1d5f-4cf9-9d92-f8c4bf2c4599 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:03.187687 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dce945-1d5f-4cf9-9d92-f8c4bf2c4599 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:03.211305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-b4dce945-1d5f-4cf9-9d92-f8c4bf2c4599 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:28:03.211305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:03.211305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:03.211305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:03.211305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:03.211305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:03.211305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:03.211305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:03.211305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:03.211305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:03.211305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:03.211305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:03.211305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 03:28:03.211305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 03:28:03.211305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 03:28:03.212300 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 03:28:03.212300 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:03.212300 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:03.212300 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:03.212300 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:03.212300 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:03.212300 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:03.212300 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:03.212300 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:03.212300 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:03.212300 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:03.212300 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:03.212300 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:03.212300 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:03.212300 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:03.212300 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:03.212300 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:03.213205 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 03:28:03.213205 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 03:28:03.213205 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 03:28:03.213205 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 03:28:03.213205 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 03:28:03.213205 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 03:28:03.213205 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:28:03.213205 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:03.217278 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:03.225207 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 369/753] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:28:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:03.231015 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dce945-1d5f-4cf9-9d92-f8c4bf2c4599 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:03.329076 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49aa41-0973-4468-a889-599f73305912 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:03.369149 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61fe4d3-9325-4128-b254-ba1a29d23521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:03.369980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fe4d3-9325-4128-b254-ba1a29d23521 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:03.370368 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fe4d3-9325-4128-b254-ba1a29d23521 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:03.370742 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fe4d3-9325-4128-b254-ba1a29d23521 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:03.383799 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61fe4d3-9325-4128-b254-ba1a29d23521 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:28:03.389916 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-e61fe4d3-9325-4128-b254-ba1a29d23521 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:28:03.389916 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:03.389916 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:03.389916 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:03.389916 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:03.389916 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:03.389916 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:03.389916 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:03.389916 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:03.389916 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:03.389916 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:03.389916 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:03.389916 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:28:03.389916 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:28:03.389916 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:28:03.389916 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:28:03.390934 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:28:03.390934 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:28:03.390934 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:28:03.390934 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:28:03.390934 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:03.390934 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:03.390934 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:03.390934 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:03.390934 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:03.390934 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:03.390934 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:03.390934 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:03.390934 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:03.390934 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:03.390934 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:03.390934 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:03.391756 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:03.391756 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:03.391756 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:03.391756 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:03.391756 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:28:03.391756 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:28:03.391756 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:28:03.391756 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:28:03.391756 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:28:03.391756 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:28:03.391756 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:28:03.391756 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:03.392781 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 385/754] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 03:28:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:03.398252 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61fe4d3-9325-4128-b254-ba1a29d23521 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:03.405926 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dce945-1d5f-4cf9-9d92-f8c4bf2c4599 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:03.452422 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc5f92-e50f-4cea-9189-787f4a24d3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:03.453200 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc5f92-e50f-4cea-9189-787f4a24d3e4 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:03.453551 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc5f92-e50f-4cea-9189-787f4a24d3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:03.453975 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc5f92-e50f-4cea-9189-787f4a24d3e4 None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:03.454918 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc5f92-e50f-4cea-9189-787f4a24d3e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:03.455319 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc5f92-e50f-4cea-9189-787f4a24d3e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:03.457563 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc5f92-e50f-4cea-9189-787f4a24d3e4 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:03.461289 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:03.473732 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 370/755] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 03:28:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:03.479254 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc5f92-e50f-4cea-9189-787f4a24d3e4 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:03.535253 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:03.544359 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61fe4d3-9325-4128-b254-ba1a29d23521 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:03.584778 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f49082-87af-4c8d-a55b-1a8ab60ed72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:03.586153 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f49082-87af-4c8d-a55b-1a8ab60ed72f None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:03.586616 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f49082-87af-4c8d-a55b-1a8ab60ed72f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:03.587064 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f49082-87af-4c8d-a55b-1a8ab60ed72f None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:03.587899 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f49082-87af-4c8d-a55b-1a8ab60ed72f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:03.588376 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f49082-87af-4c8d-a55b-1a8ab60ed72f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:03.589977 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f49082-87af-4c8d-a55b-1a8ab60ed72f None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:03.600460 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 386/756] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:28:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:03.605417 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f49082-87af-4c8d-a55b-1a8ab60ed72f None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:03.680378 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc5f92-e50f-4cea-9189-787f4a24d3e4 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:03.724449 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f49082-87af-4c8d-a55b-1a8ab60ed72f None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:03.753649 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad99a54-4b02-4edc-9750-1330959230f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:03.754949 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad99a54-4b02-4edc-9750-1330959230f9 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:03.755437 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad99a54-4b02-4edc-9750-1330959230f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:03.756215 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad99a54-4b02-4edc-9750-1330959230f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:03.757292 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad99a54-4b02-4edc-9750-1330959230f9 None admin] RBAC: Adding query filter params (role.id=4ffac54101e248479bcdc0e54890020f, scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2, user.id=9f784d98d5f440c681f53ae70f6d1cc7) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:03.757828 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad99a54-4b02-4edc-9750-1330959230f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:03.759449 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad99a54-4b02-4edc-9750-1330959230f9 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:03.765812 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 371/757] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:28:03 2022] GET /identity/v3/role_assignments?user.id=9f784d98d5f440c681f53ae70f6d1cc7&scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2&role.id=4ffac54101e248479bcdc0e54890020f => generated 259 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:03.794928 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83bbcd-4740-4bd7-ae6e-23d18fe77e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:03.795984 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83bbcd-4740-4bd7-ae6e-23d18fe77e9a None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:03.796464 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83bbcd-4740-4bd7-ae6e-23d18fe77e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:03.796956 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83bbcd-4740-4bd7-ae6e-23d18fe77e9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:03.809083 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83bbcd-4740-4bd7-ae6e-23d18fe77e9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:03.810802 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83bbcd-4740-4bd7-ae6e-23d18fe77e9a None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:03.838835 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-3d83bbcd-4740-4bd7-ae6e-23d18fe77e9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:03.838835 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:03.838835 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:03.838835 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:03.838835 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:03.838835 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:03.838835 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:03.838835 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:03.838835 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:03.838835 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:03.838835 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:03.838835 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:03.838835 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:28:03.838835 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:28:03.838835 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:28:03.838835 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:28:03.839787 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:03.839787 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:03.839787 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:03.839787 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:03.839787 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:03.839787 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:03.839787 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:03.839787 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:03.839787 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:03.839787 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:03.839787 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:03.839787 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:03.839787 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:03.839787 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:03.839787 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:03.839787 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:03.839787 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:28:03.840668 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:28:03.840668 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:03.840668 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:03.842946 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 387/758] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:28:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:03.848354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad99a54-4b02-4edc-9750-1330959230f9 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:03.915915 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:03.961897 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad99a54-4b02-4edc-9750-1330959230f9 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:04.008909 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054c353-f0e4-4858-a6a1-b37b757c9eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:04.010381 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054c353-f0e4-4858-a6a1-b37b757c9eea None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:04.010883 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054c353-f0e4-4858-a6a1-b37b757c9eea None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:04.011381 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054c353-f0e4-4858-a6a1-b37b757c9eea None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:04.012225 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8054c353-f0e4-4858-a6a1-b37b757c9eea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:04.012730 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8054c353-f0e4-4858-a6a1-b37b757c9eea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:04.014532 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8054c353-f0e4-4858-a6a1-b37b757c9eea None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:04.032113 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 372/759] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:04.038136 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83bbcd-4740-4bd7-ae6e-23d18fe77e9a None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:04.054795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:04.152086 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83bbcd-4740-4bd7-ae6e-23d18fe77e9a None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:04.188561 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099960e-67e3-4124-968f-22c4686f7109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:04.189555 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099960e-67e3-4124-968f-22c4686f7109 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:04.190064 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099960e-67e3-4124-968f-22c4686f7109 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:04.190558 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099960e-67e3-4124-968f-22c4686f7109 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:04.198720 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099960e-67e3-4124-968f-22c4686f7109 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:04.200401 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099960e-67e3-4124-968f-22c4686f7109 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:04.212846 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-c099960e-67e3-4124-968f-22c4686f7109 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 03:28:04.212846 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:04.212846 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:04.212846 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:04.212846 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:04.212846 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:04.212846 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:04.212846 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:04.212846 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:04.212846 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:04.212846 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:04.212846 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:04.212846 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 03:28:04.212846 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 03:28:04.212846 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 03:28:04.212846 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 03:28:04.213867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:04.213867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:04.213867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 03:28:04.213867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:28:04.213867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 03:28:04.213867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:28:04.213867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:04.213867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:04.213867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:04.213867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:04.213867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:04.213867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:04.213867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:04.213867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:04.213867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:04.213867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:04.213867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:04.213867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:04.214786 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:04.214786 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:04.214786 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 03:28:04.214786 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 03:28:04.214786 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 03:28:04.214786 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 03:28:04.214786 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 03:28:04.214786 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 03:28:04.214786 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 03:28:04.214786 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:04.217321 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 388/760] 10.222.0.33 () {56 vars in 1093 bytes} [Fri Sep 16 03:28:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:04.222572 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054c353-f0e4-4858-a6a1-b37b757c9eea None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:04.345569 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054c353-f0e4-4858-a6a1-b37b757c9eea None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:04.367767 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:04.382234 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474bef9-382e-4753-af2e-11355af7c653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:04.383229 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474bef9-382e-4753-af2e-11355af7c653 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:04.383710 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474bef9-382e-4753-af2e-11355af7c653 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:04.384236 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474bef9-382e-4753-af2e-11355af7c653 None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:04.385164 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7474bef9-382e-4753-af2e-11355af7c653 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:04.385695 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7474bef9-382e-4753-af2e-11355af7c653 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:04.387319 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7474bef9-382e-4753-af2e-11355af7c653 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:04.405896 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 373/761] 10.222.0.33 () {56 vars in 1133 bytes} [Fri Sep 16 03:28:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:04.414728 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099960e-67e3-4124-968f-22c4686f7109 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:04.483635 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:04.519805 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099960e-67e3-4124-968f-22c4686f7109 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:04.557089 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20718601-2bb2-466b-9e3d-285e2873b816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:04.557761 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20718601-2bb2-466b-9e3d-285e2873b816 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:04.558096 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20718601-2bb2-466b-9e3d-285e2873b816 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:04.558375 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20718601-2bb2-466b-9e3d-285e2873b816 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:04.570415 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20718601-2bb2-466b-9e3d-285e2873b816 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:04.571950 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20718601-2bb2-466b-9e3d-285e2873b816 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:04.594556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-20718601-2bb2-466b-9e3d-285e2873b816 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:04.594556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:04.594556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:04.594556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:04.594556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:04.594556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:04.594556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:04.594556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:04.594556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:04.594556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:04.594556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:04.594556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:04.594556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:28:04.594556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:28:04.594556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:28:04.594556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:28:04.595555 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:04.595555 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:04.595555 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:04.595555 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:04.595555 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:04.595555 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:04.595555 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:04.595555 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:04.595555 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:04.595555 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:04.595555 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:04.595555 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:04.595555 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:04.595555 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:04.595555 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:04.595555 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:04.595555 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:28:04.596453 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:28:04.596453 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:04.596453 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:04.596453 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 389/762] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:28:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:04.602180 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474bef9-382e-4753-af2e-11355af7c653 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:04.716681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474bef9-382e-4753-af2e-11355af7c653 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:04.730434 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721673b8-38af-4b94-ad1f-ae04bd1c3677 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:04.731025 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721673b8-38af-4b94-ad1f-ae04bd1c3677 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:04.731500 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721673b8-38af-4b94-ad1f-ae04bd1c3677 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:04.733283 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 390/763] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:28:04.738453 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d68aa-e38d-4e7f-b242-489113507314 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:04.738992 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d68aa-e38d-4e7f-b242-489113507314 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:04.739470 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d68aa-e38d-4e7f-b242-489113507314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:04.753528 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6210bfda-5d05-4e18-949a-33889900e4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:04.754187 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210bfda-5d05-4e18-949a-33889900e4aa None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:04.754882 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210bfda-5d05-4e18-949a-33889900e4aa None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:04.755157 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210bfda-5d05-4e18-949a-33889900e4aa None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:04.756336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6210bfda-5d05-4e18-949a-33889900e4aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:04.756646 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6210bfda-5d05-4e18-949a-33889900e4aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:04.758402 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6210bfda-5d05-4e18-949a-33889900e4aa None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:04.761345 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-642d68aa-e38d-4e7f-b242-489113507314 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:04.762794 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-642d68aa-e38d-4e7f-b242-489113507314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:04.771999 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 374/764] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:04.782730 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6210bfda-5d05-4e18-949a-33889900e4aa None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:04.862011 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:04.890434 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 391/765] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 03:28:04.969707 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6210bfda-5d05-4e18-949a-33889900e4aa None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:05.015806 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039bec4d-cdd4-400e-af2f-8ddd10575863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:05.016555 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039bec4d-cdd4-400e-af2f-8ddd10575863 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:05.016738 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039bec4d-cdd4-400e-af2f-8ddd10575863 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:05.017004 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039bec4d-cdd4-400e-af2f-8ddd10575863 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:05.026851 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039bec4d-cdd4-400e-af2f-8ddd10575863 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:05.028314 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039bec4d-cdd4-400e-af2f-8ddd10575863 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:05.039688 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-039bec4d-cdd4-400e-af2f-8ddd10575863 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:28:05.039688 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:05.039688 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:05.039688 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:05.039688 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:05.039688 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:05.039688 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:05.039688 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:05.039688 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:05.039688 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:05.039688 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:05.039688 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:05.039688 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 03:28:05.039688 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 03:28:05.039688 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 03:28:05.040558 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 03:28:05.040558 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:05.040558 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:05.040558 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:05.040558 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:05.040558 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:05.040558 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:05.040558 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:05.040558 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:05.040558 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:05.040558 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:05.040558 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:05.040558 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:05.040558 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:05.040558 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:05.040558 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:05.040558 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:05.041416 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 03:28:05.041416 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 03:28:05.041416 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 03:28:05.041416 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 03:28:05.041416 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 03:28:05.041416 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 03:28:05.041416 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:28:05.041416 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:05.041416 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 375/766] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:28:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:05.047981 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d68aa-e38d-4e7f-b242-489113507314 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:05.213057 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039bec4d-cdd4-400e-af2f-8ddd10575863 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:05.260520 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:05.316325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d68aa-e38d-4e7f-b242-489113507314 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:05.361708 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972470f0-9d23-48c3-bbdc-417e2718963e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:05.362324 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972470f0-9d23-48c3-bbdc-417e2718963e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:05.362598 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972470f0-9d23-48c3-bbdc-417e2718963e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:05.362866 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972470f0-9d23-48c3-bbdc-417e2718963e None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:05.363553 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972470f0-9d23-48c3-bbdc-417e2718963e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:05.363850 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972470f0-9d23-48c3-bbdc-417e2718963e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:05.366439 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972470f0-9d23-48c3-bbdc-417e2718963e None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:05.391641 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 392/767] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 03:28:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:05.400209 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972470f0-9d23-48c3-bbdc-417e2718963e None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:05.457094 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:05.461901 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039bec4d-cdd4-400e-af2f-8ddd10575863 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:05.508328 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964789c-3852-4a58-b26b-0eb78dc39301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:05.509244 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964789c-3852-4a58-b26b-0eb78dc39301 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:05.509962 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964789c-3852-4a58-b26b-0eb78dc39301 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:05.510240 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964789c-3852-4a58-b26b-0eb78dc39301 None admin] PATH_INFO: `/v3/services/network` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:05.511146 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964789c-3852-4a58-b26b-0eb78dc39301 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:05.513149 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964789c-3852-4a58-b26b-0eb78dc39301 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:05.515450 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972470f0-9d23-48c3-bbdc-417e2718963e None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:05.524988 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-f964789c-3852-4a58-b26b-0eb78dc39301 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 03:28:05.524988 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:05.524988 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 03:28:05.524988 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 03:28:05.524988 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 03:28:05.524988 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 03:28:05.524988 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 03:28:05.524988 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:28:05.524988 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 03:28:05.524988 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:05.524988 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 03:28:05.524988 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:05.524988 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:05.524988 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:05.524988 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:05.524988 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:05.524988 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:05.526038 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:05.526038 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:05.526038 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:05.526038 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:05.526038 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:05.526038 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:05.526038 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 03:28:05.526038 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 03:28:05.526038 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 03:28:05.526038 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 03:28:05.526038 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:05.526038 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:05.526038 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:05.526038 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:05.526038 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:05.526038 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:05.526878 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:05.526878 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:05.526878 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:05.526878 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:05.526878 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:05.526878 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:05.526878 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:05.526878 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:05.526878 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:05.526878 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:05.526878 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 03:28:05.526878 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:28:05.526878 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 03:28:05.526878 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:05.528406 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 376/768] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:28:05 2022] GET /identity/v3/services/network => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:05.528564 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:05.531222 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a69c3e-dcdd-4399-b0d0-4532bb62ed0e None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:05.531222 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a69c3e-dcdd-4399-b0d0-4532bb62ed0e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:05.531222 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a69c3e-dcdd-4399-b0d0-4532bb62ed0e None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:05.532587 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 377/769] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:28:05.533308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a69c3e-dcdd-4399-b0d0-4532bb62ed0e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:05.559317 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dbeb3a-e0f7-4e0b-8043-583e91095f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:05.560528 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbeb3a-e0f7-4e0b-8043-583e91095f21 None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:05.561022 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbeb3a-e0f7-4e0b-8043-583e91095f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:05.561427 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbeb3a-e0f7-4e0b-8043-583e91095f21 None admin] PATH_INFO: `/v3/projects/a0e46c2a2c62402dbf6d8461204b47d2/users/c09d1a4ac8b64921a6b05fcd567bb770/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:05.563431 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dbeb3a-e0f7-4e0b-8043-583e91095f21 None admin] RBAC: Authorizing `identity:create_grant(project_id=a0e46c2a2c62402dbf6d8461204b47d2, user_id=c09d1a4ac8b64921a6b05fcd567bb770, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:05.564860 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dbeb3a-e0f7-4e0b-8043-583e91095f21 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:05.645873 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 393/770] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 03:28:05 2022] PUT /identity/v3/projects/a0e46c2a2c62402dbf6d8461204b47d2/users/c09d1a4ac8b64921a6b05fcd567bb770/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:28:05.647476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08597e70-cfe4-4455-a8ad-e172b7b09562 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:05.647766 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08597e70-cfe4-4455-a8ad-e172b7b09562 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:05.648044 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08597e70-cfe4-4455-a8ad-e172b7b09562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:05.651968 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a69c3e-dcdd-4399-b0d0-4532bb62ed0e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:05.686847 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-08597e70-cfe4-4455-a8ad-e172b7b09562 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:05.688075 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-08597e70-cfe4-4455-a8ad-e172b7b09562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:05.711772 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18394b0-5213-4c41-86e0-9e92f8ed2acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:05.712529 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18394b0-5213-4c41-86e0-9e92f8ed2acb None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:05.712833 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18394b0-5213-4c41-86e0-9e92f8ed2acb None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:05.713201 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18394b0-5213-4c41-86e0-9e92f8ed2acb None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:05.713936 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18394b0-5213-4c41-86e0-9e92f8ed2acb None admin] RBAC: Adding query filter params (name=network) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:05.714338 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18394b0-5213-4c41-86e0-9e92f8ed2acb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:05.715971 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18394b0-5213-4c41-86e0-9e92f8ed2acb None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:05.721707 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 378/771] 10.222.0.33 () {56 vars in 1112 bytes} [Fri Sep 16 03:28:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:05.734490 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18394b0-5213-4c41-86e0-9e92f8ed2acb None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:05.777948 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:05.841770 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 394/772] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:28:05.862049 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18394b0-5213-4c41-86e0-9e92f8ed2acb None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:05.902606 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811c95f-d360-4a4d-8a46-fcb9d41615b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:05.903243 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811c95f-d360-4a4d-8a46-fcb9d41615b3 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:05.903524 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811c95f-d360-4a4d-8a46-fcb9d41615b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:05.903800 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811c95f-d360-4a4d-8a46-fcb9d41615b3 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:05.904511 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a811c95f-d360-4a4d-8a46-fcb9d41615b3 None admin] RBAC: Adding query filter params (type=network) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:05.904821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a811c95f-d360-4a4d-8a46-fcb9d41615b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:05.906356 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a811c95f-d360-4a4d-8a46-fcb9d41615b3 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:05.912803 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 379/773] 10.222.0.33 () {56 vars in 1112 bytes} [Fri Sep 16 03:28:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:05.918587 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08597e70-cfe4-4455-a8ad-e172b7b09562 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:06.031836 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d4985-2058-49a3-8a05-b0c0903d277c None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:06.032444 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d4985-2058-49a3-8a05-b0c0903d277c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:06.032444 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d4985-2058-49a3-8a05-b0c0903d277c None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:06.034996 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 380/774] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:28:06.039535 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06e999-e664-4374-9778-a0c7c98431a5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:06.039816 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06e999-e664-4374-9778-a0c7c98431a5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:06.040091 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06e999-e664-4374-9778-a0c7c98431a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:06.042027 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:06.048444 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08597e70-cfe4-4455-a8ad-e172b7b09562 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:06.060082 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3d06e999-e664-4374-9778-a0c7c98431a5 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:06.061582 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3d06e999-e664-4374-9778-a0c7c98431a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:06.107276 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5561273-8cf2-46d6-a500-1c1f98fe7577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:06.107901 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5561273-8cf2-46d6-a500-1c1f98fe7577 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:06.108180 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5561273-8cf2-46d6-a500-1c1f98fe7577 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:06.108450 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5561273-8cf2-46d6-a500-1c1f98fe7577 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:06.109154 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5561273-8cf2-46d6-a500-1c1f98fe7577 None admin] RBAC: Adding query filter params (interface=public, service_id=bb4be2f399fa432593d9c91e30eea41b, region_id=RegionOne) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:06.109458 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5561273-8cf2-46d6-a500-1c1f98fe7577 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:06.110925 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5561273-8cf2-46d6-a500-1c1f98fe7577 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:06.119804 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 395/775] 10.222.0.33 () {56 vars in 1251 bytes} [Fri Sep 16 03:28:05 2022] GET /identity/v3/endpoints?service_id=bb4be2f399fa432593d9c91e30eea41b&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:06.130631 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5561273-8cf2-46d6-a500-1c1f98fe7577 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:06.143072 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 381/776] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 03:28:06.168813 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06e999-e664-4374-9778-a0c7c98431a5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:06.206503 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:06.307049 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06e999-e664-4374-9778-a0c7c98431a5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:06.342708 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4589bf0-877e-49a6-b65c-b90bc308b5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:06.343352 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4589bf0-877e-49a6-b65c-b90bc308b5d3 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:06.343744 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4589bf0-877e-49a6-b65c-b90bc308b5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:06.344029 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4589bf0-877e-49a6-b65c-b90bc308b5d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:06.351772 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5561273-8cf2-46d6-a500-1c1f98fe7577 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:06.354945 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4589bf0-877e-49a6-b65c-b90bc308b5d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:28:06.360044 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-b4589bf0-877e-49a6-b65c-b90bc308b5d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 03:28:06.360044 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:06.360044 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:06.360044 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:06.360044 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:06.360044 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:06.360044 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:06.360044 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:06.360044 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:06.360044 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:06.360044 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:06.360044 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:06.360044 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:28:06.360044 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:28:06.360044 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:28:06.360044 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:28:06.360958 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:28:06.360958 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:28:06.360958 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:28:06.360958 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:28:06.360958 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:06.360958 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:06.360958 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:06.360958 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:06.360958 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:06.360958 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:06.360958 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:06.360958 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:06.360958 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:06.360958 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:06.360958 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:06.360958 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:06.362270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:06.362270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:06.362270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:06.362270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:06.362270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:28:06.362270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:28:06.362270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:28:06.362270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:28:06.362270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:28:06.362270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:28:06.362270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 03:28:06.362270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:06.362270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 382/777] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 03:28:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:28:06.367370 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4589bf0-877e-49a6-b65c-b90bc308b5d3 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:06.458080 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:06.462515 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3fc353-c6f5-40d3-b209-86294085901b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:06.463040 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fc353-c6f5-40d3-b209-86294085901b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:06.463317 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fc353-c6f5-40d3-b209-86294085901b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:06.463588 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fc353-c6f5-40d3-b209-86294085901b None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:06.464195 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3fc353-c6f5-40d3-b209-86294085901b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:06.465563 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3fc353-c6f5-40d3-b209-86294085901b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:06.474270 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 396/778] 10.222.0.33 () {56 vars in 1087 bytes} [Fri Sep 16 03:28:06 2022] GET /identity/v3/services => generated 772 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:06.475338 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4589bf0-877e-49a6-b65c-b90bc308b5d3 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:06.476165 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3fc353-c6f5-40d3-b209-86294085901b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:06.513532 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:06.517304 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926803d0-768a-4155-9ead-41dcd19bf969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:06.517975 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926803d0-768a-4155-9ead-41dcd19bf969 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:06.518258 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926803d0-768a-4155-9ead-41dcd19bf969 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:06.518539 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926803d0-768a-4155-9ead-41dcd19bf969 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:06.519219 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926803d0-768a-4155-9ead-41dcd19bf969 None admin] RBAC: Adding query filter params (name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:06.519553 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926803d0-768a-4155-9ead-41dcd19bf969 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:06.521246 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926803d0-768a-4155-9ead-41dcd19bf969 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:06.531286 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 383/779] 10.222.0.33 () {56 vars in 1103 bytes} [Fri Sep 16 03:28:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:28:06.538060 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926803d0-768a-4155-9ead-41dcd19bf969 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:06.631742 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3fc353-c6f5-40d3-b209-86294085901b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:06.649786 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926803d0-768a-4155-9ead-41dcd19bf969 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:06.679732 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0224d18-24ca-42a6-8270-e3b083565886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:06.680658 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0224d18-24ca-42a6-8270-e3b083565886 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:06.680937 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0224d18-24ca-42a6-8270-e3b083565886 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:06.681207 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0224d18-24ca-42a6-8270-e3b083565886 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:06.681832 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0224d18-24ca-42a6-8270-e3b083565886 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:06.683218 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0224d18-24ca-42a6-8270-e3b083565886 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:06.693189 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-a0224d18-24ca-42a6-8270-e3b083565886 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 03:28:06.693189 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:06.693189 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 03:28:06.693189 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 03:28:06.693189 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 03:28:06.693189 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 03:28:06.693189 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 03:28:06.693189 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:28:06.693189 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 03:28:06.693189 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:06.693189 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 03:28:06.693189 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:06.693189 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:06.693189 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:06.693189 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:06.693189 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:06.693189 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:06.694259 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:06.694259 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:06.694259 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:06.694259 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:06.694259 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:06.694259 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:06.694259 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 03:28:06.694259 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 03:28:06.694259 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 03:28:06.694259 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 03:28:06.694259 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:06.694259 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:06.694259 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:06.694259 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:06.694259 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:06.694259 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:06.695498 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:06.695498 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:06.695498 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:06.695498 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:06.695498 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:06.695498 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:06.695498 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:06.695498 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:06.695498 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:06.695498 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:06.695498 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 03:28:06.695498 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:28:06.695498 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 03:28:06.695498 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:06.695498 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 397/780] 10.222.0.33 () {56 vars in 1129 bytes} [Fri Sep 16 03:28:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:06.696270 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94091cd-5c84-453b-b29c-ccbc935d832f None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:06.696270 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94091cd-5c84-453b-b29c-ccbc935d832f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:06.696665 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94091cd-5c84-453b-b29c-ccbc935d832f None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:06.702396 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 398/781] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:28:06.702696 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a08a7-d26d-4195-bf72-7e352f7a933b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:06.703280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94091cd-5c84-453b-b29c-ccbc935d832f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:06.703855 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a08a7-d26d-4195-bf72-7e352f7a933b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:06.704289 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a08a7-d26d-4195-bf72-7e352f7a933b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:06.704729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a08a7-d26d-4195-bf72-7e352f7a933b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:06.721464 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a08a7-d26d-4195-bf72-7e352f7a933b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:06.723784 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a08a7-d26d-4195-bf72-7e352f7a933b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:06.727181 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:06.746851 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-868a08a7-d26d-4195-bf72-7e352f7a933b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:06.746851 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:06.746851 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:06.746851 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:06.746851 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:06.746851 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:06.746851 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:06.746851 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:06.746851 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:06.746851 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:06.746851 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:06.746851 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:06.746851 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:28:06.746851 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:28:06.746851 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:28:06.746851 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:28:06.755537 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:06.755537 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:06.755537 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:06.755537 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:06.755537 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:06.755537 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:06.755537 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:06.755537 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:06.755537 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:06.755537 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:06.755537 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:06.755537 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:06.755537 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:06.755537 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:06.755537 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:06.755537 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:06.755537 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:28:06.756671 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:28:06.756671 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:06.756671 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:06.756671 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 384/782] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:28:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:28:06.756671 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd191b6-d9dc-4d92-ad0c-aa958fe0607f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:06.756671 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd191b6-d9dc-4d92-ad0c-aa958fe0607f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:06.756671 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd191b6-d9dc-4d92-ad0c-aa958fe0607f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:06.777253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-dbd191b6-d9dc-4d92-ad0c-aa958fe0607f None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:06.778800 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-dbd191b6-d9dc-4d92-ad0c-aa958fe0607f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:06.821965 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:06.837380 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94091cd-5c84-453b-b29c-ccbc935d832f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:06.856489 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 385/783] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:28:06.857546 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd191b6-d9dc-4d92-ad0c-aa958fe0607f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:06.886296 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17155e2-4455-4c41-8685-cf7cdedd8a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:06.886831 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17155e2-4455-4c41-8685-cf7cdedd8a53 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:06.887115 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17155e2-4455-4c41-8685-cf7cdedd8a53 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:06.887391 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17155e2-4455-4c41-8685-cf7cdedd8a53 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:06.888024 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17155e2-4455-4c41-8685-cf7cdedd8a53 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:06.888407 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17155e2-4455-4c41-8685-cf7cdedd8a53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:06.889815 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17155e2-4455-4c41-8685-cf7cdedd8a53 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:06.900686 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 399/784] 10.222.0.33 () {56 vars in 1124 bytes} [Fri Sep 16 03:28:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:06.907233 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17155e2-4455-4c41-8685-cf7cdedd8a53 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:07.038716 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd191b6-d9dc-4d92-ad0c-aa958fe0607f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:07.065235 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:07.078760 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a2814-49dd-4173-9082-f889fa974dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:07.080123 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a2814-49dd-4173-9082-f889fa974dbf None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:07.080551 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a2814-49dd-4173-9082-f889fa974dbf None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:07.081000 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a2814-49dd-4173-9082-f889fa974dbf None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:07.081813 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a2814-49dd-4173-9082-f889fa974dbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:07.082275 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a2814-49dd-4173-9082-f889fa974dbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:07.085012 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a2814-49dd-4173-9082-f889fa974dbf None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:07.097907 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 386/785] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:07.104082 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a2814-49dd-4173-9082-f889fa974dbf None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:07.131566 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17155e2-4455-4c41-8685-cf7cdedd8a53 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:07.171497 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a3237-22d9-4d21-bc82-6623693cf37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:07.172033 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a3237-22d9-4d21-bc82-6623693cf37d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:07.172315 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a3237-22d9-4d21-bc82-6623693cf37d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:07.172587 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a3237-22d9-4d21-bc82-6623693cf37d None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:07.173213 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a3237-22d9-4d21-bc82-6623693cf37d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:07.173569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a3237-22d9-4d21-bc82-6623693cf37d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:07.174963 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a3237-22d9-4d21-bc82-6623693cf37d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:07.187507 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 400/786] 10.222.0.33 () {56 vars in 1124 bytes} [Fri Sep 16 03:28:06 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:07.188849 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a3237-22d9-4d21-bc82-6623693cf37d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:07.213309 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:07.240857 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a2814-49dd-4173-9082-f889fa974dbf None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:07.278083 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3789d-e99b-4111-904d-5fa9cf6ebb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:07.279534 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3789d-e99b-4111-904d-5fa9cf6ebb67 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:07.280027 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3789d-e99b-4111-904d-5fa9cf6ebb67 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:07.280435 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3789d-e99b-4111-904d-5fa9cf6ebb67 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:07.289063 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3789d-e99b-4111-904d-5fa9cf6ebb67 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:07.290924 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3789d-e99b-4111-904d-5fa9cf6ebb67 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:07.299629 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a3237-22d9-4d21-bc82-6623693cf37d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:07.305198 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-cef3789d-e99b-4111-904d-5fa9cf6ebb67 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 03:28:07.305198 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:07.305198 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:07.305198 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:07.305198 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:07.305198 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:07.305198 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:07.305198 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:07.305198 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:07.305198 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:07.305198 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:07.305198 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:07.305198 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 03:28:07.305198 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 03:28:07.305198 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 03:28:07.305198 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 03:28:07.306336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:07.306336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:07.306336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 03:28:07.306336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:28:07.306336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 03:28:07.306336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:28:07.306336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:07.306336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:07.306336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:07.306336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:07.306336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:07.306336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:07.306336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:07.306336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:07.306336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:07.306336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:07.306336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:07.306336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:07.307491 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:07.307491 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:07.307491 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 03:28:07.307491 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 03:28:07.307491 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 03:28:07.307491 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 03:28:07.307491 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 03:28:07.307491 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 03:28:07.307491 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 03:28:07.307491 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:07.309815 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 387/787] 10.222.0.33 () {56 vars in 1117 bytes} [Fri Sep 16 03:28:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:07.310792 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3789d-e99b-4111-904d-5fa9cf6ebb67 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:07.336403 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad7d991-01d4-4fd6-a7fd-3edc943dbb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:07.337018 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7d991-01d4-4fd6-a7fd-3edc943dbb40 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:07.337302 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7d991-01d4-4fd6-a7fd-3edc943dbb40 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:07.337747 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7d991-01d4-4fd6-a7fd-3edc943dbb40 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:07.338484 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7d991-01d4-4fd6-a7fd-3edc943dbb40 None admin] RBAC: Adding query filter params (interface=public, service_id=61d221ef840f41f8bdd24aed9a53f479, region_id=RegionOne) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:07.339107 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7d991-01d4-4fd6-a7fd-3edc943dbb40 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:07.340763 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7d991-01d4-4fd6-a7fd-3edc943dbb40 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:07.349700 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 401/788] 10.222.0.33 () {56 vars in 1251 bytes} [Fri Sep 16 03:28:07 2022] GET /identity/v3/endpoints?service_id=61d221ef840f41f8bdd24aed9a53f479&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:07.350741 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad7d991-01d4-4fd6-a7fd-3edc943dbb40 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:07.366035 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:07.423168 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3789d-e99b-4111-904d-5fa9cf6ebb67 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:07.459019 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:07.460728 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825bdc8-5c8d-43e1-9af3-6bae5cc2d371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:07.461529 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825bdc8-5c8d-43e1-9af3-6bae5cc2d371 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:07.462001 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825bdc8-5c8d-43e1-9af3-6bae5cc2d371 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:07.462416 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825bdc8-5c8d-43e1-9af3-6bae5cc2d371 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:07.473022 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a825bdc8-5c8d-43e1-9af3-6bae5cc2d371 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:28:07.476343 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad7d991-01d4-4fd6-a7fd-3edc943dbb40 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:07.479599 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-a825bdc8-5c8d-43e1-9af3-6bae5cc2d371 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:28:07.479599 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:07.479599 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:07.479599 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:07.479599 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:07.479599 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:07.479599 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:07.479599 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:07.479599 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:07.479599 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:07.479599 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:07.479599 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:07.479599 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:28:07.479599 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:28:07.479599 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:28:07.479599 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:28:07.480693 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:28:07.480693 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:28:07.480693 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:28:07.480693 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:28:07.480693 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:07.480693 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:07.480693 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:07.480693 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:07.480693 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:07.480693 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:07.480693 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:07.480693 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:07.480693 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:07.480693 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:07.480693 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:07.480693 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:07.481604 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:07.481604 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:07.481604 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:07.481604 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:07.481604 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:28:07.481604 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:28:07.481604 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:28:07.481604 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:28:07.481604 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:28:07.481604 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:28:07.481604 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:28:07.481604 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:07.488438 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 388/789] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 03:28:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:07.489477 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825bdc8-5c8d-43e1-9af3-6bae5cc2d371 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:07.516434 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34d2cf-45a1-484b-b794-f4956a476c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:07.517070 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34d2cf-45a1-484b-b794-f4956a476c10 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:07.517475 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34d2cf-45a1-484b-b794-f4956a476c10 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:07.517786 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34d2cf-45a1-484b-b794-f4956a476c10 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:07.518841 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34d2cf-45a1-484b-b794-f4956a476c10 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:07.519152 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34d2cf-45a1-484b-b794-f4956a476c10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:07.521095 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34d2cf-45a1-484b-b794-f4956a476c10 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:07.550765 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 402/790] 10.222.0.33 () {56 vars in 1149 bytes} [Fri Sep 16 03:28:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:07.552093 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34d2cf-45a1-484b-b794-f4956a476c10 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:07.621501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825bdc8-5c8d-43e1-9af3-6bae5cc2d371 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:07.624674 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:07.661579 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34d2cf-45a1-484b-b794-f4956a476c10 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:07.673955 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04b70e-c6fb-40a8-a469-81f9d8779c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:07.674973 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04b70e-c6fb-40a8-a469-81f9d8779c41 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:07.675290 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04b70e-c6fb-40a8-a469-81f9d8779c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:07.675669 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04b70e-c6fb-40a8-a469-81f9d8779c41 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:07.676285 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04b70e-c6fb-40a8-a469-81f9d8779c41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:07.678027 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04b70e-c6fb-40a8-a469-81f9d8779c41 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:07.694155 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 389/791] 10.222.0.33 () {56 vars in 1087 bytes} [Fri Sep 16 03:28:07 2022] GET /identity/v3/services => generated 772 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:07.695222 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04b70e-c6fb-40a8-a469-81f9d8779c41 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:07.723560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41e4c6-78f4-4f80-84df-07527694cebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:07.725117 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41e4c6-78f4-4f80-84df-07527694cebc None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:07.725593 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41e4c6-78f4-4f80-84df-07527694cebc None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:07.726074 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41e4c6-78f4-4f80-84df-07527694cebc None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:07.726979 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa41e4c6-78f4-4f80-84df-07527694cebc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:07.727473 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa41e4c6-78f4-4f80-84df-07527694cebc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:07.729205 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa41e4c6-78f4-4f80-84df-07527694cebc None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:07.745308 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 403/792] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:28:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:07.751185 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41e4c6-78f4-4f80-84df-07527694cebc None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:07.761532 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:07.814940 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04b70e-c6fb-40a8-a469-81f9d8779c41 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:07.902386 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad4b23-71b9-40ab-8988-f665383ae023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:07.903500 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad4b23-71b9-40ab-8988-f665383ae023 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:07.903996 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad4b23-71b9-40ab-8988-f665383ae023 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:07.904489 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad4b23-71b9-40ab-8988-f665383ae023 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:07.928449 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad4b23-71b9-40ab-8988-f665383ae023 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:07.929944 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad4b23-71b9-40ab-8988-f665383ae023 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:07.950911 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41e4c6-78f4-4f80-84df-07527694cebc None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:07.954499 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-f5ad4b23-71b9-40ab-8988-f665383ae023 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:07.954499 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:07.954499 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:07.954499 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:07.954499 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:07.954499 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:07.954499 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:07.954499 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:07.954499 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:07.954499 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:07.954499 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:07.954499 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:07.954499 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:28:07.954499 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:28:07.954499 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:28:07.954499 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:28:07.955415 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:07.955415 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:07.955415 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:07.955415 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:07.955415 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:07.955415 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:07.955415 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:07.955415 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:07.955415 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:07.955415 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:07.955415 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:07.955415 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:07.955415 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:07.955415 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:07.955415 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:07.955415 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:07.955415 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:28:07.956303 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:28:07.956303 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:07.956303 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:07.957793 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 390/793] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:28:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:07.962673 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad4b23-71b9-40ab-8988-f665383ae023 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:07.984517 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:08.003541 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74389321-82b7-42d3-bfa6-0b8a4605a5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:08.004572 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74389321-82b7-42d3-bfa6-0b8a4605a5e3 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:08.005049 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74389321-82b7-42d3-bfa6-0b8a4605a5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:08.005531 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74389321-82b7-42d3-bfa6-0b8a4605a5e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:08.017547 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74389321-82b7-42d3-bfa6-0b8a4605a5e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:08.019346 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74389321-82b7-42d3-bfa6-0b8a4605a5e3 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:08.036266 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-74389321-82b7-42d3-bfa6-0b8a4605a5e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:08.036266 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:08.036266 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:08.036266 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:08.036266 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:08.036266 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:08.036266 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:08.036266 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:08.036266 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:08.036266 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:08.036266 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:08.036266 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:08.036266 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:28:08.036266 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:28:08.036266 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:28:08.036266 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:28:08.037354 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:08.037354 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:08.037354 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:08.037354 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:08.037354 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:08.037354 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:08.037354 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:08.037354 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:08.037354 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:08.037354 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:08.037354 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:08.037354 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:08.037354 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:08.037354 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:08.037354 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:08.037354 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:08.037354 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:28:08.038279 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:28:08.038279 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:08.038279 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:08.040404 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 404/794] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:28:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:28:08.047611 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74389321-82b7-42d3-bfa6-0b8a4605a5e3 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:08.070597 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad4b23-71b9-40ab-8988-f665383ae023 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:08.107061 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93341d14-ff95-4b91-a1f7-324d3fc63ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:08.107678 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93341d14-ff95-4b91-a1f7-324d3fc63ebd None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:08.107960 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93341d14-ff95-4b91-a1f7-324d3fc63ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:08.108233 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93341d14-ff95-4b91-a1f7-324d3fc63ebd None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:08.109163 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93341d14-ff95-4b91-a1f7-324d3fc63ebd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:08.109469 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93341d14-ff95-4b91-a1f7-324d3fc63ebd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:08.111101 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93341d14-ff95-4b91-a1f7-324d3fc63ebd None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:08.111662 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:08.126578 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 391/795] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:28:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:28:08.133172 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93341d14-ff95-4b91-a1f7-324d3fc63ebd None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:08.164005 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74389321-82b7-42d3-bfa6-0b8a4605a5e3 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:08.202175 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e00da-09dd-4c80-8b28-37a908fcc5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:08.202900 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e00da-09dd-4c80-8b28-37a908fcc5c7 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:08.203245 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e00da-09dd-4c80-8b28-37a908fcc5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:08.203582 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e00da-09dd-4c80-8b28-37a908fcc5c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:08.204327 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e00da-09dd-4c80-8b28-37a908fcc5c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:08.204726 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e00da-09dd-4c80-8b28-37a908fcc5c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:08.206221 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e00da-09dd-4c80-8b28-37a908fcc5c7 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:08.219390 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 405/796] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:08.225484 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e00da-09dd-4c80-8b28-37a908fcc5c7 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:08.230112 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:08.251235 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93341d14-ff95-4b91-a1f7-324d3fc63ebd None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:08.288351 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972141e-3d0f-4cb6-b9c5-b3085e5ce9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:08.289360 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972141e-3d0f-4cb6-b9c5-b3085e5ce9e2 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:08.289844 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972141e-3d0f-4cb6-b9c5-b3085e5ce9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:08.290300 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972141e-3d0f-4cb6-b9c5-b3085e5ce9e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:08.297344 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972141e-3d0f-4cb6-b9c5-b3085e5ce9e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:08.299095 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972141e-3d0f-4cb6-b9c5-b3085e5ce9e2 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:08.310935 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-b972141e-3d0f-4cb6-b9c5-b3085e5ce9e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:28:08.310935 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:08.310935 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:08.310935 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:08.310935 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:08.310935 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:08.310935 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:08.310935 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:08.310935 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:08.310935 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:08.310935 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:08.310935 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:08.310935 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 03:28:08.310935 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 03:28:08.310935 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 03:28:08.311831 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 03:28:08.311831 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:08.311831 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:08.311831 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:08.311831 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:08.311831 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:08.311831 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:08.311831 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:08.311831 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:08.311831 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:08.311831 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:08.311831 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:08.311831 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:08.311831 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:08.311831 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:08.311831 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:08.311831 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:08.312714 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 03:28:08.312714 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 03:28:08.312714 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 03:28:08.312714 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 03:28:08.312714 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 03:28:08.312714 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 03:28:08.312714 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:28:08.312714 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:08.315118 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 392/797] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:28:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:08.321411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972141e-3d0f-4cb6-b9c5-b3085e5ce9e2 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:08.370005 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e00da-09dd-4c80-8b28-37a908fcc5c7 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:08.392230 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:08.419971 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c6546-0104-41e8-aeb4-b7bf09ef7175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:08.420991 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c6546-0104-41e8-aeb4-b7bf09ef7175 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:08.421549 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c6546-0104-41e8-aeb4-b7bf09ef7175 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:08.421996 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c6546-0104-41e8-aeb4-b7bf09ef7175 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:08.433092 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c6546-0104-41e8-aeb4-b7bf09ef7175 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:08.434965 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c6546-0104-41e8-aeb4-b7bf09ef7175 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:08.452558 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-851c6546-0104-41e8-aeb4-b7bf09ef7175 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 16 03:28:08.452558 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:08.452558 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:08.452558 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:08.452558 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:08.452558 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:08.452558 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:08.452558 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:08.452558 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:08.452558 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:08.452558 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:08.452558 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:08.452558 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 03:28:08.452558 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 03:28:08.452558 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 03:28:08.452558 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 03:28:08.453832 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:08.453832 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:08.453832 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 03:28:08.453832 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:28:08.453832 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 03:28:08.453832 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:28:08.453832 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:08.453832 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:08.453832 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:08.453832 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:08.453832 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:08.453832 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:08.453832 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:08.453832 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:08.453832 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:08.453832 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:08.453832 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:08.453832 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:08.454985 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:08.454985 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:08.454985 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 03:28:08.454985 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 03:28:08.454985 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 03:28:08.454985 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 03:28:08.454985 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 03:28:08.454985 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 03:28:08.454985 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 16 03:28:08.454985 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:08.457691 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 406/798] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 03:28:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:28:08.459602 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db6519-33e2-40fc-955c-f09c21add0d1 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:08.460035 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db6519-33e2-40fc-955c-f09c21add0d1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:08.460605 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db6519-33e2-40fc-955c-f09c21add0d1 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:08.462789 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 407/799] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:28:08.463651 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db6519-33e2-40fc-955c-f09c21add0d1 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:08.514003 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972141e-3d0f-4cb6-b9c5-b3085e5ce9e2 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:08.581712 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388e04f-3b3c-43b0-aa50-9cc1dda3ce1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:08.583005 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388e04f-3b3c-43b0-aa50-9cc1dda3ce1c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:08.586189 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388e04f-3b3c-43b0-aa50-9cc1dda3ce1c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:08.586627 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388e04f-3b3c-43b0-aa50-9cc1dda3ce1c None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:08.587496 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388e04f-3b3c-43b0-aa50-9cc1dda3ce1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:08.587963 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388e04f-3b3c-43b0-aa50-9cc1dda3ce1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:08.591693 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388e04f-3b3c-43b0-aa50-9cc1dda3ce1c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:08.610817 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:08.617476 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 393/800] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 03:28:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:08.619890 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce600a-da04-4226-91db-b4b033d6ec66 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:08.620404 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce600a-da04-4226-91db-b4b033d6ec66 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:08.620907 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce600a-da04-4226-91db-b4b033d6ec66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:08.647744 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db6519-33e2-40fc-955c-f09c21add0d1 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:08.658740 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f5ce600a-da04-4226-91db-b4b033d6ec66 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:08.660700 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f5ce600a-da04-4226-91db-b4b033d6ec66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:08.696023 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675eedf4-45b3-466f-ac8f-16329f471935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:08.697329 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675eedf4-45b3-466f-ac8f-16329f471935 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:08.703356 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675eedf4-45b3-466f-ac8f-16329f471935 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:08.703946 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675eedf4-45b3-466f-ac8f-16329f471935 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:08.704895 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675eedf4-45b3-466f-ac8f-16329f471935 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:08.705414 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675eedf4-45b3-466f-ac8f-16329f471935 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:08.708019 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675eedf4-45b3-466f-ac8f-16329f471935 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:08.748531 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 408/801] 10.222.0.33 () {56 vars in 1135 bytes} [Fri Sep 16 03:28:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:08.749172 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675eedf4-45b3-466f-ac8f-16329f471935 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:08.782347 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 394/802] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:28:08.783850 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce600a-da04-4226-91db-b4b033d6ec66 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:08.847564 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:08.888548 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce600a-da04-4226-91db-b4b033d6ec66 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:08.919850 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:08.927396 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba479fef-4b4b-4a30-aa96-8c6c1158e743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:08.928856 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba479fef-4b4b-4a30-aa96-8c6c1158e743 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:08.929367 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba479fef-4b4b-4a30-aa96-8c6c1158e743 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:08.929863 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba479fef-4b4b-4a30-aa96-8c6c1158e743 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:08.940536 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba479fef-4b4b-4a30-aa96-8c6c1158e743 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:08.942354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba479fef-4b4b-4a30-aa96-8c6c1158e743 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:08.958179 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-ba479fef-4b4b-4a30-aa96-8c6c1158e743 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:08.958179 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:08.958179 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:08.958179 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:08.958179 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:08.958179 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:08.958179 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:08.958179 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:08.958179 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:08.958179 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:08.958179 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:08.958179 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:08.958179 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:28:08.958179 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:28:08.958179 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:28:08.958179 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:28:08.959667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:08.959667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:08.959667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:08.959667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:08.959667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:08.959667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:08.959667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:08.959667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:08.959667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:08.959667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:08.959667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:08.959667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:08.959667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:08.959667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:08.959667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:08.959667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:08.959667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:28:08.960554 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:28:08.960554 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:08.960554 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:08.962748 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 395/803] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:28:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:08.974508 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba479fef-4b4b-4a30-aa96-8c6c1158e743 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:09.025547 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675eedf4-45b3-466f-ac8f-16329f471935 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:09.069071 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7078a5fd-9a03-4e73-85a0-f3af58d2d992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:09.069783 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078a5fd-9a03-4e73-85a0-f3af58d2d992 None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:09.070072 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078a5fd-9a03-4e73-85a0-f3af58d2d992 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:09.070348 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078a5fd-9a03-4e73-85a0-f3af58d2d992 None admin] PATH_INFO: `/v3/projects/a0e46c2a2c62402dbf6d8461204b47d2/users/b0812002d7b14bcb81a42eb380231feb/roles/8a338e321ece4061b4b30d6231167b4e` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:09.085259 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba479fef-4b4b-4a30-aa96-8c6c1158e743 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:09.085892 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7078a5fd-9a03-4e73-85a0-f3af58d2d992 None admin] RBAC: Authorizing `identity:create_grant(project_id=a0e46c2a2c62402dbf6d8461204b47d2, user_id=b0812002d7b14bcb81a42eb380231feb, role_id=8a338e321ece4061b4b30d6231167b4e)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:09.087337 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7078a5fd-9a03-4e73-85a0-f3af58d2d992 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:09.120957 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92112f6d-c7c9-43e7-b956-22292654f187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:09.121672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92112f6d-c7c9-43e7-b956-22292654f187 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:09.122047 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92112f6d-c7c9-43e7-b956-22292654f187 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:09.122396 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92112f6d-c7c9-43e7-b956-22292654f187 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:09.123106 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92112f6d-c7c9-43e7-b956-22292654f187 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:09.123474 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92112f6d-c7c9-43e7-b956-22292654f187 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:09.124926 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92112f6d-c7c9-43e7-b956-22292654f187 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:09.137543 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 396/804] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:09.138763 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e42a74-a6b6-4faa-ad9f-503f8db60eea None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:09.139055 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e42a74-a6b6-4faa-ad9f-503f8db60eea None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:09.139330 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e42a74-a6b6-4faa-ad9f-503f8db60eea None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:09.140628 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 397/805] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:28:09.146008 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e42a74-a6b6-4faa-ad9f-503f8db60eea None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:09.161187 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 409/806] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 03:28:08 2022] PUT /identity/v3/projects/a0e46c2a2c62402dbf6d8461204b47d2/users/b0812002d7b14bcb81a42eb380231feb/roles/8a338e321ece4061b4b30d6231167b4e => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:28:09.162873 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1213ed-cc8e-43e3-ab0a-5458fcda7064 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:09.163502 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1213ed-cc8e-43e3-ab0a-5458fcda7064 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:09.163502 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1213ed-cc8e-43e3-ab0a-5458fcda7064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:09.183757 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-cd1213ed-cc8e-43e3-ab0a-5458fcda7064 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:09.185239 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cd1213ed-cc8e-43e3-ab0a-5458fcda7064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:09.199697 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:09.271775 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 410/807] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:28:09.272552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1213ed-cc8e-43e3-ab0a-5458fcda7064 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:09.287729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e42a74-a6b6-4faa-ad9f-503f8db60eea None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:09.305216 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:09.364596 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4097de1-d6b2-4331-a769-d131828e0eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:09.365361 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4097de1-d6b2-4331-a769-d131828e0eb6 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:09.365667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4097de1-d6b2-4331-a769-d131828e0eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:09.365976 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4097de1-d6b2-4331-a769-d131828e0eb6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:09.376024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4097de1-d6b2-4331-a769-d131828e0eb6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:09.377502 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4097de1-d6b2-4331-a769-d131828e0eb6 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:09.399417 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-f4097de1-d6b2-4331-a769-d131828e0eb6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:28:09.399417 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:09.399417 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:09.399417 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:09.399417 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:09.399417 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:09.399417 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:09.399417 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:09.399417 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:09.399417 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:09.399417 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:09.399417 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:09.399417 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 03:28:09.399417 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 03:28:09.399417 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 03:28:09.400369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 03:28:09.400369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:09.400369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:09.400369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:09.400369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:09.400369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:09.400369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:09.400369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:09.400369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:09.400369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:09.400369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:09.400369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:09.400369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:09.400369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:09.400369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:09.400369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:09.400369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:09.401268 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 03:28:09.401268 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 03:28:09.401268 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 03:28:09.401268 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 03:28:09.401268 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 03:28:09.401268 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 03:28:09.401268 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:28:09.401268 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:09.401268 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 398/808] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:28:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:09.413493 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4097de1-d6b2-4331-a769-d131828e0eb6 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:09.443732 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1213ed-cc8e-43e3-ab0a-5458fcda7064 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:09.482386 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db145a-5249-4cce-aa98-035f94b57a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:09.483046 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db145a-5249-4cce-aa98-035f94b57a8e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:09.483380 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db145a-5249-4cce-aa98-035f94b57a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:09.483659 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db145a-5249-4cce-aa98-035f94b57a8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:09.497029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db145a-5249-4cce-aa98-035f94b57a8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:28:09.502221 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-f0db145a-5249-4cce-aa98-035f94b57a8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:28:09.502221 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:09.502221 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:09.502221 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:09.502221 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:09.502221 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:09.502221 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:09.502221 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:09.502221 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:09.502221 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:09.502221 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:09.502221 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:09.502221 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:28:09.502221 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:28:09.502221 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:28:09.502221 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:28:09.503196 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:28:09.503196 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:28:09.503196 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:28:09.503196 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:28:09.503196 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:09.503196 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:09.503196 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:09.503196 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:09.503196 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:09.503196 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:09.503196 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:09.503196 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:09.503196 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:09.503196 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:09.503196 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:09.503196 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:09.504545 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:09.504545 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:09.504545 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:09.504545 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:09.504545 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:28:09.504545 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:28:09.504545 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:28:09.504545 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:28:09.504545 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:28:09.504545 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:28:09.504545 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:28:09.504545 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:09.504545 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 411/809] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 03:28:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:09.509928 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db145a-5249-4cce-aa98-035f94b57a8e None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:09.597468 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:09.624675 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db145a-5249-4cce-aa98-035f94b57a8e None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:09.656338 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4097de1-d6b2-4331-a769-d131828e0eb6 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:09.657841 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:09.666112 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5855ee3-d2ee-40f6-a5a4-dc2be5fc499f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:09.667238 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5855ee3-d2ee-40f6-a5a4-dc2be5fc499f None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:09.667522 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5855ee3-d2ee-40f6-a5a4-dc2be5fc499f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:09.667796 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5855ee3-d2ee-40f6-a5a4-dc2be5fc499f None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:09.668867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5855ee3-d2ee-40f6-a5a4-dc2be5fc499f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:09.668867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5855ee3-d2ee-40f6-a5a4-dc2be5fc499f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:09.670696 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5855ee3-d2ee-40f6-a5a4-dc2be5fc499f None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:09.685662 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 412/810] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:28:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:28:09.685662 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5855ee3-d2ee-40f6-a5a4-dc2be5fc499f None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:09.710168 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368261d2-5df2-4e5b-9296-78bfed929af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:09.711119 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368261d2-5df2-4e5b-9296-78bfed929af7 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:09.711402 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368261d2-5df2-4e5b-9296-78bfed929af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:09.711678 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368261d2-5df2-4e5b-9296-78bfed929af7 None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:09.712887 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368261d2-5df2-4e5b-9296-78bfed929af7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:09.713199 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368261d2-5df2-4e5b-9296-78bfed929af7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:09.714976 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368261d2-5df2-4e5b-9296-78bfed929af7 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:09.736141 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 399/811] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 03:28:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:28:09.736141 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368261d2-5df2-4e5b-9296-78bfed929af7 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:09.819084 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5855ee3-d2ee-40f6-a5a4-dc2be5fc499f None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:09.859596 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b1284-2aa4-4710-b6f1-9400cf739e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:09.861204 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b1284-2aa4-4710-b6f1-9400cf739e3c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:09.861975 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b1284-2aa4-4710-b6f1-9400cf739e3c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:09.862447 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b1284-2aa4-4710-b6f1-9400cf739e3c None admin] PATH_INFO: `/v3/services/network` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:09.863259 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b1284-2aa4-4710-b6f1-9400cf739e3c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:09.863699 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368261d2-5df2-4e5b-9296-78bfed929af7 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:09.865291 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b1284-2aa4-4710-b6f1-9400cf739e3c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:09.870190 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:09.881592 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-720b1284-2aa4-4710-b6f1-9400cf739e3c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 03:28:09.881592 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:09.881592 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 03:28:09.881592 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 03:28:09.881592 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 03:28:09.881592 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 03:28:09.881592 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 03:28:09.881592 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:28:09.881592 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 03:28:09.881592 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:09.881592 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 03:28:09.881592 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:09.881592 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:09.881592 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:09.881592 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:09.881592 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:09.881592 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:09.882585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:09.882585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:09.882585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:09.882585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:09.882585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:09.882585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:09.882585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 03:28:09.882585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 03:28:09.882585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 03:28:09.882585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 03:28:09.882585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:09.882585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:09.882585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:09.882585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:09.882585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:09.882585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:09.883432 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:09.883432 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:09.883432 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:09.883432 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:09.883432 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:09.883432 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:09.883432 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:09.883432 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:09.883432 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:09.883432 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:09.883432 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 03:28:09.883432 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:28:09.883432 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 03:28:09.883432 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:09.886251 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 413/812] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:28:09 2022] GET /identity/v3/services/network => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:09.887304 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b1284-2aa4-4710-b6f1-9400cf739e3c None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:09.902283 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7d697-aea8-4a7c-9560-a514c5d8dddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:09.902925 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7d697-aea8-4a7c-9560-a514c5d8dddb None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:09.903207 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7d697-aea8-4a7c-9560-a514c5d8dddb None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:09.903486 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7d697-aea8-4a7c-9560-a514c5d8dddb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:09.918064 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b7d697-aea8-4a7c-9560-a514c5d8dddb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:09.920130 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b7d697-aea8-4a7c-9560-a514c5d8dddb None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:09.937983 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-25b7d697-aea8-4a7c-9560-a514c5d8dddb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:09.937983 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:09.937983 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:09.937983 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:09.937983 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:09.937983 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:09.937983 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:09.937983 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:09.937983 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:09.937983 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:09.937983 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:09.937983 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:09.937983 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:28:09.937983 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:28:09.937983 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:28:09.937983 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:28:09.938954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:09.938954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:09.938954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:09.938954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:09.938954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:09.938954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:09.938954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:09.938954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:09.938954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:09.938954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:09.938954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:09.938954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:09.938954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:09.938954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:09.938954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:09.938954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:09.938954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:28:09.939850 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:28:09.939850 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:09.939850 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:09.941702 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 400/813] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:28:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:09.942729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7d697-aea8-4a7c-9560-a514c5d8dddb None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:09.967477 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:10.016973 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b1284-2aa4-4710-b6f1-9400cf739e3c None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:10.059334 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f122a3-285c-4b23-a59b-1539c1f3e9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:10.060850 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f122a3-285c-4b23-a59b-1539c1f3e9da None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:10.061329 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f122a3-285c-4b23-a59b-1539c1f3e9da None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:10.061952 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f122a3-285c-4b23-a59b-1539c1f3e9da None admin] PATH_INFO: `/v3/projects/a0e46c2a2c62402dbf6d8461204b47d2/users/9f784d98d5f440c681f53ae70f6d1cc7/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:10.064983 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f122a3-285c-4b23-a59b-1539c1f3e9da None admin] RBAC: Authorizing `identity:create_grant(project_id=a0e46c2a2c62402dbf6d8461204b47d2, user_id=9f784d98d5f440c681f53ae70f6d1cc7, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:10.066836 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f122a3-285c-4b23-a59b-1539c1f3e9da None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:10.076387 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7d697-aea8-4a7c-9560-a514c5d8dddb None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:10.111487 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57f770-9dac-4e3d-b33e-ff457b31895c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:10.112106 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57f770-9dac-4e3d-b33e-ff457b31895c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:10.112327 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57f770-9dac-4e3d-b33e-ff457b31895c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:10.112566 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57f770-9dac-4e3d-b33e-ff457b31895c None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:10.113195 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c57f770-9dac-4e3d-b33e-ff457b31895c None admin] RBAC: Adding query filter params (name=network) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:10.113500 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c57f770-9dac-4e3d-b33e-ff457b31895c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:10.114960 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c57f770-9dac-4e3d-b33e-ff457b31895c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:10.120462 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 401/814] 10.222.0.33 () {56 vars in 1112 bytes} [Fri Sep 16 03:28:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:10.121074 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57f770-9dac-4e3d-b33e-ff457b31895c None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:10.141475 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 414/815] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 03:28:09 2022] PUT /identity/v3/projects/a0e46c2a2c62402dbf6d8461204b47d2/users/9f784d98d5f440c681f53ae70f6d1cc7/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:28:10.146827 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f122a3-285c-4b23-a59b-1539c1f3e9da None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:10.267079 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:10.273147 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:10.327892 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57f770-9dac-4e3d-b33e-ff457b31895c None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:10.339398 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f122a3-285c-4b23-a59b-1539c1f3e9da None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:10.397562 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bcdbf-0ccc-4c7c-8948-816436338862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:10.398235 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bcdbf-0ccc-4c7c-8948-816436338862 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:10.398510 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bcdbf-0ccc-4c7c-8948-816436338862 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:10.398782 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bcdbf-0ccc-4c7c-8948-816436338862 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:10.399411 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584bcdbf-0ccc-4c7c-8948-816436338862 None admin] RBAC: Adding query filter params (type=network) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:10.399709 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584bcdbf-0ccc-4c7c-8948-816436338862 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:10.399820 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ffc23-eed5-4ea4-af6a-45f87dd6f4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:10.400393 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ffc23-eed5-4ea4-af6a-45f87dd6f4ae None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:10.400675 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ffc23-eed5-4ea4-af6a-45f87dd6f4ae None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:10.400951 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ffc23-eed5-4ea4-af6a-45f87dd6f4ae None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:10.401061 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584bcdbf-0ccc-4c7c-8948-816436338862 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:10.401593 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484ffc23-eed5-4ea4-af6a-45f87dd6f4ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:10.401920 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484ffc23-eed5-4ea4-af6a-45f87dd6f4ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:10.403291 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484ffc23-eed5-4ea4-af6a-45f87dd6f4ae None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:10.406977 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 415/816] 10.222.0.33 () {56 vars in 1112 bytes} [Fri Sep 16 03:28:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:10.416207 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ce460-561d-4dc0-bd5a-e206805ceb5d None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:10.416488 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ce460-561d-4dc0-bd5a-e206805ceb5d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:10.416763 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ce460-561d-4dc0-bd5a-e206805ceb5d None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:10.419172 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 416/817] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:28:10.419911 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ce460-561d-4dc0-bd5a-e206805ceb5d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:10.420185 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 402/818] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:10.426046 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512a2b6-e772-4a25-a1e0-494d04977b11 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:10.426438 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512a2b6-e772-4a25-a1e0-494d04977b11 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:10.426815 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512a2b6-e772-4a25-a1e0-494d04977b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:10.445996 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4512a2b6-e772-4a25-a1e0-494d04977b11 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:10.447439 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4512a2b6-e772-4a25-a1e0-494d04977b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:10.533264 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 403/819] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:28:10.534794 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512a2b6-e772-4a25-a1e0-494d04977b11 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:10.547360 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ce460-561d-4dc0-bd5a-e206805ceb5d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:10.594481 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:10.618922 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea13dcd-9292-4d36-a448-adf5c3353090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:10.620094 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea13dcd-9292-4d36-a448-adf5c3353090 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:10.621189 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea13dcd-9292-4d36-a448-adf5c3353090 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:10.621807 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea13dcd-9292-4d36-a448-adf5c3353090 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:10.623992 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea13dcd-9292-4d36-a448-adf5c3353090 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:10.626720 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea13dcd-9292-4d36-a448-adf5c3353090 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:10.659865 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:10.697418 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512a2b6-e772-4a25-a1e0-494d04977b11 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:10.734261 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d060433-c058-44ea-a08a-8b31d61ea448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:10.734904 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d060433-c058-44ea-a08a-8b31d61ea448 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:10.735184 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d060433-c058-44ea-a08a-8b31d61ea448 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:10.735466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d060433-c058-44ea-a08a-8b31d61ea448 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:10.743177 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d060433-c058-44ea-a08a-8b31d61ea448 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:10.744619 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d060433-c058-44ea-a08a-8b31d61ea448 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:10.759118 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 417/820] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:28:10 2022] POST /identity/v3/endpoints => generated 337 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:28:10.764799 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-5d060433-c058-44ea-a08a-8b31d61ea448 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 03:28:10.764799 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:10.764799 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:10.764799 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:10.764799 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:10.764799 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:10.764799 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:10.764799 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:10.764799 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:10.764799 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:10.764799 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:10.764799 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:10.764799 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 03:28:10.764799 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 03:28:10.764799 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 03:28:10.764799 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 03:28:10.765905 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:10.765905 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:10.765905 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 03:28:10.765905 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:28:10.765905 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 03:28:10.765905 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:28:10.765905 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:10.765905 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:10.765905 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:10.765905 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:10.765905 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:10.765905 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:10.765905 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:10.765905 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:10.765905 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:10.765905 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:10.765905 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:10.765905 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:10.766826 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:10.766826 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:10.766826 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 03:28:10.766826 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 03:28:10.766826 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 03:28:10.766826 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 03:28:10.766826 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 03:28:10.766826 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 03:28:10.766826 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 03:28:10.766826 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:10.766826 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 404/821] 10.222.0.33 () {56 vars in 1093 bytes} [Fri Sep 16 03:28:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:10.775532 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea13dcd-9292-4d36-a448-adf5c3353090 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:10.934106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea13dcd-9292-4d36-a448-adf5c3353090 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:10.964898 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d060433-c058-44ea-a08a-8b31d61ea448 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:10.969981 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b8712-4c46-4777-bed5-a98291496c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:10.970597 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b8712-4c46-4777-bed5-a98291496c4d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:10.970879 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b8712-4c46-4777-bed5-a98291496c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:10.971154 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b8712-4c46-4777-bed5-a98291496c4d None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:10.971884 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b8712-4c46-4777-bed5-a98291496c4d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:10.972191 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b8712-4c46-4777-bed5-a98291496c4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:10.973621 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b8712-4c46-4777-bed5-a98291496c4d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:10.994312 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 418/822] 10.222.0.33 () {56 vars in 1133 bytes} [Fri Sep 16 03:28:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:11.000090 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b8712-4c46-4777-bed5-a98291496c4d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:11.039436 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:11.091683 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d060433-c058-44ea-a08a-8b31d61ea448 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:11.115799 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b8712-4c46-4777-bed5-a98291496c4d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:11.127322 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:11.136628 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c489c3-bf40-4fb1-854a-dd942ae43544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:11.137484 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c489c3-bf40-4fb1-854a-dd942ae43544 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:11.137945 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c489c3-bf40-4fb1-854a-dd942ae43544 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:11.139919 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c489c3-bf40-4fb1-854a-dd942ae43544 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:11.140816 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c489c3-bf40-4fb1-854a-dd942ae43544 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:11.142582 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c489c3-bf40-4fb1-854a-dd942ae43544 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:11.154465 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-d7c489c3-bf40-4fb1-854a-dd942ae43544 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 03:28:11.154465 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:11.154465 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 03:28:11.154465 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 03:28:11.154465 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 03:28:11.154465 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 03:28:11.154465 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 03:28:11.154465 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:28:11.154465 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 03:28:11.154465 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:11.154465 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 03:28:11.154465 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:11.154465 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:11.154465 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:11.154465 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:11.154465 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:11.154465 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:11.155523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:11.155523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:11.155523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:11.155523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:11.155523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:11.155523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:11.155523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 03:28:11.155523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 03:28:11.155523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 03:28:11.155523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 03:28:11.155523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:11.155523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:11.155523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:11.155523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:11.155523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:11.155523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:11.156409 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:11.156409 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:11.156409 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:11.156409 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:11.156409 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:11.156409 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:11.156409 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:11.156409 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:11.156409 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:11.156409 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:11.156409 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 03:28:11.156409 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:28:11.156409 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 03:28:11.156409 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:11.157140 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c4657-c984-4d76-a559-297a16ad9eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:11.157140 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c4657-c984-4d76-a559-297a16ad9eda None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:11.157140 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c4657-c984-4d76-a559-297a16ad9eda None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:11.157140 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c4657-c984-4d76-a559-297a16ad9eda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:11.159909 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 405/823] 10.222.0.33 () {56 vars in 1129 bytes} [Fri Sep 16 03:28:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:28:11.171202 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c489c3-bf40-4fb1-854a-dd942ae43544 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:11.236920 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c4657-c984-4d76-a559-297a16ad9eda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:11.238945 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c4657-c984-4d76-a559-297a16ad9eda None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:11.276576 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:11.295908 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c489c3-bf40-4fb1-854a-dd942ae43544 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:11.343644 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ed4a5-b244-4c95-86e9-f46670ef20a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:11.344941 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ed4a5-b244-4c95-86e9-f46670ef20a8 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:11.345491 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ed4a5-b244-4c95-86e9-f46670ef20a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:11.346073 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ed4a5-b244-4c95-86e9-f46670ef20a8 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:11.347115 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ed4a5-b244-4c95-86e9-f46670ef20a8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:11.347579 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ed4a5-b244-4c95-86e9-f46670ef20a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:11.349775 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ed4a5-b244-4c95-86e9-f46670ef20a8 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:11.355878 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 406/825] 10.222.0.33 () {56 vars in 1124 bytes} [Fri Sep 16 03:28:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:28:11.357696 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 419/825] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:28:10 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 03:28:11.360946 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ed4a5-b244-4c95-86e9-f46670ef20a8 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:11.362198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c4657-c984-4d76-a559-297a16ad9eda None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:11.430910 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:11.480312 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ed4a5-b244-4c95-86e9-f46670ef20a8 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:11.507038 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c4657-c984-4d76-a559-297a16ad9eda None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:11.522734 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48de195-5aea-4341-ad29-da65da193e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:11.523688 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48de195-5aea-4341-ad29-da65da193e21 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:11.524174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48de195-5aea-4341-ad29-da65da193e21 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:11.524654 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48de195-5aea-4341-ad29-da65da193e21 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:11.525500 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48de195-5aea-4341-ad29-da65da193e21 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:11.526023 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48de195-5aea-4341-ad29-da65da193e21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:11.527628 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48de195-5aea-4341-ad29-da65da193e21 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:11.533373 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 407/826] 10.222.0.33 () {56 vars in 1124 bytes} [Fri Sep 16 03:28:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:11.541789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48de195-5aea-4341-ad29-da65da193e21 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:11.544997 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacbf1c-2e51-45b2-9bbe-9e98840ec158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:11.545660 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacbf1c-2e51-45b2-9bbe-9e98840ec158 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:11.545935 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacbf1c-2e51-45b2-9bbe-9e98840ec158 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:11.546207 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacbf1c-2e51-45b2-9bbe-9e98840ec158 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:11.548080 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:11.558170 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aacbf1c-2e51-45b2-9bbe-9e98840ec158 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:11.561777 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aacbf1c-2e51-45b2-9bbe-9e98840ec158 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:11.575225 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-5aacbf1c-2e51-45b2-9bbe-9e98840ec158 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:11.575225 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:11.575225 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:11.575225 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:11.575225 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:11.575225 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:11.575225 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:11.575225 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:11.575225 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:11.575225 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:11.575225 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:11.575225 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:11.575225 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:28:11.575225 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:28:11.575225 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:28:11.575225 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:28:11.576240 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:11.576240 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:11.576240 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:11.576240 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:11.576240 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:11.576240 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:11.576240 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:11.576240 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:11.576240 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:11.576240 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:11.576240 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:11.576240 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:11.576240 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:11.576240 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:11.576240 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:11.576240 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:11.576240 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:28:11.577117 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:28:11.577117 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:11.577117 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:11.579453 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 420/827] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:28:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:11.585364 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacbf1c-2e51-45b2-9bbe-9e98840ec158 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:11.662507 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48de195-5aea-4341-ad29-da65da193e21 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:11.686198 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:11.706305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32bdbe-b4a0-4a58-bde7-264c7c2ee1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:11.706924 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32bdbe-b4a0-4a58-bde7-264c7c2ee1ef None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:11.707207 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32bdbe-b4a0-4a58-bde7-264c7c2ee1ef None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:11.707478 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32bdbe-b4a0-4a58-bde7-264c7c2ee1ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:11.708151 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d32bdbe-b4a0-4a58-bde7-264c7c2ee1ef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:11.710078 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d32bdbe-b4a0-4a58-bde7-264c7c2ee1ef None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:11.718405 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacbf1c-2e51-45b2-9bbe-9e98840ec158 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:11.751464 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55cc8a-f8fd-4271-b729-f2930edcb91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:11.752057 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55cc8a-f8fd-4271-b729-f2930edcb91c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:11.752332 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55cc8a-f8fd-4271-b729-f2930edcb91c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:11.752600 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55cc8a-f8fd-4271-b729-f2930edcb91c None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:11.753257 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c55cc8a-f8fd-4271-b729-f2930edcb91c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:11.753557 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c55cc8a-f8fd-4271-b729-f2930edcb91c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:11.754930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c55cc8a-f8fd-4271-b729-f2930edcb91c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:11.767806 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 421/828] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:28:11.768628 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a945cb-ac23-45db-9cc6-a10257a0eb37 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:11.768906 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a945cb-ac23-45db-9cc6-a10257a0eb37 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:11.769175 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a945cb-ac23-45db-9cc6-a10257a0eb37 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:11.773673 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 422/829] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:28:11.774670 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a945cb-ac23-45db-9cc6-a10257a0eb37 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:11.793030 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 408/830] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:28:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:28:11.794159 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200c0a2-773f-452a-a483-207a6a695d85 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:11.794444 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200c0a2-773f-452a-a483-207a6a695d85 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:11.794720 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200c0a2-773f-452a-a483-207a6a695d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:11.814911 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2200c0a2-773f-452a-a483-207a6a695d85 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:11.816220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2200c0a2-773f-452a-a483-207a6a695d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:11.840753 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:11.907880 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 409/831] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:11 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:28:11.917092 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a945cb-ac23-45db-9cc6-a10257a0eb37 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:11.955734 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b16a92-e7bc-4c09-82ba-c0c7deea2075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:11.957058 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b16a92-e7bc-4c09-82ba-c0c7deea2075 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:11.957483 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b16a92-e7bc-4c09-82ba-c0c7deea2075 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:11.958028 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b16a92-e7bc-4c09-82ba-c0c7deea2075 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:11.966184 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b16a92-e7bc-4c09-82ba-c0c7deea2075 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:11.967831 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b16a92-e7bc-4c09-82ba-c0c7deea2075 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:11.979748 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-88b16a92-e7bc-4c09-82ba-c0c7deea2075 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:28:11.979748 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:11.979748 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:11.979748 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:11.979748 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:11.979748 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:11.979748 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:11.979748 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:11.979748 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:11.979748 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:11.979748 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:11.979748 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:11.979748 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 03:28:11.979748 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 03:28:11.979748 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 03:28:11.980814 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 03:28:11.980814 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:11.980814 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:11.980814 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:11.980814 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:11.980814 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:11.980814 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:11.980814 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:11.980814 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:11.980814 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:11.980814 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:11.980814 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:11.980814 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:11.980814 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:11.980814 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:11.980814 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:11.980814 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:11.981871 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 03:28:11.981871 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 03:28:11.981871 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 03:28:11.981871 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 03:28:11.981871 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 03:28:11.981871 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 03:28:11.981871 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:28:11.981871 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:11.983008 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 423/832] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:28:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:11.988792 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200c0a2-773f-452a-a483-207a6a695d85 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:12.092444 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200c0a2-773f-452a-a483-207a6a695d85 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:12.094049 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:12.126921 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486d862-79ed-41b5-9c1f-7569bded4138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:12.127533 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486d862-79ed-41b5-9c1f-7569bded4138 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:12.128077 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486d862-79ed-41b5-9c1f-7569bded4138 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:12.128077 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486d862-79ed-41b5-9c1f-7569bded4138 None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:12.128800 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486d862-79ed-41b5-9c1f-7569bded4138 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:12.129100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486d862-79ed-41b5-9c1f-7569bded4138 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:12.131145 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486d862-79ed-41b5-9c1f-7569bded4138 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:12.143003 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 410/833] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 03:28:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:28:12.150719 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b16a92-e7bc-4c09-82ba-c0c7deea2075 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:12.187954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486d862-79ed-41b5-9c1f-7569bded4138 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:12.273689 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b16a92-e7bc-4c09-82ba-c0c7deea2075 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:12.282053 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:12.306756 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486d862-79ed-41b5-9c1f-7569bded4138 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:12.317256 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bd3aa-b614-4a0c-892c-5459de59f891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:12.319041 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bd3aa-b614-4a0c-892c-5459de59f891 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:12.319598 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bd3aa-b614-4a0c-892c-5459de59f891 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:12.320077 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bd3aa-b614-4a0c-892c-5459de59f891 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:12.321050 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7bd3aa-b614-4a0c-892c-5459de59f891 None admin] RBAC: Adding query filter params (role.id=4ffac54101e248479bcdc0e54890020f, scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2, user.id=c09d1a4ac8b64921a6b05fcd567bb770) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:12.321566 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7bd3aa-b614-4a0c-892c-5459de59f891 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:12.323350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7bd3aa-b614-4a0c-892c-5459de59f891 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:12.330221 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 424/834] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:28:12 2022] GET /identity/v3/role_assignments?user.id=c09d1a4ac8b64921a6b05fcd567bb770&scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2&role.id=4ffac54101e248479bcdc0e54890020f => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:12.353952 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3842d0-5289-4d01-8210-44b4e332048d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:12.354988 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3842d0-5289-4d01-8210-44b4e332048d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:12.355509 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3842d0-5289-4d01-8210-44b4e332048d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:12.356023 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3842d0-5289-4d01-8210-44b4e332048d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:12.369915 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3842d0-5289-4d01-8210-44b4e332048d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:28:12.376332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-7a3842d0-5289-4d01-8210-44b4e332048d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 03:28:12.376332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:12.376332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:12.376332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:12.376332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:12.376332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:12.376332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:12.376332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:12.376332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:12.376332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:12.376332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:12.376332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:12.376332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:28:12.376332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:28:12.376332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:28:12.376332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:28:12.377366 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:28:12.377366 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:28:12.377366 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:28:12.377366 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:28:12.377366 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:12.377366 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:12.377366 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:12.377366 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:12.377366 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:12.377366 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:12.377366 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:12.377366 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:12.377366 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:12.377366 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:12.377366 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:12.377366 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:12.378240 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:12.378240 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:12.378240 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:12.378240 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:12.378240 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:28:12.378240 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:28:12.378240 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:28:12.378240 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:28:12.378240 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:28:12.378240 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:28:12.378240 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 03:28:12.378240 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:12.381813 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 411/835] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 03:28:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:28:12.388295 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bd3aa-b614-4a0c-892c-5459de59f891 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:12.489346 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb35794-9439-419b-9b93-e85df4db049d None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:12.489702 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb35794-9439-419b-9b93-e85df4db049d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:12.490468 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb35794-9439-419b-9b93-e85df4db049d None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:12.496113 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 412/836] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:28:12.497997 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a244988-9713-4c7d-b729-0813e4d5add9 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:12.498285 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a244988-9713-4c7d-b729-0813e4d5add9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:12.498563 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a244988-9713-4c7d-b729-0813e4d5add9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:12.505145 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bd3aa-b614-4a0c-892c-5459de59f891 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:12.517037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2a244988-9713-4c7d-b729-0813e4d5add9 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:12.518265 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2a244988-9713-4c7d-b729-0813e4d5add9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:12.537857 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:12.544409 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4ff5e-dc6c-4fac-a147-45350e83fc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:12.545197 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4ff5e-dc6c-4fac-a147-45350e83fc57 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:12.545489 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4ff5e-dc6c-4fac-a147-45350e83fc57 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:12.545805 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4ff5e-dc6c-4fac-a147-45350e83fc57 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:12.547100 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4ff5e-dc6c-4fac-a147-45350e83fc57 None admin] RBAC: Adding query filter params (name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:12.547414 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4ff5e-dc6c-4fac-a147-45350e83fc57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:12.549416 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4ff5e-dc6c-4fac-a147-45350e83fc57 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:12.563770 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 425/837] 10.222.0.33 () {56 vars in 1103 bytes} [Fri Sep 16 03:28:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:12.568012 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4ff5e-dc6c-4fac-a147-45350e83fc57 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:12.602377 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 413/838] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:12 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 03:28:12.606879 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:12.680761 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4ff5e-dc6c-4fac-a147-45350e83fc57 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:12.723575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1c47e-9af5-4218-8a16-2120d00a06a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:12.724234 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1c47e-9af5-4218-8a16-2120d00a06a8 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:12.725082 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1c47e-9af5-4218-8a16-2120d00a06a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:12.725353 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1c47e-9af5-4218-8a16-2120d00a06a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:12.735951 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa1c47e-9af5-4218-8a16-2120d00a06a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:12.737397 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa1c47e-9af5-4218-8a16-2120d00a06a8 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:12.752291 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-baa1c47e-9af5-4218-8a16-2120d00a06a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:12.752291 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:12.752291 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:12.752291 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:12.752291 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:12.752291 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:12.752291 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:12.752291 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:12.752291 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:12.752291 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:12.752291 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:12.752291 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:12.752291 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:28:12.752291 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:28:12.752291 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:28:12.752291 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:28:12.753242 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:12.753242 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:12.753242 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:12.753242 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:12.753242 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:12.753242 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:12.753242 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:12.753242 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:12.753242 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:12.753242 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:12.753242 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:12.753242 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:12.753242 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:12.753242 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:12.753242 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:12.753242 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:12.753242 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:28:12.754168 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:28:12.754168 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:12.754168 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:12.754168 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 426/839] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:28:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:12.760607 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a244988-9713-4c7d-b729-0813e4d5add9 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:12.870041 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a244988-9713-4c7d-b729-0813e4d5add9 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:12.871400 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1c47e-9af5-4218-8a16-2120d00a06a8 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:12.906236 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110303e-a2cf-463f-b426-28b5503371a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:12.906910 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110303e-a2cf-463f-b426-28b5503371a5 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:12.907252 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110303e-a2cf-463f-b426-28b5503371a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:12.907531 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110303e-a2cf-463f-b426-28b5503371a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:12.908227 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5110303e-a2cf-463f-b426-28b5503371a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:12.908539 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5110303e-a2cf-463f-b426-28b5503371a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:12.910122 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5110303e-a2cf-463f-b426-28b5503371a5 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:12.923505 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 414/840] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:12.930783 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110303e-a2cf-463f-b426-28b5503371a5 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:12.948922 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:12.973535 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:12.993578 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1c47e-9af5-4218-8a16-2120d00a06a8 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:13.038574 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b12d0eb-1492-4af8-9a3f-932f22b6f065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:13.039771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b12d0eb-1492-4af8-9a3f-932f22b6f065 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:13.040255 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b12d0eb-1492-4af8-9a3f-932f22b6f065 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:13.040858 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b12d0eb-1492-4af8-9a3f-932f22b6f065 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:13.061294 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b12d0eb-1492-4af8-9a3f-932f22b6f065 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:28:13.061719 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110303e-a2cf-463f-b426-28b5503371a5 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:13.067548 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-9b12d0eb-1492-4af8-9a3f-932f22b6f065 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:28:13.067548 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:13.067548 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:13.067548 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:13.067548 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:13.067548 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:13.067548 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:13.067548 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:13.067548 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:13.067548 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:13.067548 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:13.067548 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:13.067548 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:28:13.067548 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:28:13.067548 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:28:13.067548 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:28:13.069044 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:28:13.069044 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:28:13.069044 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:28:13.069044 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:28:13.069044 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:13.069044 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:13.069044 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:13.069044 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:13.069044 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:13.069044 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:13.069044 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:13.069044 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:13.069044 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:13.069044 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:13.069044 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:13.069044 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:13.070003 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:13.070003 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:13.070003 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:13.070003 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:13.070003 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:28:13.070003 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:28:13.070003 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:28:13.070003 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:28:13.070003 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:28:13.070003 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:28:13.070003 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:28:13.070003 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:13.076854 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 427/841] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 03:28:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:28:13.079748 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b12d0eb-1492-4af8-9a3f-932f22b6f065 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:13.104842 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e09de4e-3c57-46d9-af33-436a848ac3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:13.105527 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09de4e-3c57-46d9-af33-436a848ac3a3 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:13.105842 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09de4e-3c57-46d9-af33-436a848ac3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:13.106110 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09de4e-3c57-46d9-af33-436a848ac3a3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:13.114261 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e09de4e-3c57-46d9-af33-436a848ac3a3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:13.115761 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e09de4e-3c57-46d9-af33-436a848ac3a3 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:13.127405 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-8e09de4e-3c57-46d9-af33-436a848ac3a3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 03:28:13.127405 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:13.127405 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:13.127405 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:13.127405 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:13.127405 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:13.127405 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:13.127405 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:13.127405 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:13.127405 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:13.127405 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:13.127405 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:13.127405 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 03:28:13.127405 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 03:28:13.127405 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 03:28:13.127405 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 03:28:13.128801 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:13.128801 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:13.128801 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 03:28:13.128801 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:28:13.128801 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 03:28:13.128801 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:28:13.128801 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:13.128801 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:13.128801 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:13.128801 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:13.128801 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:13.128801 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:13.128801 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:13.128801 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:13.128801 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:13.128801 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:13.128801 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:13.128801 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:13.129767 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:13.129767 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:13.129767 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 03:28:13.129767 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 03:28:13.129767 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 03:28:13.129767 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 03:28:13.129767 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 03:28:13.129767 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 03:28:13.129767 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 03:28:13.129767 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:13.129767 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 415/842] 10.222.0.33 () {56 vars in 1117 bytes} [Fri Sep 16 03:28:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:28:13.138888 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e09de4e-3c57-46d9-af33-436a848ac3a3 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:13.203869 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b12d0eb-1492-4af8-9a3f-932f22b6f065 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:13.230195 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:13.243568 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2e348-27cf-43e2-a09a-b23ccb7965e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:13.244436 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2e348-27cf-43e2-a09a-b23ccb7965e3 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:13.244874 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2e348-27cf-43e2-a09a-b23ccb7965e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:13.245291 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2e348-27cf-43e2-a09a-b23ccb7965e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:13.246141 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e2e348-27cf-43e2-a09a-b23ccb7965e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:13.246603 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e2e348-27cf-43e2-a09a-b23ccb7965e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:13.248112 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e2e348-27cf-43e2-a09a-b23ccb7965e3 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:13.257390 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 428/843] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:28:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:13.263935 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2e348-27cf-43e2-a09a-b23ccb7965e3 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:13.271606 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e09de4e-3c57-46d9-af33-436a848ac3a3 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:13.274773 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:13.321647 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b281781-3c5e-4375-b8f2-5c76001d97f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:13.322255 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b281781-3c5e-4375-b8f2-5c76001d97f9 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:13.322532 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b281781-3c5e-4375-b8f2-5c76001d97f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:13.322811 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b281781-3c5e-4375-b8f2-5c76001d97f9 None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:13.323532 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b281781-3c5e-4375-b8f2-5c76001d97f9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:13.323835 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b281781-3c5e-4375-b8f2-5c76001d97f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:13.325243 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b281781-3c5e-4375-b8f2-5c76001d97f9 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:13.347913 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 416/844] 10.222.0.33 () {56 vars in 1149 bytes} [Fri Sep 16 03:28:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:28:13.348946 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b281781-3c5e-4375-b8f2-5c76001d97f9 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:13.396841 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2e348-27cf-43e2-a09a-b23ccb7965e3 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:13.436350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64758cb9-7ea4-4f46-8483-de60754a0df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:13.436976 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64758cb9-7ea4-4f46-8483-de60754a0df5 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:13.437289 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64758cb9-7ea4-4f46-8483-de60754a0df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:13.437574 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64758cb9-7ea4-4f46-8483-de60754a0df5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:13.454166 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64758cb9-7ea4-4f46-8483-de60754a0df5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:13.455590 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64758cb9-7ea4-4f46-8483-de60754a0df5 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:13.474232 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-64758cb9-7ea4-4f46-8483-de60754a0df5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:13.474232 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:13.474232 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:13.474232 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:13.474232 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:13.474232 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:13.474232 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:13.474232 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:13.474232 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:13.474232 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:13.474232 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:13.474232 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:13.474232 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:28:13.474232 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:28:13.474232 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:28:13.474232 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:28:13.475231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:13.475231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:13.475231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:13.475231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:13.475231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:13.475231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:13.475231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:13.475231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:13.475231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:13.475231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:13.475231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:13.475231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:13.475231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:13.475231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:13.475231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:13.475231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:13.475231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:28:13.476114 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:28:13.476114 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:13.476114 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:13.480203 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 429/845] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:28:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:13.481426 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64758cb9-7ea4-4f46-8483-de60754a0df5 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:13.493887 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b281781-3c5e-4375-b8f2-5c76001d97f9 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:13.537647 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:13.546091 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41e1d6-dc92-4448-b04d-0b650cde7465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:13.547098 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41e1d6-dc92-4448-b04d-0b650cde7465 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:13.547693 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41e1d6-dc92-4448-b04d-0b650cde7465 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:13.548150 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41e1d6-dc92-4448-b04d-0b650cde7465 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:13.551908 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:13.622476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64758cb9-7ea4-4f46-8483-de60754a0df5 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:13.631372 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41e1d6-dc92-4448-b04d-0b650cde7465 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:13.632961 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41e1d6-dc92-4448-b04d-0b650cde7465 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:13.674106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9539a-e1ad-4ddf-bc1e-ea72c2e5d29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:13.675544 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9539a-e1ad-4ddf-bc1e-ea72c2e5d29b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:13.676082 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9539a-e1ad-4ddf-bc1e-ea72c2e5d29b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:13.676578 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9539a-e1ad-4ddf-bc1e-ea72c2e5d29b None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:13.677993 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f9539a-e1ad-4ddf-bc1e-ea72c2e5d29b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:13.678904 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f9539a-e1ad-4ddf-bc1e-ea72c2e5d29b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:13.680808 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f9539a-e1ad-4ddf-bc1e-ea72c2e5d29b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:13.706411 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 430/846] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:13.711832 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9539a-e1ad-4ddf-bc1e-ea72c2e5d29b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:13.759311 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 417/847] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:28:13 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 03:28:13.760282 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41e1d6-dc92-4448-b04d-0b650cde7465 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:13.791368 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:13.825086 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9539a-e1ad-4ddf-bc1e-ea72c2e5d29b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:13.844075 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:13.863437 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5bde52-0042-45af-81cc-4768866454cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:13.863932 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41e1d6-dc92-4448-b04d-0b650cde7465 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:13.864651 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bde52-0042-45af-81cc-4768866454cb None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:13.865755 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bde52-0042-45af-81cc-4768866454cb None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:13.866293 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bde52-0042-45af-81cc-4768866454cb None admin] PATH_INFO: `/v3/users/swift` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:13.874261 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5bde52-0042-45af-81cc-4768866454cb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:13.876135 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5bde52-0042-45af-81cc-4768866454cb None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:13.889652 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-5e5bde52-0042-45af-81cc-4768866454cb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 16 03:28:13.889652 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:13.889652 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:13.889652 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:13.889652 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:13.889652 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:13.889652 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:13.889652 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:13.889652 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:13.889652 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:13.889652 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:13.889652 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:13.889652 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 03:28:13.889652 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 03:28:13.889652 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 03:28:13.889652 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 03:28:13.890667 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:13.890667 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:13.890667 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 03:28:13.890667 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:28:13.890667 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 03:28:13.890667 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:28:13.890667 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:13.890667 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:13.890667 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:13.890667 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:13.890667 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:13.890667 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:13.890667 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:13.890667 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:13.890667 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:13.890667 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:13.890667 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:13.890667 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:13.891649 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:13.891649 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:13.891649 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 03:28:13.891649 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 03:28:13.891649 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 03:28:13.891649 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 03:28:13.891649 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 03:28:13.891649 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 03:28:13.891649 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 16 03:28:13.891649 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:13.894315 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 431/848] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 03:28:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:28:13.901308 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5bde52-0042-45af-81cc-4768866454cb None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:13.907785 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43090bf1-da0b-4796-82d6-c2bd26e072df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:13.908417 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43090bf1-da0b-4796-82d6-c2bd26e072df None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:13.908695 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43090bf1-da0b-4796-82d6-c2bd26e072df None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:13.908965 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43090bf1-da0b-4796-82d6-c2bd26e072df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:13.921979 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43090bf1-da0b-4796-82d6-c2bd26e072df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:13.924306 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43090bf1-da0b-4796-82d6-c2bd26e072df None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:13.944003 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-43090bf1-da0b-4796-82d6-c2bd26e072df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:13.944003 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:13.944003 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:13.944003 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:13.944003 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:13.944003 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:13.944003 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:13.944003 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:13.944003 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:13.944003 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:13.944003 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:13.944003 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:13.944003 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:28:13.944003 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:28:13.944003 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:28:13.944003 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:28:13.944994 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:13.944994 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:13.944994 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:13.944994 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:13.944994 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:13.944994 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:13.944994 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:13.944994 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:13.944994 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:13.944994 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:13.944994 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:13.944994 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:13.944994 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:13.944994 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:13.944994 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:13.944994 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:13.944994 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:28:13.946014 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:28:13.946014 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:13.946014 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:13.949901 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 418/849] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:28:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:13.950728 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43090bf1-da0b-4796-82d6-c2bd26e072df None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:14.030106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5bde52-0042-45af-81cc-4768866454cb None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:14.041822 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:14.060720 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43090bf1-da0b-4796-82d6-c2bd26e072df None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:14.068598 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6778f-4198-4058-bea5-de21affb50b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:14.069428 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6778f-4198-4058-bea5-de21affb50b5 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:14.069542 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6778f-4198-4058-bea5-de21affb50b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:14.069808 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6778f-4198-4058-bea5-de21affb50b5 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:14.070531 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6778f-4198-4058-bea5-de21affb50b5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:14.070836 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6778f-4198-4058-bea5-de21affb50b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:14.072395 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6778f-4198-4058-bea5-de21affb50b5 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:14.096930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 432/850] 10.222.0.33 () {56 vars in 1135 bytes} [Fri Sep 16 03:28:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:14.098773 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6778f-4198-4058-bea5-de21affb50b5 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:14.105737 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f62c9-b519-4355-a88d-c7f9e7912120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:14.106389 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f62c9-b519-4355-a88d-c7f9e7912120 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:14.106670 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f62c9-b519-4355-a88d-c7f9e7912120 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:14.106992 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f62c9-b519-4355-a88d-c7f9e7912120 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:14.107635 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f62c9-b519-4355-a88d-c7f9e7912120 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:14.107937 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f62c9-b519-4355-a88d-c7f9e7912120 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:14.109295 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f62c9-b519-4355-a88d-c7f9e7912120 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:14.129412 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 419/851] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:14.132251 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f62c9-b519-4355-a88d-c7f9e7912120 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:14.148912 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:14.216299 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6778f-4198-4058-bea5-de21affb50b5 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:14.240195 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f62c9-b519-4355-a88d-c7f9e7912120 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:14.253267 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f4365-2a22-47d5-821f-91e43df66e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:14.253912 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f4365-2a22-47d5-821f-91e43df66e0e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:14.254194 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f4365-2a22-47d5-821f-91e43df66e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:14.254468 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f4365-2a22-47d5-821f-91e43df66e0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:14.276937 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf430bf-47f0-4c6f-8fb2-d2a1e8443446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:14.277577 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf430bf-47f0-4c6f-8fb2-d2a1e8443446 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:14.277878 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf430bf-47f0-4c6f-8fb2-d2a1e8443446 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:14.278152 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf430bf-47f0-4c6f-8fb2-d2a1e8443446 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:14.284918 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf430bf-47f0-4c6f-8fb2-d2a1e8443446 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:14.286393 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf430bf-47f0-4c6f-8fb2-d2a1e8443446 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:14.298354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-bdf430bf-47f0-4c6f-8fb2-d2a1e8443446 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:28:14.298354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:14.298354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:14.298354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:14.298354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:14.298354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:14.298354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:14.298354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:14.298354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:14.298354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:14.298354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:14.298354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:14.298354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 03:28:14.298354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 03:28:14.298354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 03:28:14.299278 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 03:28:14.299278 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:14.299278 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:14.299278 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:14.299278 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:14.299278 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:14.299278 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:14.299278 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:14.299278 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:14.299278 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:14.299278 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:14.299278 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:14.299278 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:14.299278 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:14.299278 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:14.299278 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:14.299278 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:14.305214 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 03:28:14.305214 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 03:28:14.305214 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 03:28:14.305214 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 03:28:14.305214 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 03:28:14.305214 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 03:28:14.305214 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:28:14.305214 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:14.305214 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 420/852] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:28:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:14.305214 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b7708-ce43-43ef-956b-0f85f68d3f07 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:14.305214 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b7708-ce43-43ef-956b-0f85f68d3f07 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:14.305998 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b7708-ce43-43ef-956b-0f85f68d3f07 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:14.305998 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 421/853] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:28:14.307763 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b7708-ce43-43ef-956b-0f85f68d3f07 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:14.310804 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:14.335699 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f4365-2a22-47d5-821f-91e43df66e0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:14.337203 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f4365-2a22-47d5-821f-91e43df66e0e None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:14.373413 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:14.431579 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b7708-ce43-43ef-956b-0f85f68d3f07 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:14.442277 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 433/854] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:28:14 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 03:28:14.444224 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fb7c5-f130-49dd-a972-7fe2842a1510 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:14.444507 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fb7c5-f130-49dd-a972-7fe2842a1510 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:14.444779 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fb7c5-f130-49dd-a972-7fe2842a1510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:14.463739 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-454fb7c5-f130-49dd-a972-7fe2842a1510 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:14.465147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-454fb7c5-f130-49dd-a972-7fe2842a1510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:14.469669 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05d2cb-4a03-467f-a80b-979e9173fb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:14.470219 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05d2cb-4a03-467f-a80b-979e9173fb8c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:14.470502 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05d2cb-4a03-467f-a80b-979e9173fb8c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:14.470778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05d2cb-4a03-467f-a80b-979e9173fb8c None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:14.471468 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05d2cb-4a03-467f-a80b-979e9173fb8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:14.471775 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05d2cb-4a03-467f-a80b-979e9173fb8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:14.473356 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05d2cb-4a03-467f-a80b-979e9173fb8c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:14.485897 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 422/855] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 03:28:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:14.486618 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05d2cb-4a03-467f-a80b-979e9173fb8c None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:14.541777 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 434/856] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:28:14.542945 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454fb7c5-f130-49dd-a972-7fe2842a1510 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:14.574383 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:14.616705 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:14.630492 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05d2cb-4a03-467f-a80b-979e9173fb8c None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:14.652536 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454fb7c5-f130-49dd-a972-7fe2842a1510 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:14.674153 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5522aadf-c21a-4045-a4b0-970f5a0a34f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:14.674776 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522aadf-c21a-4045-a4b0-970f5a0a34f3 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:14.675056 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522aadf-c21a-4045-a4b0-970f5a0a34f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:14.675325 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522aadf-c21a-4045-a4b0-970f5a0a34f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:14.686052 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5522aadf-c21a-4045-a4b0-970f5a0a34f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:14.687491 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5522aadf-c21a-4045-a4b0-970f5a0a34f3 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:14.688303 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3906ba-d8d7-4ea7-a120-718a4e6470ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:14.688953 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3906ba-d8d7-4ea7-a120-718a4e6470ad None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:14.689194 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3906ba-d8d7-4ea7-a120-718a4e6470ad None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:14.689472 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3906ba-d8d7-4ea7-a120-718a4e6470ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:14.690237 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3906ba-d8d7-4ea7-a120-718a4e6470ad None admin] RBAC: Adding query filter params (role.id=8a338e321ece4061b4b30d6231167b4e, scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2, user.id=b0812002d7b14bcb81a42eb380231feb) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:14.690546 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3906ba-d8d7-4ea7-a120-718a4e6470ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:14.691987 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3906ba-d8d7-4ea7-a120-718a4e6470ad None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:14.709134 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 435/857] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:28:14 2022] GET /identity/v3/role_assignments?user.id=b0812002d7b14bcb81a42eb380231feb&scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2&role.id=8a338e321ece4061b4b30d6231167b4e => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:14.709134 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd637f-c912-4c16-945d-324f34409f08 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:14.709134 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd637f-c912-4c16-945d-324f34409f08 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:14.709134 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd637f-c912-4c16-945d-324f34409f08 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:14.709134 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 436/858] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:28:14.713665 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5bc59c-2903-4102-b69f-ebb61385e4e6 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:14.713957 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5bc59c-2903-4102-b69f-ebb61385e4e6 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:14.714234 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5bc59c-2903-4102-b69f-ebb61385e4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:14.715914 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-5522aadf-c21a-4045-a4b0-970f5a0a34f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:14.715914 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:14.715914 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:14.715914 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:14.715914 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:14.715914 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:14.715914 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:14.715914 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:14.715914 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:14.715914 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:14.715914 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:14.715914 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:14.715914 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:28:14.715914 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:28:14.715914 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:28:14.715914 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:28:14.716810 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:14.716810 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:14.716810 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:14.716810 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:14.716810 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:14.716810 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:14.716810 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:14.716810 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:14.716810 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:14.716810 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:14.716810 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:14.716810 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:14.716810 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:14.716810 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:14.716810 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:14.716810 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:14.716810 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:28:14.718198 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:28:14.718198 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:14.718198 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:14.718198 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 423/859] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:28:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:14.722989 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5522aadf-c21a-4045-a4b0-970f5a0a34f3 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:14.734390 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1a5bc59c-2903-4102-b69f-ebb61385e4e6 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:14.735936 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1a5bc59c-2903-4102-b69f-ebb61385e4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:14.823468 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 437/860] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 03:28:14.832156 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5bc59c-2903-4102-b69f-ebb61385e4e6 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:14.856822 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5522aadf-c21a-4045-a4b0-970f5a0a34f3 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:14.874476 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:14.901770 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6716aea-c77b-494d-bdf7-da08ff9f6e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:14.902498 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6716aea-c77b-494d-bdf7-da08ff9f6e3b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:14.902779 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6716aea-c77b-494d-bdf7-da08ff9f6e3b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:14.903209 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6716aea-c77b-494d-bdf7-da08ff9f6e3b None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:14.904030 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6716aea-c77b-494d-bdf7-da08ff9f6e3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:14.904341 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6716aea-c77b-494d-bdf7-da08ff9f6e3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:14.906049 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6716aea-c77b-494d-bdf7-da08ff9f6e3b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:14.909657 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:14.923368 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 424/861] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:28:14.929489 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6716aea-c77b-494d-bdf7-da08ff9f6e3b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:14.967937 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5bc59c-2903-4102-b69f-ebb61385e4e6 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:15.012239 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c58eb8-0849-49f9-8e01-2d1dccc550fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:15.012843 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c58eb8-0849-49f9-8e01-2d1dccc550fc None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:15.013122 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c58eb8-0849-49f9-8e01-2d1dccc550fc None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:15.013392 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c58eb8-0849-49f9-8e01-2d1dccc550fc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:15.014024 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c58eb8-0849-49f9-8e01-2d1dccc550fc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:15.015421 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c58eb8-0849-49f9-8e01-2d1dccc550fc None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:15.026901 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-68c58eb8-0849-49f9-8e01-2d1dccc550fc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 03:28:15.026901 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:15.026901 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 03:28:15.026901 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 03:28:15.026901 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 03:28:15.026901 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 03:28:15.026901 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 03:28:15.026901 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:28:15.026901 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 03:28:15.026901 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:15.026901 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 03:28:15.026901 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:15.026901 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:15.026901 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:15.026901 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:15.026901 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:15.026901 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:15.028029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:15.028029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:15.028029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:15.028029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:15.028029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:15.028029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:15.028029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 03:28:15.028029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 03:28:15.028029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 03:28:15.028029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 03:28:15.028029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:15.028029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:15.028029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:15.028029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:15.028029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:15.028029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:15.028887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:15.028887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:15.028887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:15.028887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:15.028887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:15.028887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:15.028887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:15.028887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:15.028887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:15.028887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:15.028887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 03:28:15.028887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:28:15.028887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 03:28:15.028887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:15.028887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 438/862] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 03:28:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:28:15.035455 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c58eb8-0849-49f9-8e01-2d1dccc550fc None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:15.065776 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6716aea-c77b-494d-bdf7-da08ff9f6e3b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:15.102698 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db9af3-c5e3-4470-bad7-c6db8e614940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:15.103354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db9af3-c5e3-4470-bad7-c6db8e614940 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:15.103739 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db9af3-c5e3-4470-bad7-c6db8e614940 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:15.103911 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db9af3-c5e3-4470-bad7-c6db8e614940 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:15.110877 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db9af3-c5e3-4470-bad7-c6db8e614940 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:15.112310 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db9af3-c5e3-4470-bad7-c6db8e614940 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:15.124649 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-89db9af3-c5e3-4470-bad7-c6db8e614940 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:28:15.124649 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:15.124649 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:15.124649 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:15.124649 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:15.124649 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:15.124649 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:15.124649 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:15.124649 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:15.124649 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:15.124649 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:15.124649 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:15.124649 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 03:28:15.124649 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 03:28:15.124649 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 03:28:15.125755 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 03:28:15.125755 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:15.125755 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:15.125755 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:15.125755 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:15.125755 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:15.125755 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:15.125755 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:15.125755 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:15.125755 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:15.125755 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:15.125755 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:15.125755 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:15.125755 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:15.125755 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:15.125755 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:15.125755 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:15.126796 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 03:28:15.126796 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 03:28:15.126796 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 03:28:15.126796 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 03:28:15.126796 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 03:28:15.126796 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 03:28:15.126796 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:28:15.126796 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:15.126796 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 425/863] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:28:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:28:15.126796 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db9af3-c5e3-4470-bad7-c6db8e614940 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:15.166594 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c58eb8-0849-49f9-8e01-2d1dccc550fc None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:15.168133 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:15.193551 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:15.204237 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d1e7d-9760-497b-8596-edde8c5cacbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:15.204843 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d1e7d-9760-497b-8596-edde8c5cacbf None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:15.205126 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d1e7d-9760-497b-8596-edde8c5cacbf None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:15.205405 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d1e7d-9760-497b-8596-edde8c5cacbf None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:15.206071 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d1e7d-9760-497b-8596-edde8c5cacbf None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:15.206378 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d1e7d-9760-497b-8596-edde8c5cacbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:15.207827 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d1e7d-9760-497b-8596-edde8c5cacbf None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:15.212599 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 439/864] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 03:28:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:15.213387 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d1e7d-9760-497b-8596-edde8c5cacbf None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:15.243287 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db9af3-c5e3-4470-bad7-c6db8e614940 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:15.278720 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9d156-f166-439f-90bf-3c1d6f25d15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:15.279272 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9d156-f166-439f-90bf-3c1d6f25d15d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:15.279625 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9d156-f166-439f-90bf-3c1d6f25d15d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:15.279805 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9d156-f166-439f-90bf-3c1d6f25d15d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:15.280376 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc9d156-f166-439f-90bf-3c1d6f25d15d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:15.281754 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc9d156-f166-439f-90bf-3c1d6f25d15d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:15.291291 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-2bc9d156-f166-439f-90bf-3c1d6f25d15d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 03:28:15.291291 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:15.291291 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 03:28:15.291291 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 03:28:15.291291 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 03:28:15.291291 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 03:28:15.291291 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 03:28:15.291291 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:28:15.291291 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 03:28:15.291291 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:15.291291 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 03:28:15.291291 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:15.291291 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:15.291291 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:15.291291 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:15.291291 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:15.292271 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:15.292271 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:15.292271 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:15.292271 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:15.292271 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:15.292271 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:15.292271 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:15.292271 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 03:28:15.292271 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 03:28:15.292271 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 03:28:15.292271 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 03:28:15.292271 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:15.292271 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:15.292271 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:15.292271 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:15.292271 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:15.292271 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:15.293146 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:15.293146 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:15.293146 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:15.293146 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:15.293146 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:15.293146 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:15.293146 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:15.293146 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:15.293146 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:15.293146 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:15.293146 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 03:28:15.293146 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:28:15.293146 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 03:28:15.293146 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:15.293146 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 426/865] 10.222.0.33 () {56 vars in 1132 bytes} [Fri Sep 16 03:28:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:15.294006 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9d156-f166-439f-90bf-3c1d6f25d15d None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:15.328714 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d1e7d-9760-497b-8596-edde8c5cacbf None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:15.367105 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae3166d-d005-4ff6-8d45-c184838f02ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:15.367712 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3166d-d005-4ff6-8d45-c184838f02ce None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:15.367996 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3166d-d005-4ff6-8d45-c184838f02ce None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:15.368259 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3166d-d005-4ff6-8d45-c184838f02ce None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:15.368952 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae3166d-d005-4ff6-8d45-c184838f02ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:15.369261 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae3166d-d005-4ff6-8d45-c184838f02ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:15.371023 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae3166d-d005-4ff6-8d45-c184838f02ce None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:15.382980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 440/866] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 03:28:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:15.383788 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae3166d-d005-4ff6-8d45-c184838f02ce None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:15.402550 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:15.407696 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9d156-f166-439f-90bf-3c1d6f25d15d None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:15.439596 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:15.443954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff8e5c-0855-41b5-aa3d-1a19247cd96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:15.444206 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff8e5c-0855-41b5-aa3d-1a19247cd96b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:15.444499 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff8e5c-0855-41b5-aa3d-1a19247cd96b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:15.445077 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff8e5c-0855-41b5-aa3d-1a19247cd96b None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:15.445678 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff8e5c-0855-41b5-aa3d-1a19247cd96b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:15.446354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff8e5c-0855-41b5-aa3d-1a19247cd96b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:15.448610 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff8e5c-0855-41b5-aa3d-1a19247cd96b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:15.453341 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 427/867] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 03:28:15 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:15.454375 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff8e5c-0855-41b5-aa3d-1a19247cd96b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:15.511310 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae3166d-d005-4ff6-8d45-c184838f02ce None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:15.555385 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039e5c5-2fb3-4e80-844e-dd202ab4f7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:15.556019 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039e5c5-2fb3-4e80-844e-dd202ab4f7c4 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:15.556371 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039e5c5-2fb3-4e80-844e-dd202ab4f7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:15.556717 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039e5c5-2fb3-4e80-844e-dd202ab4f7c4 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:15.557432 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2039e5c5-2fb3-4e80-844e-dd202ab4f7c4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:15.557833 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2039e5c5-2fb3-4e80-844e-dd202ab4f7c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:15.559612 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2039e5c5-2fb3-4e80-844e-dd202ab4f7c4 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:15.566758 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 441/868] 10.222.0.33 () {56 vars in 1126 bytes} [Fri Sep 16 03:28:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:15.570336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff8e5c-0855-41b5-aa3d-1a19247cd96b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:15.572075 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039e5c5-2fb3-4e80-844e-dd202ab4f7c4 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:15.626524 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81691d9-c886-4c23-b8f5-9f731355a1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:15.628095 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81691d9-c886-4c23-b8f5-9f731355a1a5 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:15.628983 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81691d9-c886-4c23-b8f5-9f731355a1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:15.629444 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81691d9-c886-4c23-b8f5-9f731355a1a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:15.630842 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81691d9-c886-4c23-b8f5-9f731355a1a5 None admin] RBAC: Adding query filter params (role.id=4ffac54101e248479bcdc0e54890020f, scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2, user.id=9f784d98d5f440c681f53ae70f6d1cc7) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:15.631362 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81691d9-c886-4c23-b8f5-9f731355a1a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:15.634106 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81691d9-c886-4c23-b8f5-9f731355a1a5 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:15.642796 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 428/869] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:28:15 2022] GET /identity/v3/role_assignments?user.id=9f784d98d5f440c681f53ae70f6d1cc7&scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2&role.id=4ffac54101e248479bcdc0e54890020f => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:15.704049 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039e5c5-2fb3-4e80-844e-dd202ab4f7c4 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:15.734155 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:15.744111 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed00c9-1c3e-4b17-9937-b18f10601840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:15.744791 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed00c9-1c3e-4b17-9937-b18f10601840 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:15.745073 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed00c9-1c3e-4b17-9937-b18f10601840 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:15.745342 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed00c9-1c3e-4b17-9937-b18f10601840 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:15.746018 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed00c9-1c3e-4b17-9937-b18f10601840 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:15.746317 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed00c9-1c3e-4b17-9937-b18f10601840 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:15.747693 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed00c9-1c3e-4b17-9937-b18f10601840 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:15.753403 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 442/870] 10.222.0.33 () {56 vars in 1126 bytes} [Fri Sep 16 03:28:15 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:17.045120 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f2107-7fb8-4685-b77a-407996cb5ecb None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:17.045676 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f2107-7fb8-4685-b77a-407996cb5ecb None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:17.045676 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f2107-7fb8-4685-b77a-407996cb5ecb None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:17.047216 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 429/871] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:28:17.053132 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7c45b-c99b-4ac8-859e-56897311cc63 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:17.053526 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7c45b-c99b-4ac8-859e-56897311cc63 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:17.053745 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7c45b-c99b-4ac8-859e-56897311cc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:17.072506 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f6f7c45b-c99b-4ac8-859e-56897311cc63 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:17.074197 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f6f7c45b-c99b-4ac8-859e-56897311cc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:17.141869 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 443/872] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 03:28:17.404243 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f2107-7fb8-4685-b77a-407996cb5ecb None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:17.431975 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:17.510634 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f2107-7fb8-4685-b77a-407996cb5ecb None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:17.545987 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b9524-40af-4c63-ad28-3a855988ca1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:17.546622 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b9524-40af-4c63-ad28-3a855988ca1f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:17.546901 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b9524-40af-4c63-ad28-3a855988ca1f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:17.547175 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b9524-40af-4c63-ad28-3a855988ca1f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:17.557660 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b9524-40af-4c63-ad28-3a855988ca1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:28:17.562484 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-da4b9524-40af-4c63-ad28-3a855988ca1f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 03:28:17.562484 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:17.562484 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:17.562484 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:17.562484 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:17.562484 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:17.562484 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:17.562484 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:17.562484 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:17.562484 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:17.562484 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:17.562484 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:17.562484 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:28:17.562484 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:28:17.562484 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:28:17.562484 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:28:17.563388 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:28:17.563388 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:28:17.563388 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:28:17.563388 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:28:17.563388 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:17.563388 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:17.563388 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:17.563388 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:17.563388 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:17.563388 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:17.563388 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:17.563388 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:17.563388 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:17.563388 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:17.563388 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:17.563388 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:17.564210 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:17.564210 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:17.564210 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:17.564210 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:17.564210 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:28:17.564210 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:28:17.564210 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:28:17.564210 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:28:17.564210 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:28:17.564210 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:28:17.564210 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 03:28:17.564210 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:17.564210 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 430/873] 10.222.0.33 () {56 vars in 1120 bytes} [Fri Sep 16 03:28:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:17.570001 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7c45b-c99b-4ac8-859e-56897311cc63 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:17.679799 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7c45b-c99b-4ac8-859e-56897311cc63 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:17.687318 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:17.713884 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb4283-01f9-4a1d-9e98-99a0234b2b8a None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:17.714179 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb4283-01f9-4a1d-9e98-99a0234b2b8a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:17.714501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb4283-01f9-4a1d-9e98-99a0234b2b8a None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:17.717695 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134732ae-fc72-4f98-b03f-27764d0ea052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:17.718469 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134732ae-fc72-4f98-b03f-27764d0ea052 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:17.718905 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134732ae-fc72-4f98-b03f-27764d0ea052 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:17.719323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134732ae-fc72-4f98-b03f-27764d0ea052 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:17.720137 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134732ae-fc72-4f98-b03f-27764d0ea052 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:17.720538 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 431/874] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:28:17.720665 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134732ae-fc72-4f98-b03f-27764d0ea052 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:17.721958 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134732ae-fc72-4f98-b03f-27764d0ea052 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:17.722545 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e059fc-b4a9-4d5f-92d4-f6d853b4a978 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:17.723049 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e059fc-b4a9-4d5f-92d4-f6d853b4a978 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:17.723529 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e059fc-b4a9-4d5f-92d4-f6d853b4a978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:17.731354 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 444/875] 10.222.0.33 () {56 vars in 1115 bytes} [Fri Sep 16 03:28:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:17.737053 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134732ae-fc72-4f98-b03f-27764d0ea052 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:17.743563 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-23e059fc-b4a9-4d5f-92d4-f6d853b4a978 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:17.744830 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-23e059fc-b4a9-4d5f-92d4-f6d853b4a978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:17.841773 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 432/876] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 03:28:17.853027 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134732ae-fc72-4f98-b03f-27764d0ea052 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:17.897053 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7bcdf1-aad1-4d5b-8a13-a485e180da79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:17.897717 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bcdf1-aad1-4d5b-8a13-a485e180da79 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:17.898001 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bcdf1-aad1-4d5b-8a13-a485e180da79 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:17.898273 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bcdf1-aad1-4d5b-8a13-a485e180da79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:17.909476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7bcdf1-aad1-4d5b-8a13-a485e180da79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:17.910965 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7bcdf1-aad1-4d5b-8a13-a485e180da79 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:17.925818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-8e7bcdf1-aad1-4d5b-8a13-a485e180da79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:17.925818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:17.925818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:17.925818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:17.925818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:17.925818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:17.925818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:17.925818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:17.925818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:17.925818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:17.925818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:17.925818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:17.925818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:28:17.925818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:28:17.925818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:28:17.925818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:28:17.926771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:17.926771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:17.926771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:17.926771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:17.926771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:17.926771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:17.926771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:17.926771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:17.926771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:17.926771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:17.926771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:17.926771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:17.926771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:17.926771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:17.926771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:17.926771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:17.926771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:28:17.927709 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:28:17.927709 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:17.927709 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:17.927709 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 445/877] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:28:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:28:17.930795 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe23eba-2ad0-499a-8d20-e27673aaf9d0 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:17.931289 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe23eba-2ad0-499a-8d20-e27673aaf9d0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:17.932005 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe23eba-2ad0-499a-8d20-e27673aaf9d0 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:17.932778 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7bcdf1-aad1-4d5b-8a13-a485e180da79 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:17.934140 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 433/878] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:28:17.938953 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c72fe-14f4-46ba-875f-826c5840989b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:17.939483 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c72fe-14f4-46ba-875f-826c5840989b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:17.939947 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c72fe-14f4-46ba-875f-826c5840989b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:17.958099 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:17.961430 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ec9c72fe-14f4-46ba-875f-826c5840989b None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:17.962926 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ec9c72fe-14f4-46ba-875f-826c5840989b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:17.975346 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:18.035375 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 434/879] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:28:18.037175 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953d6ba-5a8c-4a3a-bb7f-4d4842ab4589 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:18.037480 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953d6ba-5a8c-4a3a-bb7f-4d4842ab4589 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:18.037775 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953d6ba-5a8c-4a3a-bb7f-4d4842ab4589 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:18.039148 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 435/880] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:28:18.044280 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabc132-4d45-4e25-96e9-26e4a92e9cae None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:18.044642 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabc132-4d45-4e25-96e9-26e4a92e9cae None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:18.044922 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabc132-4d45-4e25-96e9-26e4a92e9cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:18.048402 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7bcdf1-aad1-4d5b-8a13-a485e180da79 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:18.065563 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4dabc132-4d45-4e25-96e9-26e4a92e9cae None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:18.067506 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4dabc132-4d45-4e25-96e9-26e4a92e9cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:18.091227 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c955e683-f6f6-4237-af80-187b70b32965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:18.098694 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955e683-f6f6-4237-af80-187b70b32965 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:18.098694 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955e683-f6f6-4237-af80-187b70b32965 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:18.098694 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955e683-f6f6-4237-af80-187b70b32965 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:18.098694 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c955e683-f6f6-4237-af80-187b70b32965 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:18.098694 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c955e683-f6f6-4237-af80-187b70b32965 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:18.098694 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c955e683-f6f6-4237-af80-187b70b32965 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:18.113833 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 446/881] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:28:18.123235 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c955e683-f6f6-4237-af80-187b70b32965 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:18.146896 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 436/882] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 03:28:18.146896 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dabc132-4d45-4e25-96e9-26e4a92e9cae None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:18.231032 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:18.238789 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:18.254071 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dabc132-4d45-4e25-96e9-26e4a92e9cae None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:18.260752 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c955e683-f6f6-4237-af80-187b70b32965 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:18.290646 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8dc1f1-c7eb-4f70-aa3f-c2d17cb2aebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:18.291484 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8dc1f1-c7eb-4f70-aa3f-c2d17cb2aebd None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:18.291945 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8dc1f1-c7eb-4f70-aa3f-c2d17cb2aebd None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:18.292371 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8dc1f1-c7eb-4f70-aa3f-c2d17cb2aebd None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:18.293156 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8dc1f1-c7eb-4f70-aa3f-c2d17cb2aebd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:18.294712 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8dc1f1-c7eb-4f70-aa3f-c2d17cb2aebd None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:18.302512 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3704c384-4e1a-40bc-9cd4-79f72718b594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:18.303150 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704c384-4e1a-40bc-9cd4-79f72718b594 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:18.303433 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704c384-4e1a-40bc-9cd4-79f72718b594 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:18.303707 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704c384-4e1a-40bc-9cd4-79f72718b594 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:18.311096 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3704c384-4e1a-40bc-9cd4-79f72718b594 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:18.316281 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3704c384-4e1a-40bc-9cd4-79f72718b594 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:18.324533 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-3704c384-4e1a-40bc-9cd4-79f72718b594 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 03:28:18.324533 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:18.324533 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:18.324533 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:18.324533 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:18.324533 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:18.324533 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:18.324533 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:18.324533 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:18.324533 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:18.324533 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:18.324533 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:18.324533 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 03:28:18.324533 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 03:28:18.324533 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 03:28:18.324533 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 03:28:18.325448 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:18.325448 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:18.325448 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 03:28:18.325448 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:28:18.325448 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 03:28:18.325448 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:28:18.325448 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:18.325448 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:18.325448 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:18.325448 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:18.325448 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:18.325448 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:18.325448 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:18.325448 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:18.325448 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:18.325448 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:18.325448 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:18.325448 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:18.326431 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:18.326431 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:18.326431 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 03:28:18.326431 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 03:28:18.326431 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 03:28:18.326431 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 03:28:18.326431 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 03:28:18.326431 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 03:28:18.326431 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 03:28:18.326431 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:18.326431 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 447/883] 10.222.0.33 () {56 vars in 1117 bytes} [Fri Sep 16 03:28:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:18.326431 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3704c384-4e1a-40bc-9cd4-79f72718b594 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:18.378181 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 437/884] 10.222.0.33 () {60 vars in 1141 bytes} [Fri Sep 16 03:28:18 2022] POST /identity/v3/services => generated 251 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:28:18.379555 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8dc1f1-c7eb-4f70-aa3f-c2d17cb2aebd None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:18.435958 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3704c384-4e1a-40bc-9cd4-79f72718b594 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:18.481656 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c9a442-7035-473f-8fd7-904a682893ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:18.482224 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9a442-7035-473f-8fd7-904a682893ad None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:18.482506 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9a442-7035-473f-8fd7-904a682893ad None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:18.482780 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9a442-7035-473f-8fd7-904a682893ad None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:18.483382 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c9a442-7035-473f-8fd7-904a682893ad None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:18.484794 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c9a442-7035-473f-8fd7-904a682893ad None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:18.488144 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:18.495981 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-04c9a442-7035-473f-8fd7-904a682893ad None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 03:28:18.495981 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:18.495981 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 03:28:18.495981 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 03:28:18.495981 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 03:28:18.495981 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 03:28:18.495981 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 03:28:18.495981 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:28:18.495981 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 03:28:18.495981 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:18.495981 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 03:28:18.495981 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:18.495981 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:18.495981 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:18.495981 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:18.495981 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:18.495981 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:18.497121 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:18.497121 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:18.497121 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:18.497121 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:18.497121 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:18.497121 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:18.497121 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 03:28:18.497121 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 03:28:18.497121 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 03:28:18.497121 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 03:28:18.497121 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:18.497121 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:18.497121 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:18.497121 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:18.497121 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:18.497121 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:18.498307 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:18.498307 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:18.498307 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:18.498307 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:18.498307 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:18.498307 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:18.498307 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:18.498307 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:18.498307 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:18.498307 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:18.498307 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 03:28:18.498307 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:28:18.498307 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 03:28:18.498307 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:18.498307 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 448/885] 10.222.0.33 () {56 vars in 1126 bytes} [Fri Sep 16 03:28:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:18.499089 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c9a442-7035-473f-8fd7-904a682893ad None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:18.512709 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8dc1f1-c7eb-4f70-aa3f-c2d17cb2aebd None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:18.549753 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab32a1-4a39-4ffa-adf2-895738224bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:18.550422 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab32a1-4a39-4ffa-adf2-895738224bab None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:18.550703 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab32a1-4a39-4ffa-adf2-895738224bab None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:18.550976 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab32a1-4a39-4ffa-adf2-895738224bab None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:18.551727 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab32a1-4a39-4ffa-adf2-895738224bab None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:18.552034 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab32a1-4a39-4ffa-adf2-895738224bab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:18.554039 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab32a1-4a39-4ffa-adf2-895738224bab None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:18.557906 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:18.573580 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 438/886] 10.222.0.33 () {56 vars in 1149 bytes} [Fri Sep 16 03:28:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:18.574389 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab32a1-4a39-4ffa-adf2-895738224bab None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:18.615890 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c9a442-7035-473f-8fd7-904a682893ad None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:18.657618 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9d07f-dd0c-4e60-83f1-b9f51466cd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:18.658252 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9d07f-dd0c-4e60-83f1-b9f51466cd6e None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:18.658532 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9d07f-dd0c-4e60-83f1-b9f51466cd6e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:18.658804 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9d07f-dd0c-4e60-83f1-b9f51466cd6e None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:18.659454 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9d07f-dd0c-4e60-83f1-b9f51466cd6e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:18.660819 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9d07f-dd0c-4e60-83f1-b9f51466cd6e None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:18.685120 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab32a1-4a39-4ffa-adf2-895738224bab None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:18.721349 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6e15d-703a-4cc4-b4f8-a4ede8074621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:18.721982 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6e15d-703a-4cc4-b4f8-a4ede8074621 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:18.722279 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6e15d-703a-4cc4-b4f8-a4ede8074621 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:18.722530 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6e15d-703a-4cc4-b4f8-a4ede8074621 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:18.723145 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf6e15d-703a-4cc4-b4f8-a4ede8074621 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:18.723441 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf6e15d-703a-4cc4-b4f8-a4ede8074621 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:18.724841 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf6e15d-703a-4cc4-b4f8-a4ede8074621 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:18.729184 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 439/887] 10.222.0.33 () {56 vars in 1122 bytes} [Fri Sep 16 03:28:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:18.729985 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6e15d-703a-4cc4-b4f8-a4ede8074621 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:18.754002 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 449/888] 10.222.0.33 () {60 vars in 1141 bytes} [Fri Sep 16 03:28:18 2022] POST /identity/v3/services => generated 269 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:28:18.754002 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9d07f-dd0c-4e60-83f1-b9f51466cd6e None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:18.800535 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:18.824793 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:18.848844 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6e15d-703a-4cc4-b4f8-a4ede8074621 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:18.888789 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9d07f-dd0c-4e60-83f1-b9f51466cd6e None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:18.894064 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8191c-6e15-41f6-82fa-db5b80333f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:18.894789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8191c-6e15-41f6-82fa-db5b80333f90 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:18.897365 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8191c-6e15-41f6-82fa-db5b80333f90 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:18.897365 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8191c-6e15-41f6-82fa-db5b80333f90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:18.936982 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35247954-82f9-4786-bac7-75f522d4a3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:18.937565 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35247954-82f9-4786-bac7-75f522d4a3e6 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:18.937881 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35247954-82f9-4786-bac7-75f522d4a3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:18.938157 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35247954-82f9-4786-bac7-75f522d4a3e6 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:18.938846 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35247954-82f9-4786-bac7-75f522d4a3e6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:18.939150 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35247954-82f9-4786-bac7-75f522d4a3e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:18.940636 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35247954-82f9-4786-bac7-75f522d4a3e6 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:18.947272 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 450/889] 10.222.0.33 () {56 vars in 1122 bytes} [Fri Sep 16 03:28:18 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:18.979285 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a8191c-6e15-41f6-82fa-db5b80333f90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:18.980774 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a8191c-6e15-41f6-82fa-db5b80333f90 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:19.047307 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:19.096334 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 440/890] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:28:18 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 03:28:19.103402 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35247954-82f9-4786-bac7-75f522d4a3e6 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:19.217584 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35247954-82f9-4786-bac7-75f522d4a3e6 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:19.238315 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:19.253414 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf6c53-d273-4bf2-98f1-fbc6ce41d602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:19.254080 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf6c53-d273-4bf2-98f1-fbc6ce41d602 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:19.255435 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf6c53-d273-4bf2-98f1-fbc6ce41d602 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:19.255435 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf6c53-d273-4bf2-98f1-fbc6ce41d602 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:19.265934 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf6c53-d273-4bf2-98f1-fbc6ce41d602 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:19.267387 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf6c53-d273-4bf2-98f1-fbc6ce41d602 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:19.283292 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-4caf6c53-d273-4bf2-98f1-fbc6ce41d602 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:19.283292 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:19.283292 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:19.283292 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:19.283292 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:19.283292 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:19.283292 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:19.283292 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:19.283292 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:19.283292 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:19.283292 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:19.283292 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:19.283292 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:28:19.283292 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:28:19.283292 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:28:19.283292 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:28:19.284274 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:19.284274 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:19.284274 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:19.284274 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:19.284274 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:19.284274 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:19.284274 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:19.284274 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:19.284274 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:19.284274 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:19.284274 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:19.284274 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:19.284274 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:19.284274 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:19.284274 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:19.284274 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:19.284274 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:28:19.285793 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:28:19.285793 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:19.285793 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:19.285793 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 451/891] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:28:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:19.290753 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8191c-6e15-41f6-82fa-db5b80333f90 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:19.399073 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8191c-6e15-41f6-82fa-db5b80333f90 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:19.434722 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fb4b0-60f3-4738-8e70-bcde167a1a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:19.435338 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fb4b0-60f3-4738-8e70-bcde167a1a9e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:19.435619 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fb4b0-60f3-4738-8e70-bcde167a1a9e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:19.435893 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fb4b0-60f3-4738-8e70-bcde167a1a9e None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:19.436529 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440fb4b0-60f3-4738-8e70-bcde167a1a9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:19.436835 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440fb4b0-60f3-4738-8e70-bcde167a1a9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:19.438316 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440fb4b0-60f3-4738-8e70-bcde167a1a9e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:19.454299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 441/892] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:19.459502 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf6c53-d273-4bf2-98f1-fbc6ce41d602 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:19.570033 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf6c53-d273-4bf2-98f1-fbc6ce41d602 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:19.605217 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e4bff1-f69b-4f4d-8c55-0eb718f37784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:19.606159 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4bff1-f69b-4f4d-8c55-0eb718f37784 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:19.606586 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4bff1-f69b-4f4d-8c55-0eb718f37784 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:19.607022 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4bff1-f69b-4f4d-8c55-0eb718f37784 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:19.614025 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e4bff1-f69b-4f4d-8c55-0eb718f37784 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:19.615685 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e4bff1-f69b-4f4d-8c55-0eb718f37784 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:19.627305 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-62e4bff1-f69b-4f4d-8c55-0eb718f37784 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:28:19.627305 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:19.627305 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:19.627305 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:19.627305 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:19.627305 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:19.627305 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:19.627305 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:19.627305 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:19.627305 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:19.627305 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:19.627305 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:19.627305 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 03:28:19.627305 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 03:28:19.627305 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 03:28:19.628398 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 03:28:19.628398 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:19.628398 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:19.628398 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:19.628398 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:19.628398 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:19.628398 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:19.628398 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:19.628398 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:19.628398 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:19.628398 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:19.628398 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:19.628398 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:19.628398 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:19.628398 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:19.628398 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:19.628398 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:19.629511 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 03:28:19.629511 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 03:28:19.629511 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 03:28:19.629511 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 03:28:19.629511 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 03:28:19.629511 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 03:28:19.629511 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:28:19.629511 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:19.632064 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 452/893] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:28:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:19.641656 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fb4b0-60f3-4738-8e70-bcde167a1a9e None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:19.658060 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:19.747308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fb4b0-60f3-4738-8e70-bcde167a1a9e None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:19.784206 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c060ceda-9b41-40b9-8428-7b54d15c825d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:19.784813 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060ceda-9b41-40b9-8428-7b54d15c825d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:19.785090 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060ceda-9b41-40b9-8428-7b54d15c825d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:19.785358 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060ceda-9b41-40b9-8428-7b54d15c825d None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:19.786074 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c060ceda-9b41-40b9-8428-7b54d15c825d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:19.786375 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c060ceda-9b41-40b9-8428-7b54d15c825d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:19.788331 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c060ceda-9b41-40b9-8428-7b54d15c825d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:19.800769 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 442/894] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 03:28:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:19.806666 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e4bff1-f69b-4f4d-8c55-0eb718f37784 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:19.839756 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:19.910501 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e4bff1-f69b-4f4d-8c55-0eb718f37784 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:19.947583 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888fbff5-a350-4cb2-8a14-fb49aeae983c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:19.956176 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fbff5-a350-4cb2-8a14-fb49aeae983c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:19.956176 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fbff5-a350-4cb2-8a14-fb49aeae983c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:19.956176 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fbff5-a350-4cb2-8a14-fb49aeae983c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:19.956176 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888fbff5-a350-4cb2-8a14-fb49aeae983c None admin] RBAC: Adding query filter params (role.id=da747e5ab1c6405a97b406d925ebd4b4, scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2, user.id=b0812002d7b14bcb81a42eb380231feb) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:19.956176 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888fbff5-a350-4cb2-8a14-fb49aeae983c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:19.956176 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888fbff5-a350-4cb2-8a14-fb49aeae983c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:19.958054 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 453/895] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:28:19 2022] GET /identity/v3/role_assignments?user.id=b0812002d7b14bcb81a42eb380231feb&scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2&role.id=da747e5ab1c6405a97b406d925ebd4b4 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:20.578533 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1891e2-bbdf-4336-b982-f2b79b55f336 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:20.579081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1891e2-bbdf-4336-b982-f2b79b55f336 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:20.579081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1891e2-bbdf-4336-b982-f2b79b55f336 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:20.580636 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 443/896] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:28:20.586156 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ce456-1143-4ee5-8501-6e8557c0c64b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:20.586578 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ce456-1143-4ee5-8501-6e8557c0c64b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:20.586770 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ce456-1143-4ee5-8501-6e8557c0c64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:20.605168 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-169ce456-1143-4ee5-8501-6e8557c0c64b None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:20.606389 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-169ce456-1143-4ee5-8501-6e8557c0c64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:20.682355 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 454/897] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:20 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:28:20.954737 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1891e2-bbdf-4336-b982-f2b79b55f336 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:21.030109 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:21.054139 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1891e2-bbdf-4336-b982-f2b79b55f336 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:21.085231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5bd55-c343-47cd-96d5-87ea13caff83 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:21.085884 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5bd55-c343-47cd-96d5-87ea13caff83 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:21.086352 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5bd55-c343-47cd-96d5-87ea13caff83 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:21.088088 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 455/898] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:28:21.092081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3cdf0e-899f-450e-989d-357d727cbc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:21.092081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cdf0e-899f-450e-989d-357d727cbc3c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:21.092081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cdf0e-899f-450e-989d-357d727cbc3c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:21.092081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cdf0e-899f-450e-989d-357d727cbc3c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:21.092703 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3cdf0e-899f-450e-989d-357d727cbc3c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:21.093479 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd80e44-e437-44c6-838a-8962c1895f34 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:21.093825 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd80e44-e437-44c6-838a-8962c1895f34 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:21.093986 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3cdf0e-899f-450e-989d-357d727cbc3c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:21.094147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd80e44-e437-44c6-838a-8962c1895f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:21.103093 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-db3cdf0e-899f-450e-989d-357d727cbc3c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 03:28:21.103093 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:21.103093 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 03:28:21.103093 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 03:28:21.103093 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 03:28:21.103093 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 03:28:21.103093 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 03:28:21.103093 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:28:21.103093 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 03:28:21.103093 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:21.103093 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 03:28:21.103093 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:21.103093 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:21.103093 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:21.103093 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:21.103093 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:21.103093 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:21.104098 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:21.104098 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:21.104098 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:21.104098 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:21.104098 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:21.104098 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:21.104098 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 03:28:21.104098 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 03:28:21.104098 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 03:28:21.104098 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 03:28:21.104098 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:21.104098 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:21.104098 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:21.104098 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:21.104098 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:21.104098 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:21.104944 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:21.104944 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:21.104944 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:21.104944 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:21.104944 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:21.104944 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:21.104944 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:21.104944 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:21.104944 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:21.104944 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:21.104944 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 03:28:21.104944 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:28:21.104944 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 03:28:21.104944 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:21.104944 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 444/899] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 03:28:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:21.120634 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3cdf0e-899f-450e-989d-357d727cbc3c None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:21.122114 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0cd80e44-e437-44c6-838a-8962c1895f34 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:21.123694 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0cd80e44-e437-44c6-838a-8962c1895f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:21.149806 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:21.203737 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 456/900] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:21 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:28:21.244756 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3cdf0e-899f-450e-989d-357d727cbc3c None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:21.251794 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704872a-affa-4406-a0cf-411d96ced7d6 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:21.252083 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704872a-affa-4406-a0cf-411d96ced7d6 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:21.252357 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704872a-affa-4406-a0cf-411d96ced7d6 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:21.253966 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 457/901] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 03:28:21.259323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a220847-979e-4cfe-8f05-335185fe5de0 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:21.259602 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a220847-979e-4cfe-8f05-335185fe5de0 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:21.259881 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a220847-979e-4cfe-8f05-335185fe5de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:21.280252 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-5a220847-979e-4cfe-8f05-335185fe5de0 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:21.281322 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5a220847-979e-4cfe-8f05-335185fe5de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:21.286504 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f11cb4a-94ab-4e9b-b6b6-56c767ec42f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:21.287379 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11cb4a-94ab-4e9b-b6b6-56c767ec42f1 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:21.287841 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11cb4a-94ab-4e9b-b6b6-56c767ec42f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:21.288365 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11cb4a-94ab-4e9b-b6b6-56c767ec42f1 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:21.289588 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f11cb4a-94ab-4e9b-b6b6-56c767ec42f1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:21.290132 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f11cb4a-94ab-4e9b-b6b6-56c767ec42f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:21.292086 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f11cb4a-94ab-4e9b-b6b6-56c767ec42f1 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:21.299011 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 445/902] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 03:28:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:28:21.306585 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f11cb4a-94ab-4e9b-b6b6-56c767ec42f1 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:21.315919 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:21.366851 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 458/903] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:21 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 03:28:21.413931 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f11cb4a-94ab-4e9b-b6b6-56c767ec42f1 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:21.448221 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a00488-f156-4a4c-baf3-671979308427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:21.449093 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a00488-f156-4a4c-baf3-671979308427 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:21.449558 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a00488-f156-4a4c-baf3-671979308427 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:21.450039 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a00488-f156-4a4c-baf3-671979308427 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:21.450840 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a00488-f156-4a4c-baf3-671979308427 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:21.451323 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a00488-f156-4a4c-baf3-671979308427 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:21.452885 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a00488-f156-4a4c-baf3-671979308427 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:21.458824 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 446/904] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 03:28:21 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:21.466717 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a220847-979e-4cfe-8f05-335185fe5de0 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:21.485182 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a00488-f156-4a4c-baf3-671979308427 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:21.567246 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:21.574198 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:21.590727 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a220847-979e-4cfe-8f05-335185fe5de0 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:21.607974 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a00488-f156-4a4c-baf3-671979308427 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:21.629664 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710f380-a3a8-42e8-9996-88b3db04c356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:21.630331 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710f380-a3a8-42e8-9996-88b3db04c356 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:21.630932 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710f380-a3a8-42e8-9996-88b3db04c356 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:21.631251 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710f380-a3a8-42e8-9996-88b3db04c356 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:21.632053 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b710f380-a3a8-42e8-9996-88b3db04c356 None admin] RBAC: Adding query filter params (interface=public, service_id=853e2b5124ad4522881144d7f34d9a52, region_id=RegionOne) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:21.632350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b710f380-a3a8-42e8-9996-88b3db04c356 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:21.633929 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b710f380-a3a8-42e8-9996-88b3db04c356 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:21.641793 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 459/905] 10.222.0.33 () {56 vars in 1251 bytes} [Fri Sep 16 03:28:21 2022] GET /identity/v3/endpoints?service_id=853e2b5124ad4522881144d7f34d9a52&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:21.646292 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710f380-a3a8-42e8-9996-88b3db04c356 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:21.652375 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c638f977-a13c-46a5-8c71-2e91bfe6e7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:21.653067 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638f977-a13c-46a5-8c71-2e91bfe6e7b8 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:21.653349 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638f977-a13c-46a5-8c71-2e91bfe6e7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:21.653621 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638f977-a13c-46a5-8c71-2e91bfe6e7b8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:21.654551 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c638f977-a13c-46a5-8c71-2e91bfe6e7b8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:21.655905 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c638f977-a13c-46a5-8c71-2e91bfe6e7b8 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:21.665701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-c638f977-a13c-46a5-8c71-2e91bfe6e7b8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 03:28:21.665701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:21.665701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 03:28:21.665701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 03:28:21.665701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 03:28:21.665701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 03:28:21.665701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 03:28:21.665701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:28:21.665701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 03:28:21.665701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:21.665701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 03:28:21.665701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:21.665701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:21.665701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:21.665701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:21.665701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:21.666637 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:21.666637 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:21.666637 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:21.666637 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:21.666637 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:21.666637 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:21.666637 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:21.666637 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 03:28:21.666637 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 03:28:21.666637 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 03:28:21.666637 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 03:28:21.666637 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:21.666637 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:21.666637 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:21.666637 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:21.666637 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:21.666637 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:21.667538 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:21.667538 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:21.667538 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:21.667538 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:21.667538 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:21.667538 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:21.667538 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:21.667538 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:21.667538 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:21.667538 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:21.667538 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 03:28:21.667538 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:28:21.667538 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 03:28:21.667538 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:21.667538 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 447/906] 10.222.0.33 () {56 vars in 1132 bytes} [Fri Sep 16 03:28:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:28:21.668373 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c638f977-a13c-46a5-8c71-2e91bfe6e7b8 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:21.771900 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c638f977-a13c-46a5-8c71-2e91bfe6e7b8 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:21.772229 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710f380-a3a8-42e8-9996-88b3db04c356 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:21.805804 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2cdf72-8d63-4f7a-8afa-da25b8ab1b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:21.806422 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2cdf72-8d63-4f7a-8afa-da25b8ab1b1f None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:21.806695 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2cdf72-8d63-4f7a-8afa-da25b8ab1b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:21.806975 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2cdf72-8d63-4f7a-8afa-da25b8ab1b1f None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:21.807638 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2cdf72-8d63-4f7a-8afa-da25b8ab1b1f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:21.809016 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2cdf72-8d63-4f7a-8afa-da25b8ab1b1f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:21.812366 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:21.815691 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c973c-5237-445a-91f6-372c65b35cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:21.816293 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c973c-5237-445a-91f6-372c65b35cfb None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:21.816571 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c973c-5237-445a-91f6-372c65b35cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:21.816841 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c973c-5237-445a-91f6-372c65b35cfb None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:21.817494 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c973c-5237-445a-91f6-372c65b35cfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:21.819342 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c973c-5237-445a-91f6-372c65b35cfb None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:21.824858 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 460/907] 10.222.0.33 () {56 vars in 1087 bytes} [Fri Sep 16 03:28:21 2022] GET /identity/v3/services => generated 1268 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:28:21.825624 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c973c-5237-445a-91f6-372c65b35cfb None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:21.845556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:21.934526 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c973c-5237-445a-91f6-372c65b35cfb None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:21.971113 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36740e-bd86-43f5-8361-27f605faab60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:21.971818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36740e-bd86-43f5-8361-27f605faab60 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:21.972098 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36740e-bd86-43f5-8361-27f605faab60 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:21.972366 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36740e-bd86-43f5-8361-27f605faab60 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:21.973002 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36740e-bd86-43f5-8361-27f605faab60 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:21.973385 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36740e-bd86-43f5-8361-27f605faab60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:21.975334 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36740e-bd86-43f5-8361-27f605faab60 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:21.985582 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 461/908] 10.222.0.33 () {56 vars in 1126 bytes} [Fri Sep 16 03:28:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:21.986390 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36740e-bd86-43f5-8361-27f605faab60 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:22.010154 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 448/909] 10.222.0.33 () {60 vars in 1141 bytes} [Fri Sep 16 03:28:21 2022] POST /identity/v3/services => generated 241 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:28:22.096222 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:22.120740 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36740e-bd86-43f5-8361-27f605faab60 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:22.171036 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1423435-fe5b-4388-812e-da6159f4f47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:22.172040 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1423435-fe5b-4388-812e-da6159f4f47e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:22.172635 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1423435-fe5b-4388-812e-da6159f4f47e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:22.173112 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1423435-fe5b-4388-812e-da6159f4f47e None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:22.173994 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1423435-fe5b-4388-812e-da6159f4f47e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:22.174507 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1423435-fe5b-4388-812e-da6159f4f47e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:22.176113 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1423435-fe5b-4388-812e-da6159f4f47e None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:22.183048 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 462/910] 10.222.0.33 () {56 vars in 1126 bytes} [Fri Sep 16 03:28:21 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:28:22.186646 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d058ff7-2fbd-41d6-afbd-93bf4924467f None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:22.187151 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d058ff7-2fbd-41d6-afbd-93bf4924467f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:22.187628 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d058ff7-2fbd-41d6-afbd-93bf4924467f None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:22.188366 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1423435-fe5b-4388-812e-da6159f4f47e None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:22.189550 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 449/911] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:28:22.195458 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6103a5e-20bb-4cf1-8d71-1f792767d028 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:22.195744 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6103a5e-20bb-4cf1-8d71-1f792767d028 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:22.196018 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6103a5e-20bb-4cf1-8d71-1f792767d028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:22.217597 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a6103a5e-20bb-4cf1-8d71-1f792767d028 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:22.218775 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a6103a5e-20bb-4cf1-8d71-1f792767d028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:22.304998 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 450/912] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:28:22.326179 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1423435-fe5b-4388-812e-da6159f4f47e None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:22.363519 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c1c94-f5b4-4088-94ee-f1b710e6d9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:22.364509 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c1c94-f5b4-4088-94ee-f1b710e6d9bd None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:22.365008 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c1c94-f5b4-4088-94ee-f1b710e6d9bd None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:22.365480 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c1c94-f5b4-4088-94ee-f1b710e6d9bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:22.366402 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c1c94-f5b4-4088-94ee-f1b710e6d9bd None admin] RBAC: Adding query filter params (interface=public, service_id=8a08f1aa80f34c8f96e36b0fc796ce32, region_id=RegionOne) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:22.366909 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c1c94-f5b4-4088-94ee-f1b710e6d9bd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:22.368472 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c1c94-f5b4-4088-94ee-f1b710e6d9bd None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:22.374591 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 463/913] 10.222.0.33 () {56 vars in 1251 bytes} [Fri Sep 16 03:28:22 2022] GET /identity/v3/endpoints?service_id=8a08f1aa80f34c8f96e36b0fc796ce32&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:22.380056 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6103a5e-20bb-4cf1-8d71-1f792767d028 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:22.486619 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6103a5e-20bb-4cf1-8d71-1f792767d028 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:22.511866 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:22.523354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60562bd-43c4-46e8-96f8-b7d4c11df695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:22.529121 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60562bd-43c4-46e8-96f8-b7d4c11df695 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:22.529121 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60562bd-43c4-46e8-96f8-b7d4c11df695 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:22.529121 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60562bd-43c4-46e8-96f8-b7d4c11df695 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:22.529121 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60562bd-43c4-46e8-96f8-b7d4c11df695 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:22.529121 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60562bd-43c4-46e8-96f8-b7d4c11df695 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:22.533038 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 451/914] 10.222.0.33 () {56 vars in 1087 bytes} [Fri Sep 16 03:28:22 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:28:22.584578 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c1c94-f5b4-4088-94ee-f1b710e6d9bd None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:22.587626 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:22.697932 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c1c94-f5b4-4088-94ee-f1b710e6d9bd None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:22.735188 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab5fad-8d67-4757-888e-8cdbe98753a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:22.735827 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab5fad-8d67-4757-888e-8cdbe98753a7 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:22.736106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab5fad-8d67-4757-888e-8cdbe98753a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:22.736380 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab5fad-8d67-4757-888e-8cdbe98753a7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:22.747098 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab5fad-8d67-4757-888e-8cdbe98753a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:28:22.752415 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-25ab5fad-8d67-4757-888e-8cdbe98753a7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 03:28:22.752415 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:22.752415 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:22.752415 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:22.752415 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:22.752415 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:22.752415 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:22.752415 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:22.752415 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:22.752415 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:22.752415 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:22.752415 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:22.752415 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:28:22.752415 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:28:22.752415 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:28:22.752415 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:28:22.753325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:28:22.753325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:28:22.753325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:28:22.753325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:28:22.753325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:22.753325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:22.753325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:22.753325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:22.753325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:22.753325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:22.753325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:22.753325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:22.753325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:22.753325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:22.753325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:22.753325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:22.754198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:22.754198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:22.754198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:22.754198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:22.754198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:28:22.754198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:28:22.754198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:28:22.754198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:28:22.754198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:28:22.754198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:28:22.754198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 03:28:22.754198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:22.754198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 464/915] 10.222.0.33 () {56 vars in 1120 bytes} [Fri Sep 16 03:28:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:22.759932 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60562bd-43c4-46e8-96f8-b7d4c11df695 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:22.869066 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60562bd-43c4-46e8-96f8-b7d4c11df695 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:22.904728 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7aa3b2-2925-4b56-a5cc-26a60f4aa4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:22.905336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7aa3b2-2925-4b56-a5cc-26a60f4aa4e5 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:22.905616 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7aa3b2-2925-4b56-a5cc-26a60f4aa4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:22.905917 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7aa3b2-2925-4b56-a5cc-26a60f4aa4e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:22.906580 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7aa3b2-2925-4b56-a5cc-26a60f4aa4e5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:22.906880 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7aa3b2-2925-4b56-a5cc-26a60f4aa4e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:22.908253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7aa3b2-2925-4b56-a5cc-26a60f4aa4e5 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:22.917596 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 452/916] 10.222.0.33 () {56 vars in 1115 bytes} [Fri Sep 16 03:28:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:28:22.922883 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab5fad-8d67-4757-888e-8cdbe98753a7 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:22.986766 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:23.027787 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab5fad-8d67-4757-888e-8cdbe98753a7 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:23.063778 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43986846-d250-48fd-ab61-5478dc0e8ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:23.064403 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43986846-d250-48fd-ab61-5478dc0e8ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:23.064679 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43986846-d250-48fd-ab61-5478dc0e8ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:23.064948 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43986846-d250-48fd-ab61-5478dc0e8ad1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:23.075649 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43986846-d250-48fd-ab61-5478dc0e8ad1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:23.077069 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43986846-d250-48fd-ab61-5478dc0e8ad1 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:23.091558 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-43986846-d250-48fd-ab61-5478dc0e8ad1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:23.091558 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:23.091558 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:23.091558 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:23.091558 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:23.091558 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:23.091558 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:23.091558 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:23.091558 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:23.091558 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:23.091558 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:23.091558 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:23.091558 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:28:23.091558 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:28:23.091558 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:28:23.091558 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:28:23.093742 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:23.093742 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:23.093742 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:23.093742 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:23.093742 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:23.093742 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:23.093742 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:23.093742 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:23.093742 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:23.093742 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:23.093742 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:23.093742 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:23.093742 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:23.093742 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:23.093742 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:23.093742 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:23.093742 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:28:23.095836 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:28:23.095836 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:23.095836 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:23.095836 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 465/917] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:28:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:28:23.098467 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7aa3b2-2925-4b56-a5cc-26a60f4aa4e5 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:23.151184 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:23.202664 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7aa3b2-2925-4b56-a5cc-26a60f4aa4e5 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:23.237266 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e670784-0891-441d-bbaa-ce5a0d2fb9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:23.237834 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e670784-0891-441d-bbaa-ce5a0d2fb9b8 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:23.238126 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e670784-0891-441d-bbaa-ce5a0d2fb9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:23.238406 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e670784-0891-441d-bbaa-ce5a0d2fb9b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:23.239047 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e670784-0891-441d-bbaa-ce5a0d2fb9b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:23.239352 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e670784-0891-441d-bbaa-ce5a0d2fb9b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:23.241252 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e670784-0891-441d-bbaa-ce5a0d2fb9b8 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:23.253731 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 453/918] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:28:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:23.258987 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43986846-d250-48fd-ab61-5478dc0e8ad1 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:23.367183 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43986846-d250-48fd-ab61-5478dc0e8ad1 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:23.381624 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:23.409398 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212b8f8-44ce-4d84-a6db-73ede5f92ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:23.410066 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212b8f8-44ce-4d84-a6db-73ede5f92ffe None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:23.410342 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212b8f8-44ce-4d84-a6db-73ede5f92ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:23.410623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212b8f8-44ce-4d84-a6db-73ede5f92ffe None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:23.419503 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6212b8f8-44ce-4d84-a6db-73ede5f92ffe None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:23.420938 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6212b8f8-44ce-4d84-a6db-73ede5f92ffe None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:23.432328 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-6212b8f8-44ce-4d84-a6db-73ede5f92ffe None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 03:28:23.432328 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:23.432328 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:23.432328 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:23.432328 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:23.432328 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:23.432328 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:23.432328 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:23.432328 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:23.432328 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:23.432328 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:23.432328 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:23.432328 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 03:28:23.432328 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 03:28:23.432328 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 03:28:23.432328 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 03:28:23.434595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:23.434595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:23.434595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 03:28:23.434595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:28:23.434595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 03:28:23.434595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:28:23.434595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:23.434595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:23.434595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:23.434595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:23.434595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:23.434595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:23.434595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:23.434595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:23.434595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:23.434595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:23.434595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:23.434595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:23.436877 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:23.436877 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:23.436877 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 03:28:23.436877 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 03:28:23.436877 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 03:28:23.436877 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 03:28:23.436877 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 03:28:23.436877 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 03:28:23.436877 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 03:28:23.436877 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:23.436877 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 466/919] 10.222.0.33 () {56 vars in 1117 bytes} [Fri Sep 16 03:28:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:23.441731 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e670784-0891-441d-bbaa-ce5a0d2fb9b8 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:23.542597 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e670784-0891-441d-bbaa-ce5a0d2fb9b8 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:23.553407 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:23.576646 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da16b8-50dc-45ab-b890-edcfa8bdbe37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:23.577261 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da16b8-50dc-45ab-b890-edcfa8bdbe37 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:23.577548 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da16b8-50dc-45ab-b890-edcfa8bdbe37 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:23.577864 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da16b8-50dc-45ab-b890-edcfa8bdbe37 None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:23.578727 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90da16b8-50dc-45ab-b890-edcfa8bdbe37 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:23.579119 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90da16b8-50dc-45ab-b890-edcfa8bdbe37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:23.580549 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90da16b8-50dc-45ab-b890-edcfa8bdbe37 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:23.602912 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 454/920] 10.222.0.33 () {56 vars in 1149 bytes} [Fri Sep 16 03:28:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:23.610961 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212b8f8-44ce-4d84-a6db-73ede5f92ffe None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:23.719103 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212b8f8-44ce-4d84-a6db-73ede5f92ffe None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:23.755160 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b07736-1dcc-4727-9594-f26b5847c3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:23.755801 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b07736-1dcc-4727-9594-f26b5847c3b7 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:23.756085 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b07736-1dcc-4727-9594-f26b5847c3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:23.756360 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b07736-1dcc-4727-9594-f26b5847c3b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:23.767494 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b07736-1dcc-4727-9594-f26b5847c3b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:23.768942 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b07736-1dcc-4727-9594-f26b5847c3b7 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:23.784582 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-c9b07736-1dcc-4727-9594-f26b5847c3b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:23.784582 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:23.784582 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:23.784582 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:23.784582 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:23.784582 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:23.784582 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:23.784582 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:23.784582 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:23.784582 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:23.784582 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:23.784582 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:23.784582 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:28:23.784582 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:28:23.784582 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:28:23.784582 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:28:23.785560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:23.785560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:23.785560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:23.785560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:23.785560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:23.785560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:23.785560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:23.785560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:23.785560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:23.785560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:23.785560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:23.785560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:23.785560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:23.785560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:23.785560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:23.785560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:23.785560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:28:23.786587 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:28:23.786587 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:23.786587 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:23.786587 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 467/921] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:28:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:23.791861 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da16b8-50dc-45ab-b890-edcfa8bdbe37 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:23.900524 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da16b8-50dc-45ab-b890-edcfa8bdbe37 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:23.935437 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2701a93-7696-484f-a21d-41d9266f91d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:23.936054 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2701a93-7696-484f-a21d-41d9266f91d1 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:23.936332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2701a93-7696-484f-a21d-41d9266f91d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:23.936604 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2701a93-7696-484f-a21d-41d9266f91d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:23.937239 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2701a93-7696-484f-a21d-41d9266f91d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:23.937543 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2701a93-7696-484f-a21d-41d9266f91d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:23.938931 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2701a93-7696-484f-a21d-41d9266f91d1 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:23.951019 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 455/922] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:28:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:23.956377 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b07736-1dcc-4727-9594-f26b5847c3b7 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:23.986893 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:24.067311 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b07736-1dcc-4727-9594-f26b5847c3b7 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:24.107038 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc4ef9-9858-4711-b757-3a3857b3ed7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:24.107918 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc4ef9-9858-4711-b757-3a3857b3ed7c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:24.108385 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc4ef9-9858-4711-b757-3a3857b3ed7c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:24.108806 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc4ef9-9858-4711-b757-3a3857b3ed7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:24.116078 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc4ef9-9858-4711-b757-3a3857b3ed7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:24.117714 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc4ef9-9858-4711-b757-3a3857b3ed7c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:24.129441 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-57cc4ef9-9858-4711-b757-3a3857b3ed7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:28:24.129441 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:24.129441 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:24.129441 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:24.129441 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:24.129441 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:24.129441 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:24.129441 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:24.129441 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:24.129441 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:24.129441 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:24.129441 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:24.129441 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 03:28:24.129441 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 03:28:24.129441 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 03:28:24.131106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 03:28:24.131106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:24.131106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:24.131106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:24.131106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:24.131106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:24.131106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:24.131106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:24.131106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:24.131106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:24.131106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:24.131106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:24.131106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:24.131106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:24.131106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:24.131106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:24.131106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:24.132114 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 03:28:24.132114 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 03:28:24.132114 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 03:28:24.132114 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 03:28:24.132114 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 03:28:24.132114 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 03:28:24.132114 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:28:24.132114 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:24.134062 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 468/923] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:28:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:24.139983 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2701a93-7696-484f-a21d-41d9266f91d1 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:24.170336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:24.178437 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb15308-607a-4e3c-91d0-4f06f1e284f3 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:24.178921 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb15308-607a-4e3c-91d0-4f06f1e284f3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:24.179068 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb15308-607a-4e3c-91d0-4f06f1e284f3 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:24.180645 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 469/924] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 03:28:24.190875 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb56f3e-686f-4825-9fce-9dac1706496a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:24.191447 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb56f3e-686f-4825-9fce-9dac1706496a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:24.191918 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb56f3e-686f-4825-9fce-9dac1706496a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:24.210382 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4bb56f3e-686f-4825-9fce-9dac1706496a None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:24.211873 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4bb56f3e-686f-4825-9fce-9dac1706496a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:24.254629 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2701a93-7696-484f-a21d-41d9266f91d1 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:24.294743 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc76abb-cb71-4575-b99f-abfd8be6fdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:24.295833 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc76abb-cb71-4575-b99f-abfd8be6fdff None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:24.297044 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc76abb-cb71-4575-b99f-abfd8be6fdff None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:24.297749 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc76abb-cb71-4575-b99f-abfd8be6fdff None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:24.300000 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc76abb-cb71-4575-b99f-abfd8be6fdff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:24.300552 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc76abb-cb71-4575-b99f-abfd8be6fdff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:24.303299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc76abb-cb71-4575-b99f-abfd8be6fdff None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:24.304577 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 470/925] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 03:28:24.331438 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 456/926] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 03:28:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:24.337415 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb56f3e-686f-4825-9fce-9dac1706496a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:24.357220 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:24.423191 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0068260-8702-4221-b084-c3a254db2973 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:24.423512 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0068260-8702-4221-b084-c3a254db2973 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:24.423683 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0068260-8702-4221-b084-c3a254db2973 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:24.429167 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 457/927] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:28:24.431028 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f8230-e2f7-443d-9512-15a6e9c96d1e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:24.431655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f8230-e2f7-443d-9512-15a6e9c96d1e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:24.432134 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f8230-e2f7-443d-9512-15a6e9c96d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:24.447700 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb56f3e-686f-4825-9fce-9dac1706496a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:24.451712 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-974f8230-e2f7-443d-9512-15a6e9c96d1e None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:24.453156 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-974f8230-e2f7-443d-9512-15a6e9c96d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:24.484871 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd1d8f-0d6d-4b29-962c-d5c622a510e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:24.485574 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd1d8f-0d6d-4b29-962c-d5c622a510e0 None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:24.485886 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd1d8f-0d6d-4b29-962c-d5c622a510e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:24.486165 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd1d8f-0d6d-4b29-962c-d5c622a510e0 None admin] PATH_INFO: `/v3/projects/a0e46c2a2c62402dbf6d8461204b47d2/users/b0812002d7b14bcb81a42eb380231feb/roles/da747e5ab1c6405a97b406d925ebd4b4` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:24.488366 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd1d8f-0d6d-4b29-962c-d5c622a510e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=a0e46c2a2c62402dbf6d8461204b47d2, user_id=b0812002d7b14bcb81a42eb380231feb, role_id=da747e5ab1c6405a97b406d925ebd4b4)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:24.491193 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd1d8f-0d6d-4b29-962c-d5c622a510e0 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:24.531445 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 458/928] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:28:24.583258 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f8230-e2f7-443d-9512-15a6e9c96d1e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:24.596217 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 471/929] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 03:28:24 2022] PUT /identity/v3/projects/a0e46c2a2c62402dbf6d8461204b47d2/users/b0812002d7b14bcb81a42eb380231feb/roles/da747e5ab1c6405a97b406d925ebd4b4 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:28:24.610739 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:24.717101 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f8230-e2f7-443d-9512-15a6e9c96d1e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:24.758567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20445f8d-fa08-4816-a127-82e21c3b6174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:24.759227 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20445f8d-fa08-4816-a127-82e21c3b6174 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:24.759504 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20445f8d-fa08-4816-a127-82e21c3b6174 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:24.759775 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20445f8d-fa08-4816-a127-82e21c3b6174 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:24.760364 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20445f8d-fa08-4816-a127-82e21c3b6174 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:24.761782 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20445f8d-fa08-4816-a127-82e21c3b6174 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:24.773616 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-20445f8d-fa08-4816-a127-82e21c3b6174 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 03:28:24.773616 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:24.773616 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 03:28:24.773616 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 03:28:24.773616 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 03:28:24.773616 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 03:28:24.773616 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 03:28:24.773616 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:28:24.773616 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 03:28:24.773616 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:24.773616 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 03:28:24.773616 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:24.773616 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:24.773616 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:24.773616 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:24.773616 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:24.773616 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:24.774681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:24.774681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:24.774681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:24.774681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:24.774681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:24.774681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:24.774681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 03:28:24.774681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 03:28:24.774681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 03:28:24.774681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 03:28:24.774681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:24.774681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:24.774681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:24.774681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:24.774681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:24.774681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:24.775518 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:24.775518 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:24.775518 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:24.775518 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:24.775518 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:24.775518 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:24.775518 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:24.775518 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:24.775518 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:24.775518 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:24.775518 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 03:28:24.775518 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:28:24.775518 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 03:28:24.775518 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:24.775518 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 459/930] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 03:28:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:28:24.782789 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd1d8f-0d6d-4b29-962c-d5c622a510e0 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:24.820473 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d70336-afd6-4a66-95d4-59a551819382 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:24.820984 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d70336-afd6-4a66-95d4-59a551819382 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:24.820984 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d70336-afd6-4a66-95d4-59a551819382 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:24.823666 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 460/931] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 03:28:24.827675 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a0fb1-b1cd-4ce5-b0fe-f4fda79bdde8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:24.827964 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a0fb1-b1cd-4ce5-b0fe-f4fda79bdde8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:24.828246 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a0fb1-b1cd-4ce5-b0fe-f4fda79bdde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:24.847787 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d68a0fb1-b1cd-4ce5-b0fe-f4fda79bdde8 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:24.850036 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d68a0fb1-b1cd-4ce5-b0fe-f4fda79bdde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:24.875359 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:24.900174 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd1d8f-0d6d-4b29-962c-d5c622a510e0 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:24.926105 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 461/932] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 03:28:24.926105 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a0fb1-b1cd-4ce5-b0fe-f4fda79bdde8 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:24.943947 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c485976-6551-4590-88b7-7ba32da44e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:24.944199 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:24.945529 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c485976-6551-4590-88b7-7ba32da44e88 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:24.946027 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c485976-6551-4590-88b7-7ba32da44e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:24.946482 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c485976-6551-4590-88b7-7ba32da44e88 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:24.947265 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c485976-6551-4590-88b7-7ba32da44e88 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:24.947891 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c485976-6551-4590-88b7-7ba32da44e88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:24.949805 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c485976-6551-4590-88b7-7ba32da44e88 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:24.956880 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 472/933] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 03:28:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:24.968026 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c485976-6551-4590-88b7-7ba32da44e88 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:25.052533 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a0fb1-b1cd-4ce5-b0fe-f4fda79bdde8 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:25.083505 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c485976-6551-4590-88b7-7ba32da44e88 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:25.095348 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f12e8-39fa-4611-bf0b-9b59357a9318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:25.096472 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f12e8-39fa-4611-bf0b-9b59357a9318 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:25.096868 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f12e8-39fa-4611-bf0b-9b59357a9318 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:25.097252 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f12e8-39fa-4611-bf0b-9b59357a9318 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:25.098261 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f12e8-39fa-4611-bf0b-9b59357a9318 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:25.100450 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f12e8-39fa-4611-bf0b-9b59357a9318 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:25.117657 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-1f6f12e8-39fa-4611-bf0b-9b59357a9318 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 03:28:25.117657 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:25.117657 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 03:28:25.117657 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 03:28:25.117657 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 03:28:25.117657 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 03:28:25.117657 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 03:28:25.117657 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:28:25.117657 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 03:28:25.117657 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:25.117657 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 03:28:25.117657 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:25.117657 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:25.117657 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:25.117657 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:25.117657 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:25.117657 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:25.118711 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:25.118711 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:25.118711 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:25.118711 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:25.118711 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:25.118711 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:25.118711 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 03:28:25.118711 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 03:28:25.118711 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 03:28:25.118711 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 03:28:25.118711 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:25.118711 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:25.118711 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:25.118711 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:25.118711 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:25.118711 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:25.119566 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:25.119566 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:25.119566 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:25.119566 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:25.119566 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:25.119566 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:25.119566 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:25.119566 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:25.119566 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:25.119566 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:25.119566 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 03:28:25.119566 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:28:25.119566 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 03:28:25.119566 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:25.119566 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 462/934] 10.222.0.33 () {56 vars in 1126 bytes} [Fri Sep 16 03:28:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:25.120350 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f12e8-39fa-4611-bf0b-9b59357a9318 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:25.127816 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f794d4-0fe3-4c1e-bf0e-36af61bffded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:25.128539 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f794d4-0fe3-4c1e-bf0e-36af61bffded None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:25.128917 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f794d4-0fe3-4c1e-bf0e-36af61bffded None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:25.129284 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f794d4-0fe3-4c1e-bf0e-36af61bffded None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:25.130586 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f794d4-0fe3-4c1e-bf0e-36af61bffded None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:25.130988 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f794d4-0fe3-4c1e-bf0e-36af61bffded None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:25.132894 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f794d4-0fe3-4c1e-bf0e-36af61bffded None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:25.139305 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 473/935] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 03:28:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:28:25.144768 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f794d4-0fe3-4c1e-bf0e-36af61bffded None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:25.148896 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:25.211011 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:25.229367 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f12e8-39fa-4611-bf0b-9b59357a9318 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:25.263894 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f794d4-0fe3-4c1e-bf0e-36af61bffded None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:25.264737 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38f303-7257-494e-a474-503ec2d1ee0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:25.265348 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38f303-7257-494e-a474-503ec2d1ee0d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:25.265677 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38f303-7257-494e-a474-503ec2d1ee0d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:25.265917 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38f303-7257-494e-a474-503ec2d1ee0d None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:25.267164 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38f303-7257-494e-a474-503ec2d1ee0d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:25.267164 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38f303-7257-494e-a474-503ec2d1ee0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:25.268180 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38f303-7257-494e-a474-503ec2d1ee0d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:25.277904 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 463/936] 10.222.0.33 () {56 vars in 1122 bytes} [Fri Sep 16 03:28:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:28:25.277904 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38f303-7257-494e-a474-503ec2d1ee0d None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:25.306578 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8990d0-efc1-49b5-9275-f5e65a2f0a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:25.307188 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8990d0-efc1-49b5-9275-f5e65a2f0a9d None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:25.307467 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8990d0-efc1-49b5-9275-f5e65a2f0a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:25.307755 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8990d0-efc1-49b5-9275-f5e65a2f0a9d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:25.308414 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8990d0-efc1-49b5-9275-f5e65a2f0a9d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:25.309798 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8990d0-efc1-49b5-9275-f5e65a2f0a9d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:25.372978 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 474/937] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:28:25 2022] POST /identity/v3/endpoints => generated 346 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:28:25.372978 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8990d0-efc1-49b5-9275-f5e65a2f0a9d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:25.377251 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38f303-7257-494e-a474-503ec2d1ee0d None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:25.434188 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b13a7d-2ddf-4476-b5b4-fd9a78a93e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:25.434954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b13a7d-2ddf-4476-b5b4-fd9a78a93e69 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:25.435331 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b13a7d-2ddf-4476-b5b4-fd9a78a93e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:25.435678 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b13a7d-2ddf-4476-b5b4-fd9a78a93e69 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:25.436419 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b13a7d-2ddf-4476-b5b4-fd9a78a93e69 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:25.438016 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b13a7d-2ddf-4476-b5b4-fd9a78a93e69 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:25.441546 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:25.448623 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-f1b13a7d-2ddf-4476-b5b4-fd9a78a93e69 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 03:28:25.448623 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:25.448623 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 03:28:25.448623 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 03:28:25.448623 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 03:28:25.448623 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 03:28:25.448623 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 03:28:25.448623 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:28:25.448623 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 03:28:25.448623 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:25.448623 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 03:28:25.448623 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:25.448623 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:25.448623 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:25.448623 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:25.448623 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:25.449655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:25.449655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:25.449655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:25.449655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:25.449655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:25.449655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:25.449655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:25.449655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 03:28:25.449655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 03:28:25.449655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 03:28:25.449655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 03:28:25.449655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:25.449655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:25.449655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:25.449655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:25.449655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:25.449655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:25.450672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:25.450672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:25.450672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:25.450672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:25.450672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:25.450672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:25.450672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:25.450672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:25.450672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:25.450672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:25.450672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 03:28:25.450672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:28:25.450672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 03:28:25.450672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:25.455207 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 464/938] 10.222.0.33 () {56 vars in 1132 bytes} [Fri Sep 16 03:28:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:25.457306 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b13a7d-2ddf-4476-b5b4-fd9a78a93e69 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:25.464566 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:25.532071 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8990d0-efc1-49b5-9275-f5e65a2f0a9d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:25.576998 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b13a7d-2ddf-4476-b5b4-fd9a78a93e69 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:25.577573 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d20613-cc6a-4092-ad56-9c0cf84db0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:25.578239 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d20613-cc6a-4092-ad56-9c0cf84db0cd None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:25.578549 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d20613-cc6a-4092-ad56-9c0cf84db0cd None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:25.578854 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d20613-cc6a-4092-ad56-9c0cf84db0cd None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:25.579450 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d20613-cc6a-4092-ad56-9c0cf84db0cd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:25.579753 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d20613-cc6a-4092-ad56-9c0cf84db0cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:25.581116 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d20613-cc6a-4092-ad56-9c0cf84db0cd None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:25.586432 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 475/939] 10.222.0.33 () {56 vars in 1122 bytes} [Fri Sep 16 03:28:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:25.593416 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d20613-cc6a-4092-ad56-9c0cf84db0cd None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:25.619223 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd474d-fca4-4446-9e14-548ffdde1b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:25.619992 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd474d-fca4-4446-9e14-548ffdde1b97 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:25.620275 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd474d-fca4-4446-9e14-548ffdde1b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:25.620548 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd474d-fca4-4446-9e14-548ffdde1b97 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:25.621169 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd474d-fca4-4446-9e14-548ffdde1b97 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:25.621474 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd474d-fca4-4446-9e14-548ffdde1b97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:25.622938 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd474d-fca4-4446-9e14-548ffdde1b97 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:25.633125 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 465/940] 10.222.0.33 () {56 vars in 1126 bytes} [Fri Sep 16 03:28:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:28:25.634471 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd474d-fca4-4446-9e14-548ffdde1b97 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:25.707830 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:25.714384 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d20613-cc6a-4092-ad56-9c0cf84db0cd None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:25.743232 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:25.749698 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd474d-fca4-4446-9e14-548ffdde1b97 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:25.755943 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379cf517-7c09-4ee9-a63c-99aa760bfc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:25.756702 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cf517-7c09-4ee9-a63c-99aa760bfc5b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:25.756982 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cf517-7c09-4ee9-a63c-99aa760bfc5b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:25.757250 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cf517-7c09-4ee9-a63c-99aa760bfc5b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:25.757974 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379cf517-7c09-4ee9-a63c-99aa760bfc5b None admin] RBAC: Adding query filter params (interface=public, service_id=c763da72a0f84f7a99cc6d27faa306fe, region_id=RegionOne) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:25.758337 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379cf517-7c09-4ee9-a63c-99aa760bfc5b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:25.759768 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379cf517-7c09-4ee9-a63c-99aa760bfc5b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:25.766647 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 476/941] 10.222.0.33 () {56 vars in 1251 bytes} [Fri Sep 16 03:28:25 2022] GET /identity/v3/endpoints?service_id=c763da72a0f84f7a99cc6d27faa306fe&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:28:25.773383 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379cf517-7c09-4ee9-a63c-99aa760bfc5b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:25.791200 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a455958-02bc-487f-b6e3-98b90dbfce44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:25.793041 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a455958-02bc-487f-b6e3-98b90dbfce44 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:25.793508 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a455958-02bc-487f-b6e3-98b90dbfce44 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:25.793952 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a455958-02bc-487f-b6e3-98b90dbfce44 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:25.794766 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a455958-02bc-487f-b6e3-98b90dbfce44 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:25.795393 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a455958-02bc-487f-b6e3-98b90dbfce44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:25.797088 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a455958-02bc-487f-b6e3-98b90dbfce44 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:25.803141 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 466/942] 10.222.0.33 () {56 vars in 1126 bytes} [Fri Sep 16 03:28:25 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:28:25.811120 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a455958-02bc-487f-b6e3-98b90dbfce44 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:25.903657 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379cf517-7c09-4ee9-a63c-99aa760bfc5b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:25.918261 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a455958-02bc-487f-b6e3-98b90dbfce44 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:25.948499 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a24ae-991e-4b2c-bcd4-cd01b8b7c3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:25.949114 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a24ae-991e-4b2c-bcd4-cd01b8b7c3c9 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:25.949396 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a24ae-991e-4b2c-bcd4-cd01b8b7c3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:25.949691 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a24ae-991e-4b2c-bcd4-cd01b8b7c3c9 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:25.950360 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a24ae-991e-4b2c-bcd4-cd01b8b7c3c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:25.952793 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:25.952911 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a24ae-991e-4b2c-bcd4-cd01b8b7c3c9 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:25.959427 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 477/943] 10.222.0.33 () {56 vars in 1087 bytes} [Fri Sep 16 03:28:25 2022] GET /identity/v3/services => generated 1497 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:28:25.968281 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26502d5d-1e42-4912-9385-9aee4918edbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:25.969528 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26502d5d-1e42-4912-9385-9aee4918edbe None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:25.970079 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26502d5d-1e42-4912-9385-9aee4918edbe None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:25.970497 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26502d5d-1e42-4912-9385-9aee4918edbe None admin] PATH_INFO: `/v3/endpoints` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:25.971334 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26502d5d-1e42-4912-9385-9aee4918edbe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:25.973065 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26502d5d-1e42-4912-9385-9aee4918edbe None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:26.081392 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 467/944] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:28:25 2022] POST /identity/v3/endpoints => generated 347 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:28:26.822166 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73437291-503d-4182-afaf-18b2f92e52a2 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:26.822484 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73437291-503d-4182-afaf-18b2f92e52a2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:26.822721 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73437291-503d-4182-afaf-18b2f92e52a2 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:26.824290 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 478/945] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:28:26.829512 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626f494-2a9f-48b3-afc0-6c8dbe74de40 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:26.829838 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626f494-2a9f-48b3-afc0-6c8dbe74de40 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:26.830114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626f494-2a9f-48b3-afc0-6c8dbe74de40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:26.848612 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5626f494-2a9f-48b3-afc0-6c8dbe74de40 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:26.849902 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5626f494-2a9f-48b3-afc0-6c8dbe74de40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:26.924747 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 468/946] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:28:27.193372 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73437291-503d-4182-afaf-18b2f92e52a2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:27.247530 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:27.303481 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73437291-503d-4182-afaf-18b2f92e52a2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:27.338992 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2103adc6-479e-49e9-924a-e806cb6e27b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:27.339625 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103adc6-479e-49e9-924a-e806cb6e27b9 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:27.339906 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103adc6-479e-49e9-924a-e806cb6e27b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:27.340187 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103adc6-479e-49e9-924a-e806cb6e27b9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:27.352850 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2103adc6-479e-49e9-924a-e806cb6e27b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:28:27.357723 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-2103adc6-479e-49e9-924a-e806cb6e27b9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 03:28:27.357723 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:27.357723 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:27.357723 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:27.357723 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:27.357723 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:27.357723 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:27.357723 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:27.357723 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:27.357723 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:27.357723 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:27.357723 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:27.357723 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:28:27.357723 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:28:27.357723 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:28:27.357723 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:28:27.358660 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:28:27.358660 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:28:27.358660 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:28:27.358660 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:28:27.358660 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:27.358660 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:27.358660 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:27.358660 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:27.358660 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:27.358660 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:27.358660 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:27.358660 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:27.358660 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:27.358660 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:27.358660 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:27.358660 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:27.359553 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:27.359553 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:27.359553 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:27.359553 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:27.359553 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:28:27.359553 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:28:27.359553 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:28:27.359553 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:28:27.359553 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:28:27.359553 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:28:27.359553 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 03:28:27.359553 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:27.359553 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 479/947] 10.222.0.33 () {56 vars in 1120 bytes} [Fri Sep 16 03:28:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:27.365263 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626f494-2a9f-48b3-afc0-6c8dbe74de40 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:27.465081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626f494-2a9f-48b3-afc0-6c8dbe74de40 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:27.476426 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:27.500600 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f858555-8e99-4920-a398-b7316c7a1a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:27.501584 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f858555-8e99-4920-a398-b7316c7a1a77 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:27.502154 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f858555-8e99-4920-a398-b7316c7a1a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:27.502631 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f858555-8e99-4920-a398-b7316c7a1a77 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:27.503492 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f858555-8e99-4920-a398-b7316c7a1a77 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:27.504001 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f858555-8e99-4920-a398-b7316c7a1a77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:27.505651 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f858555-8e99-4920-a398-b7316c7a1a77 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:27.514546 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 469/948] 10.222.0.33 () {56 vars in 1115 bytes} [Fri Sep 16 03:28:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:27.520122 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2103adc6-479e-49e9-924a-e806cb6e27b9 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:27.630734 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2103adc6-479e-49e9-924a-e806cb6e27b9 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:27.648967 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:27.670464 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c454c9-671b-4059-ad95-70570656576f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:27.671102 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c454c9-671b-4059-ad95-70570656576f None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:27.671381 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c454c9-671b-4059-ad95-70570656576f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:27.671652 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c454c9-671b-4059-ad95-70570656576f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:27.683363 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c454c9-671b-4059-ad95-70570656576f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:27.684820 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c454c9-671b-4059-ad95-70570656576f None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:27.700139 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-b8c454c9-671b-4059-ad95-70570656576f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:27.700139 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:27.700139 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:27.700139 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:27.700139 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:27.700139 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:27.700139 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:27.700139 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:27.700139 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:27.700139 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:27.700139 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:27.700139 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:27.700139 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:28:27.700139 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:28:27.700139 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:28:27.700139 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:28:27.701136 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:27.701136 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:27.701136 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:27.701136 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:27.701136 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:27.701136 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:27.701136 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:27.701136 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:27.701136 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:27.701136 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:27.701136 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:27.701136 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:27.701136 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:27.701136 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:27.701136 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:27.701136 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:27.701136 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:28:27.702075 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:28:27.702075 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:27.702075 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:27.702075 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 480/949] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:28:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:27.709752 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f858555-8e99-4920-a398-b7316c7a1a77 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:27.730593 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d2225-6d87-4dfd-a6e5-a0651a6de68e None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:27.730875 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d2225-6d87-4dfd-a6e5-a0651a6de68e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:27.731064 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d2225-6d87-4dfd-a6e5-a0651a6de68e None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:27.732730 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 481/950] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 03:28:27.737733 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534bb4b-4c7a-4bb3-999f-60a6875b0556 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:27.738015 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534bb4b-4c7a-4bb3-999f-60a6875b0556 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:27.738289 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534bb4b-4c7a-4bb3-999f-60a6875b0556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:27.757555 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0534bb4b-4c7a-4bb3-999f-60a6875b0556 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:27.758765 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0534bb4b-4c7a-4bb3-999f-60a6875b0556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:27.832144 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f858555-8e99-4920-a398-b7316c7a1a77 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:27.841772 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 482/951] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 03:28:27.874725 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d39a08-5be7-4bc2-b063-2283680061db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:27.875729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d39a08-5be7-4bc2-b063-2283680061db None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:27.876286 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d39a08-5be7-4bc2-b063-2283680061db None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:27.876785 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d39a08-5be7-4bc2-b063-2283680061db None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:27.877690 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d39a08-5be7-4bc2-b063-2283680061db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:27.878197 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d39a08-5be7-4bc2-b063-2283680061db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:27.879816 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d39a08-5be7-4bc2-b063-2283680061db None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:27.893829 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 470/952] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:28:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:27.902394 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534bb4b-4c7a-4bb3-999f-60a6875b0556 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:28.001428 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:28.009280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534bb4b-4c7a-4bb3-999f-60a6875b0556 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:28.044958 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02e3e2-c844-4050-8f24-4dbbd984b407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:28.045584 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02e3e2-c844-4050-8f24-4dbbd984b407 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:28.045888 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02e3e2-c844-4050-8f24-4dbbd984b407 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:28.046216 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02e3e2-c844-4050-8f24-4dbbd984b407 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:28.053693 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c02e3e2-c844-4050-8f24-4dbbd984b407 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:28.055177 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c02e3e2-c844-4050-8f24-4dbbd984b407 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:28.066829 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-8c02e3e2-c844-4050-8f24-4dbbd984b407 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 03:28:28.066829 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:28.066829 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:28.066829 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:28.066829 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:28.066829 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:28.066829 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:28.066829 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:28.066829 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:28.066829 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:28.066829 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:28.066829 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:28.066829 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 03:28:28.066829 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 03:28:28.066829 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 03:28:28.066829 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 03:28:28.068374 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:28.068374 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:28.068374 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 03:28:28.068374 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:28:28.068374 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 03:28:28.068374 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:28:28.068374 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:28.068374 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:28.068374 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:28.068374 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:28.068374 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:28.068374 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:28.068374 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:28.068374 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:28.068374 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:28.068374 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:28.068374 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:28.068374 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:28.069313 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:28.069313 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:28.069313 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 03:28:28.069313 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 03:28:28.069313 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 03:28:28.069313 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 03:28:28.069313 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 03:28:28.069313 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 03:28:28.069313 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 03:28:28.069313 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:28.069313 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 483/953] 10.222.0.33 () {56 vars in 1117 bytes} [Fri Sep 16 03:28:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:28.075094 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d39a08-5be7-4bc2-b063-2283680061db None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:28.111286 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:28.146885 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02e3e2-c844-4050-8f24-4dbbd984b407 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:28.193377 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d39a08-5be7-4bc2-b063-2283680061db None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:28.229362 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e12712-693e-4ea5-8a19-6113b5fc1b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:28.230148 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e12712-693e-4ea5-8a19-6113b5fc1b49 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:28.230429 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e12712-693e-4ea5-8a19-6113b5fc1b49 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:28.230702 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e12712-693e-4ea5-8a19-6113b5fc1b49 None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:28.231421 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e12712-693e-4ea5-8a19-6113b5fc1b49 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:28.231724 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e12712-693e-4ea5-8a19-6113b5fc1b49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:28.233143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e12712-693e-4ea5-8a19-6113b5fc1b49 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:28.254435 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 471/954] 10.222.0.33 () {56 vars in 1149 bytes} [Fri Sep 16 03:28:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:28.256868 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d90df-0548-4c63-9d6c-c948549e2d3d None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:28.257157 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d90df-0548-4c63-9d6c-c948549e2d3d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:28.257472 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d90df-0548-4c63-9d6c-c948549e2d3d None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:28.259021 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 472/955] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:28:28.262988 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d90df-0548-4c63-9d6c-c948549e2d3d None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:28.273768 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02e3e2-c844-4050-8f24-4dbbd984b407 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:28.312555 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4095984a-9b96-4c06-a101-69f4c4be51e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:28.313158 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095984a-9b96-4c06-a101-69f4c4be51e9 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:28.313436 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095984a-9b96-4c06-a101-69f4c4be51e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:28.313734 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095984a-9b96-4c06-a101-69f4c4be51e9 None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:28.314385 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4095984a-9b96-4c06-a101-69f4c4be51e9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:28.315801 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4095984a-9b96-4c06-a101-69f4c4be51e9 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:28.318495 dv-cinder-857993-1-smb devstack@keystone.service[81775]: WARNING keystone.server.flask.common [None req-4095984a-9b96-4c06-a101-69f4c4be51e9 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 16 03:28:28.362493 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.sql.core [None req-4095984a-9b96-4c06-a101-69f4c4be51e9 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 16 03:28:28.362493 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 16 03:28:28.362493 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [parameters: {'id': '417b27f21f2b44c68b67c0e818f2a25f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 16 03:28:28.362493 dv-cinder-857993-1-smb devstack@keystone.service[81775]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81775) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 16 03:28:28.370582 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:28.379311 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-4095984a-9b96-4c06-a101-69f4c4be51e9 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 417b27f21f2b44c68b67c0e818f2a25f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 417b27f21f2b44c68b67c0e818f2a25f. Sep 16 03:28:28.379311 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:28.379311 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 03:28:28.379311 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 16 03:28:28.379311 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 03:28:28.379311 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 16 03:28:28.379311 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 03:28:28.379311 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application result = self._query(query) Sep 16 03:28:28.379311 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 03:28:28.379311 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application conn.query(q) Sep 16 03:28:28.379311 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 03:28:28.379311 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 03:28:28.379311 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 03:28:28.383518 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application result.read() Sep 16 03:28:28.383518 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 03:28:28.383518 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 16 03:28:28.383518 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 03:28:28.383518 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 16 03:28:28.383518 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 03:28:28.383518 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 16 03:28:28.383518 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 03:28:28.383518 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 16 03:28:28.383518 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 16 03:28:28.383518 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:28.383518 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 16 03:28:28.383518 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:28.383518 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:28.383518 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 16 03:28:28.383518 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 16 03:28:28.383518 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 16 03:28:28.383518 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 16 03:28:28.384467 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 16 03:28:28.384467 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application next(self.gen) Sep 16 03:28:28.384467 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 16 03:28:28.384467 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application yield resource Sep 16 03:28:28.384467 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 16 03:28:28.384467 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application next(self.gen) Sep 16 03:28:28.384467 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 16 03:28:28.384467 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.session.rollback() Sep 16 03:28:28.384467 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 03:28:28.384467 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.force_reraise() Sep 16 03:28:28.384467 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 03:28:28.384467 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise self.value Sep 16 03:28:28.384467 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 16 03:28:28.384467 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 16 03:28:28.384467 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 16 03:28:28.384467 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application session.commit() Sep 16 03:28:28.384467 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 16 03:28:28.385458 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 16 03:28:28.385458 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 16 03:28:28.385458 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._prepare_impl() Sep 16 03:28:28.385458 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 16 03:28:28.385458 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.session.flush() Sep 16 03:28:28.385458 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 16 03:28:28.385458 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._flush(objects) Sep 16 03:28:28.385458 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 16 03:28:28.385458 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 16 03:28:28.385458 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 16 03:28:28.385458 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application compat.raise_( Sep 16 03:28:28.385458 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 03:28:28.385458 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception Sep 16 03:28:28.385458 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 16 03:28:28.385458 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application flush_context.execute() Sep 16 03:28:28.385458 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 16 03:28:28.385458 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rec.execute(self) Sep 16 03:28:28.387857 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 16 03:28:28.387857 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 16 03:28:28.387857 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 16 03:28:28.387857 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 16 03:28:28.387857 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 16 03:28:28.387857 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 16 03:28:28.387857 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 16 03:28:28.387857 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 16 03:28:28.387857 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 16 03:28:28.387857 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 16 03:28:28.387857 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 16 03:28:28.387857 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 16 03:28:28.387857 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 16 03:28:28.387857 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 16 03:28:28.387857 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 16 03:28:28.388631 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 16 03:28:28.388631 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 03:28:28.388631 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception Sep 16 03:28:28.388631 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 03:28:28.388631 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 16 03:28:28.388631 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 03:28:28.388631 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 16 03:28:28.388631 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 03:28:28.388631 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application result = self._query(query) Sep 16 03:28:28.388631 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 03:28:28.388631 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application conn.query(q) Sep 16 03:28:28.388631 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 03:28:28.388631 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 03:28:28.388631 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 03:28:28.388631 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application result.read() Sep 16 03:28:28.388631 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 03:28:28.388631 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 16 03:28:28.389500 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 03:28:28.389500 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 16 03:28:28.389500 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 03:28:28.389500 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 16 03:28:28.389500 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 03:28:28.389500 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 16 03:28:28.389500 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 16 03:28:28.389500 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 16 03:28:28.389500 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [parameters: {'id': '417b27f21f2b44c68b67c0e818f2a25f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 16 03:28:28.389500 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 16 03:28:28.389500 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:28.389500 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 03:28:28.389500 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:28.389500 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:28.389500 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 16 03:28:28.390516 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 16 03:28:28.390516 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 16 03:28:28.390516 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 16 03:28:28.390516 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 16 03:28:28.390516 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:28.390516 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 03:28:28.390516 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:28.390516 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:28.390516 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:28.390516 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:28.390516 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:28.390516 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:28.390516 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:28.390516 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:28.390516 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:28.390516 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:28.390516 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:28.392664 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:28.392664 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 16 03:28:28.392664 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 16 03:28:28.392664 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:28.392664 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:28.392664 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 16 03:28:28.392664 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 16 03:28:28.392664 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 417b27f21f2b44c68b67c0e818f2a25f. Sep 16 03:28:28.392664 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:28.392664 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 484/956] 10.222.0.33 () {60 vars in 1140 bytes} [Fri Sep 16 03:28:28 2022] POST /identity/v3/projects => generated 262 bytes in 235 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:28:28.393418 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d90df-0548-4c63-9d6c-c948549e2d3d None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:28.393505 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2077c93-8ac8-4f37-b6bd-09c6b2e21010 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:28.393505 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2077c93-8ac8-4f37-b6bd-09c6b2e21010 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:28.393505 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2077c93-8ac8-4f37-b6bd-09c6b2e21010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:28.403419 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d2077c93-8ac8-4f37-b6bd-09c6b2e21010 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:28.404942 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d2077c93-8ac8-4f37-b6bd-09c6b2e21010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:28.407973 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:28.420584 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f99258-f919-47dd-9e3c-4c3f6159cf4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:28.421195 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f99258-f919-47dd-9e3c-4c3f6159cf4a None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:28.421477 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f99258-f919-47dd-9e3c-4c3f6159cf4a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:28.421781 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f99258-f919-47dd-9e3c-4c3f6159cf4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:28.473673 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 485/957] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:28:28.473673 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cb001-7713-434c-baaf-cd5f970b6318 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:28.473673 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cb001-7713-434c-baaf-cd5f970b6318 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:28.474790 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cb001-7713-434c-baaf-cd5f970b6318 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:28.479006 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 486/958] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:28:28.479683 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41cb001-7713-434c-baaf-cd5f970b6318 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:28.490668 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f99258-f919-47dd-9e3c-4c3f6159cf4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:28.492048 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f99258-f919-47dd-9e3c-4c3f6159cf4a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:28.583353 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:28.583542 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41cb001-7713-434c-baaf-cd5f970b6318 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:28.598151 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 473/959] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:28:28 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 03:28:28.598151 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2caff5-282f-4a91-a582-f08910486cc4 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:28.598151 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2caff5-282f-4a91-a582-f08910486cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:28.598151 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2caff5-282f-4a91-a582-f08910486cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:28.613905 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-dc2caff5-282f-4a91-a582-f08910486cc4 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:28.615641 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-dc2caff5-282f-4a91-a582-f08910486cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:28.617816 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc6b4b-cbd4-4d94-8f83-2800ad7ee448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:28.618479 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc6b4b-cbd4-4d94-8f83-2800ad7ee448 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:28.618728 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc6b4b-cbd4-4d94-8f83-2800ad7ee448 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:28.619004 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc6b4b-cbd4-4d94-8f83-2800ad7ee448 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:28.625849 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc6b4b-cbd4-4d94-8f83-2800ad7ee448 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:28.627450 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc6b4b-cbd4-4d94-8f83-2800ad7ee448 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:28.630080 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:28.639921 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-92cc6b4b-cbd4-4d94-8f83-2800ad7ee448 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:28:28.639921 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:28.639921 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:28.639921 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:28.639921 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:28.639921 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:28.639921 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:28.639921 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:28.639921 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:28.639921 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:28.639921 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:28.639921 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:28.639921 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 03:28:28.639921 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 03:28:28.639921 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 03:28:28.641928 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 03:28:28.641928 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:28.641928 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:28.641928 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:28.641928 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:28.641928 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:28.641928 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:28.641928 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:28.641928 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:28.641928 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:28.641928 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:28.641928 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:28.641928 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:28.641928 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:28.641928 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:28.641928 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:28.641928 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:28.642888 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 03:28:28.642888 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 03:28:28.642888 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 03:28:28.642888 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 03:28:28.642888 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 03:28:28.642888 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 03:28:28.642888 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:28:28.642888 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:28.642888 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 487/960] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:28:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:28.642888 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc6b4b-cbd4-4d94-8f83-2800ad7ee448 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:28.705790 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 474/961] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:28:28.706699 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2caff5-282f-4a91-a582-f08910486cc4 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:28.761792 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc6b4b-cbd4-4d94-8f83-2800ad7ee448 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:28.798072 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1adfd0-c0de-4627-b01f-b962c5540428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:28.798704 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1adfd0-c0de-4627-b01f-b962c5540428 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:28.798983 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1adfd0-c0de-4627-b01f-b962c5540428 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:28.799261 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1adfd0-c0de-4627-b01f-b962c5540428 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:28.810524 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1adfd0-c0de-4627-b01f-b962c5540428 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:28.812001 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1adfd0-c0de-4627-b01f-b962c5540428 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:28.818321 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2caff5-282f-4a91-a582-f08910486cc4 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:28.827338 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-fc1adfd0-c0de-4627-b01f-b962c5540428 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:28.827338 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:28.827338 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:28.827338 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:28.827338 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:28.827338 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:28.827338 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:28.827338 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:28.827338 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:28.827338 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:28.827338 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:28.827338 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:28.827338 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:28:28.827338 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:28:28.827338 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:28:28.827338 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:28:28.828444 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:28.828444 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:28.828444 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:28.828444 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:28.828444 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:28.828444 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:28.828444 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:28.828444 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:28.828444 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:28.828444 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:28.828444 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:28.828444 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:28.828444 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:28.828444 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:28.828444 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:28.828444 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:28.828444 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:28:28.829479 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:28:28.829479 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:28.829479 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:28.829479 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 488/962] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:28:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:28.834366 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1adfd0-c0de-4627-b01f-b962c5540428 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:28.842766 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:28.857235 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78222c-c2fd-4c31-a4be-926df5d714ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:28.857868 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78222c-c2fd-4c31-a4be-926df5d714ac None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:28.858146 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78222c-c2fd-4c31-a4be-926df5d714ac None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:28.858418 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78222c-c2fd-4c31-a4be-926df5d714ac None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:28.859071 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc78222c-c2fd-4c31-a4be-926df5d714ac None admin] RBAC: Adding query filter params (name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:28.859370 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc78222c-c2fd-4c31-a4be-926df5d714ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:28.860796 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc78222c-c2fd-4c31-a4be-926df5d714ac None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:28.877856 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 475/963] 10.222.0.33 () {56 vars in 1112 bytes} [Fri Sep 16 03:28:28 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:28.878674 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78222c-c2fd-4c31-a4be-926df5d714ac None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:28.901127 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:28.968461 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1adfd0-c0de-4627-b01f-b962c5540428 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:29.001592 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78222c-c2fd-4c31-a4be-926df5d714ac None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:29.004855 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017d897-d507-4304-9b76-d0fa7012be82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:29.005678 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017d897-d507-4304-9b76-d0fa7012be82 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:29.006059 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017d897-d507-4304-9b76-d0fa7012be82 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:29.006429 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017d897-d507-4304-9b76-d0fa7012be82 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:29.007123 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8017d897-d507-4304-9b76-d0fa7012be82 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:29.008636 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8017d897-d507-4304-9b76-d0fa7012be82 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:29.018385 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-8017d897-d507-4304-9b76-d0fa7012be82 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 03:28:29.018385 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:29.018385 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 03:28:29.018385 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 03:28:29.018385 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 03:28:29.018385 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 03:28:29.018385 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 03:28:29.018385 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:28:29.018385 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 03:28:29.018385 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:29.018385 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 03:28:29.018385 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:29.018385 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:29.018385 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:29.018385 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:29.018385 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:29.018385 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:29.019723 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:29.019723 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:29.019723 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:29.019723 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:29.019723 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:29.019723 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:29.019723 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 03:28:29.019723 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 03:28:29.019723 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 03:28:29.019723 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 03:28:29.019723 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:29.019723 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:29.019723 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:29.019723 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:29.019723 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:29.019723 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:29.021564 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:29.021564 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:29.021564 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:29.021564 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:29.021564 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:29.021564 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:29.021564 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:29.021564 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:29.021564 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:29.021564 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:29.021564 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 03:28:29.021564 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:28:29.021564 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 03:28:29.021564 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:29.022400 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 489/964] 10.222.0.33 () {56 vars in 1126 bytes} [Fri Sep 16 03:28:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:29.022686 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017d897-d507-4304-9b76-d0fa7012be82 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:29.049568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af0a90-c87c-4124-ae7d-ac0da68d0da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:29.050493 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af0a90-c87c-4124-ae7d-ac0da68d0da5 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:29.050820 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af0a90-c87c-4124-ae7d-ac0da68d0da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:29.051264 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af0a90-c87c-4124-ae7d-ac0da68d0da5 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:29.052322 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af0a90-c87c-4124-ae7d-ac0da68d0da5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:29.052699 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af0a90-c87c-4124-ae7d-ac0da68d0da5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:29.054299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af0a90-c87c-4124-ae7d-ac0da68d0da5 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:29.066680 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 476/965] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:29.068419 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af0a90-c87c-4124-ae7d-ac0da68d0da5 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:29.117297 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:29.138907 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017d897-d507-4304-9b76-d0fa7012be82 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:29.158685 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:29.177395 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcbf713-32ec-4093-b466-be702e2cea38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:29.178069 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbf713-32ec-4093-b466-be702e2cea38 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:29.178348 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbf713-32ec-4093-b466-be702e2cea38 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:29.178627 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbf713-32ec-4093-b466-be702e2cea38 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:29.179214 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcbf713-32ec-4093-b466-be702e2cea38 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:29.180631 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcbf713-32ec-4093-b466-be702e2cea38 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:29.182611 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af0a90-c87c-4124-ae7d-ac0da68d0da5 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:29.189308 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-adcbf713-32ec-4093-b466-be702e2cea38 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 03:28:29.189308 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:29.189308 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 03:28:29.189308 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 03:28:29.189308 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 03:28:29.189308 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 03:28:29.189308 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 03:28:29.189308 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:28:29.189308 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 03:28:29.189308 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:29.189308 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 03:28:29.189308 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:29.189308 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:29.189308 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:29.189308 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:29.189308 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:29.189308 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:29.194524 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:29.194524 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:29.194524 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:29.194524 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:29.194524 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:29.194524 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:29.194524 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 03:28:29.194524 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 03:28:29.194524 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 03:28:29.194524 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 03:28:29.194524 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:29.194524 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:29.194524 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:29.194524 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:29.194524 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:29.194524 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:29.195560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:29.195560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:29.195560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:29.195560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:29.195560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:29.195560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:29.195560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:29.195560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:29.195560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:29.195560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:29.195560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 03:28:29.195560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:28:29.195560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 03:28:29.195560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:29.195560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 490/966] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:28:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:29.196479 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcbf713-32ec-4093-b466-be702e2cea38 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:29.223766 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d654b3-edf5-4532-ac98-9808cea1b9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:29.224415 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d654b3-edf5-4532-ac98-9808cea1b9f9 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:29.224699 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d654b3-edf5-4532-ac98-9808cea1b9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:29.224978 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d654b3-edf5-4532-ac98-9808cea1b9f9 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:29.225609 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d654b3-edf5-4532-ac98-9808cea1b9f9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:29.225940 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d654b3-edf5-4532-ac98-9808cea1b9f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:29.227312 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d654b3-edf5-4532-ac98-9808cea1b9f9 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:29.236679 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 477/967] 10.222.0.33 () {56 vars in 1122 bytes} [Fri Sep 16 03:28:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:29.236679 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d654b3-edf5-4532-ac98-9808cea1b9f9 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:29.305751 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcbf713-32ec-4093-b466-be702e2cea38 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:29.338781 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d654b3-edf5-4532-ac98-9808cea1b9f9 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:29.341139 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:29.344965 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ca1f4-2f5f-420c-aa86-8c46a94dfdcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:29.345610 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ca1f4-2f5f-420c-aa86-8c46a94dfdcb None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:29.345923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ca1f4-2f5f-420c-aa86-8c46a94dfdcb None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:29.346197 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ca1f4-2f5f-420c-aa86-8c46a94dfdcb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:29.354017 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ca1f4-2f5f-420c-aa86-8c46a94dfdcb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:29.356127 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ca1f4-2f5f-420c-aa86-8c46a94dfdcb None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:29.369461 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-8d1ca1f4-2f5f-420c-aa86-8c46a94dfdcb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:28:29.369461 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:29.369461 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:29.369461 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:29.369461 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:29.369461 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:29.369461 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:29.369461 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:29.369461 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:29.369461 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:29.369461 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:29.369461 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:29.369461 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 03:28:29.369461 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 03:28:29.369461 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 03:28:29.370571 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 03:28:29.370571 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:29.370571 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:29.370571 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:29.370571 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:29.370571 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:29.370571 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:29.370571 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:29.370571 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:29.370571 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:29.370571 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:29.370571 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:29.370571 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:29.370571 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:29.370571 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:29.370571 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:29.370571 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:29.372020 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 03:28:29.372020 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 03:28:29.372020 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 03:28:29.372020 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 03:28:29.372020 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 03:28:29.372020 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 03:28:29.372020 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:28:29.372020 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:29.372020 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 491/968] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:28:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:29.372020 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ca1f4-2f5f-420c-aa86-8c46a94dfdcb None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:29.378749 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81b12b-6999-4b4b-a25a-4830fdd3bd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:29.379371 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81b12b-6999-4b4b-a25a-4830fdd3bd4c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:29.379653 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81b12b-6999-4b4b-a25a-4830fdd3bd4c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:29.380463 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81b12b-6999-4b4b-a25a-4830fdd3bd4c None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:29.381100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b81b12b-6999-4b4b-a25a-4830fdd3bd4c None admin] RBAC: Adding query filter params (name=compute) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:29.381406 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b81b12b-6999-4b4b-a25a-4830fdd3bd4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:29.382810 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b81b12b-6999-4b4b-a25a-4830fdd3bd4c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:29.388176 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 478/969] 10.222.0.33 () {56 vars in 1112 bytes} [Fri Sep 16 03:28:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:29.388176 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81b12b-6999-4b4b-a25a-4830fdd3bd4c None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:29.424805 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:29.493710 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81b12b-6999-4b4b-a25a-4830fdd3bd4c None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:29.493913 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ca1f4-2f5f-420c-aa86-8c46a94dfdcb None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:29.527570 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2d21f-5196-494f-9f0b-106cf01ca06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:29.528182 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2d21f-5196-494f-9f0b-106cf01ca06a None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:29.528466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2d21f-5196-494f-9f0b-106cf01ca06a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:29.528744 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2d21f-5196-494f-9f0b-106cf01ca06a None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:29.529485 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2d21f-5196-494f-9f0b-106cf01ca06a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:29.529769 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2d21f-5196-494f-9f0b-106cf01ca06a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:29.531199 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2d21f-5196-494f-9f0b-106cf01ca06a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:29.531979 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763b952-cc2e-4c43-b5b5-63787b6abc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:29.532742 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763b952-cc2e-4c43-b5b5-63787b6abc15 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:29.533029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763b952-cc2e-4c43-b5b5-63787b6abc15 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:29.533379 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763b952-cc2e-4c43-b5b5-63787b6abc15 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:29.534146 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763b952-cc2e-4c43-b5b5-63787b6abc15 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:29.534450 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763b952-cc2e-4c43-b5b5-63787b6abc15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:29.535792 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763b952-cc2e-4c43-b5b5-63787b6abc15 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:29.546242 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 492/970] 10.222.0.33 () {56 vars in 1122 bytes} [Fri Sep 16 03:28:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:29.546242 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763b952-cc2e-4c43-b5b5-63787b6abc15 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:29.553758 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 479/971] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 03:28:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:29.553758 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2d21f-5196-494f-9f0b-106cf01ca06a None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:29.582274 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:29.647667 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763b952-cc2e-4c43-b5b5-63787b6abc15 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:29.650068 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:29.658986 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2d21f-5196-494f-9f0b-106cf01ca06a None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:29.686195 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb61058-d710-48b4-9adf-36b6482e8749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:29.686943 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb61058-d710-48b4-9adf-36b6482e8749 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:29.687347 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb61058-d710-48b4-9adf-36b6482e8749 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:29.687728 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb61058-d710-48b4-9adf-36b6482e8749 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:29.688362 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb61058-d710-48b4-9adf-36b6482e8749 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:29.688668 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb61058-d710-48b4-9adf-36b6482e8749 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:29.690094 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb61058-d710-48b4-9adf-36b6482e8749 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:29.703898 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89607d1e-fad3-4527-abba-9ec94c574205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:29.704606 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89607d1e-fad3-4527-abba-9ec94c574205 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:29.704893 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89607d1e-fad3-4527-abba-9ec94c574205 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:29.705170 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89607d1e-fad3-4527-abba-9ec94c574205 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:29.705988 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 493/972] 10.222.0.33 () {56 vars in 1112 bytes} [Fri Sep 16 03:28:29 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:29.706115 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89607d1e-fad3-4527-abba-9ec94c574205 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:29.706796 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb61058-d710-48b4-9adf-36b6482e8749 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:29.707411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89607d1e-fad3-4527-abba-9ec94c574205 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:29.805308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 480/973] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:28:29 2022] POST /identity/v3/endpoints => generated 349 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:28:29.837086 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb61058-d710-48b4-9adf-36b6482e8749 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:29.888513 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52dfa3-7687-405f-a5f0-088ef2b80251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:29.889136 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52dfa3-7687-405f-a5f0-088ef2b80251 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:29.889418 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52dfa3-7687-405f-a5f0-088ef2b80251 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:29.889728 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52dfa3-7687-405f-a5f0-088ef2b80251 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:29.890521 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52dfa3-7687-405f-a5f0-088ef2b80251 None admin] RBAC: Adding query filter params (role.id=da747e5ab1c6405a97b406d925ebd4b4, scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2, user.id=b0812002d7b14bcb81a42eb380231feb) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:29.890827 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52dfa3-7687-405f-a5f0-088ef2b80251 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:29.892287 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52dfa3-7687-405f-a5f0-088ef2b80251 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:29.899803 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 494/974] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:28:29 2022] GET /identity/v3/role_assignments?user.id=b0812002d7b14bcb81a42eb380231feb&scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2&role.id=da747e5ab1c6405a97b406d925ebd4b4 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:31.110688 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370874d-6693-4594-bba5-2061d9b2b906 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:31.111242 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370874d-6693-4594-bba5-2061d9b2b906 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:31.111242 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370874d-6693-4594-bba5-2061d9b2b906 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:31.112771 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 481/975] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:28:31.118790 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522f77a-c00a-4cca-84b3-093b75721cae None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:31.119200 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522f77a-c00a-4cca-84b3-093b75721cae None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:31.119392 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522f77a-c00a-4cca-84b3-093b75721cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:31.138150 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b522f77a-c00a-4cca-84b3-093b75721cae None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:31.139399 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b522f77a-c00a-4cca-84b3-093b75721cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:31.163906 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:31.211561 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 495/976] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:28:31.478704 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370874d-6693-4594-bba5-2061d9b2b906 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:31.567168 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:31.585211 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370874d-6693-4594-bba5-2061d9b2b906 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:31.620818 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ad516-111b-4145-acfb-893574abdb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:31.621428 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ad516-111b-4145-acfb-893574abdb9b None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:31.621728 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ad516-111b-4145-acfb-893574abdb9b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:31.622002 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ad516-111b-4145-acfb-893574abdb9b None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:31.622652 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ad516-111b-4145-acfb-893574abdb9b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:31.624200 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ad516-111b-4145-acfb-893574abdb9b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:31.626797 dv-cinder-857993-1-smb devstack@keystone.service[81776]: WARNING keystone.server.flask.common [None req-7b6ad516-111b-4145-acfb-893574abdb9b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 16 03:28:31.668771 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.sql.core [None req-7b6ad516-111b-4145-acfb-893574abdb9b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 16 03:28:31.668771 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 16 03:28:31.668771 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [parameters: {'user_id': '77ff600f318342dea719ac9d478827a6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 16 03:28:31.668771 dv-cinder-857993-1-smb devstack@keystone.service[81776]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81776) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 16 03:28:31.675419 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-7b6ad516-111b-4145-acfb-893574abdb9b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 16 03:28:31.675419 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:31.675419 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 03:28:31.675419 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 16 03:28:31.675419 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 03:28:31.675419 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 16 03:28:31.675419 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 03:28:31.675419 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application result = self._query(query) Sep 16 03:28:31.675419 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 03:28:31.675419 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application conn.query(q) Sep 16 03:28:31.675419 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 03:28:31.675419 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 03:28:31.675419 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 03:28:31.675419 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application result.read() Sep 16 03:28:31.675419 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 03:28:31.676287 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 16 03:28:31.676287 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 03:28:31.676287 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 16 03:28:31.676287 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 03:28:31.676287 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 16 03:28:31.676287 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 03:28:31.676287 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 16 03:28:31.676287 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 16 03:28:31.676287 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:31.676287 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 16 03:28:31.676287 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:31.676287 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:31.676287 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 16 03:28:31.676287 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 16 03:28:31.676287 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 16 03:28:31.676287 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 16 03:28:31.676287 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 16 03:28:31.676287 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application next(self.gen) Sep 16 03:28:31.678294 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 16 03:28:31.678294 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application yield resource Sep 16 03:28:31.678294 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 16 03:28:31.678294 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application next(self.gen) Sep 16 03:28:31.678294 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 16 03:28:31.678294 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self.session.rollback() Sep 16 03:28:31.678294 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 03:28:31.678294 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self.force_reraise() Sep 16 03:28:31.678294 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 03:28:31.678294 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise self.value Sep 16 03:28:31.678294 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 16 03:28:31.678294 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 16 03:28:31.678294 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 16 03:28:31.678294 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application session.commit() Sep 16 03:28:31.678294 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 16 03:28:31.678294 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 16 03:28:31.678294 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 16 03:28:31.679411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._prepare_impl() Sep 16 03:28:31.679411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 16 03:28:31.679411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self.session.flush() Sep 16 03:28:31.679411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 16 03:28:31.679411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._flush(objects) Sep 16 03:28:31.679411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 16 03:28:31.679411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 16 03:28:31.679411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 16 03:28:31.679411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application compat.raise_( Sep 16 03:28:31.679411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 03:28:31.679411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception Sep 16 03:28:31.679411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 16 03:28:31.679411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application flush_context.execute() Sep 16 03:28:31.679411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 16 03:28:31.679411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rec.execute(self) Sep 16 03:28:31.679411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 16 03:28:31.679411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 16 03:28:31.680309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 16 03:28:31.680309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 16 03:28:31.680309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 16 03:28:31.680309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 16 03:28:31.680309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 16 03:28:31.680309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 16 03:28:31.680309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 16 03:28:31.680309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 16 03:28:31.680309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 16 03:28:31.680309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 16 03:28:31.680309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 16 03:28:31.680309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 16 03:28:31.680309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 16 03:28:31.680309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 16 03:28:31.680309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 03:28:31.680309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception Sep 16 03:28:31.681194 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 03:28:31.681194 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 16 03:28:31.681194 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 03:28:31.681194 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 16 03:28:31.681194 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 03:28:31.681194 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application result = self._query(query) Sep 16 03:28:31.681194 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 03:28:31.681194 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application conn.query(q) Sep 16 03:28:31.681194 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 03:28:31.681194 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 03:28:31.681194 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 03:28:31.681194 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application result.read() Sep 16 03:28:31.681194 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 03:28:31.681194 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 16 03:28:31.681194 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 03:28:31.681194 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 16 03:28:31.683396 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 03:28:31.683396 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 16 03:28:31.683396 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 03:28:31.683396 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 16 03:28:31.683396 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 16 03:28:31.683396 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 16 03:28:31.683396 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [parameters: {'user_id': '77ff600f318342dea719ac9d478827a6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 16 03:28:31.683396 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 16 03:28:31.683396 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:31.683396 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 03:28:31.683396 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:31.683396 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:31.683396 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:31.683396 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:31.683396 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:31.685504 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:31.685504 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:31.685504 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:31.685504 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:31.685504 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:31.685504 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:31.685504 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:31.685504 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 16 03:28:31.685504 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 16 03:28:31.685504 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:31.685504 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:31.685504 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 03:28:31.685504 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:28:31.685504 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 03:28:31.685504 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:28:31.685504 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 16 03:28:31.685504 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 16 03:28:31.687713 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 16 03:28:31.687713 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 16 03:28:31.687713 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 16 03:28:31.687713 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 16 03:28:31.687713 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 16 03:28:31.687713 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:31.687713 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 482/977] 10.222.0.33 () {60 vars in 1131 bytes} [Fri Sep 16 03:28:31 2022] POST /identity/v3/users => generated 160 bytes in 199 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:31.688672 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522f77a-c00a-4cca-84b3-093b75721cae None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:31.800753 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522f77a-c00a-4cca-84b3-093b75721cae None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:31.836622 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6aa3b9-7433-4582-896e-92e03f298691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:31.837260 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6aa3b9-7433-4582-896e-92e03f298691 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:31.837539 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6aa3b9-7433-4582-896e-92e03f298691 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:31.837839 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6aa3b9-7433-4582-896e-92e03f298691 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:31.845667 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6aa3b9-7433-4582-896e-92e03f298691 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:31.847172 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6aa3b9-7433-4582-896e-92e03f298691 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:31.861189 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-6d6aa3b9-7433-4582-896e-92e03f298691 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 03:28:31.861189 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:31.861189 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:31.861189 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:31.861189 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:31.861189 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:31.861189 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:31.861189 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:31.861189 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:31.861189 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:31.861189 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:31.861189 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:31.861189 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 03:28:31.861189 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 03:28:31.861189 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 03:28:31.861189 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 03:28:31.863569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:31.863569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:31.863569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 03:28:31.863569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:28:31.863569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 03:28:31.863569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:28:31.863569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:31.863569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:31.863569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:31.863569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:31.863569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:31.863569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:31.863569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:31.863569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:31.863569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:31.863569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:31.863569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:31.863569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:31.866029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:31.866029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:31.866029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 03:28:31.866029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 03:28:31.866029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 03:28:31.866029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 03:28:31.866029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 03:28:31.866029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 03:28:31.866029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 03:28:31.866029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:31.866029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 496/978] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:28:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:31.869106 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ad516-111b-4145-acfb-893574abdb9b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:31.980166 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918e016-c3f4-405b-9b71-234aa19244df None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:31.980492 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918e016-c3f4-405b-9b71-234aa19244df None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:31.980738 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918e016-c3f4-405b-9b71-234aa19244df None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:31.982417 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 497/979] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:28:31.982920 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ad516-111b-4145-acfb-893574abdb9b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:31.987714 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11408285-6a63-41d5-9e3c-91dd2c374935 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:31.988099 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11408285-6a63-41d5-9e3c-91dd2c374935 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:31.994102 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11408285-6a63-41d5-9e3c-91dd2c374935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:32.007735 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-11408285-6a63-41d5-9e3c-91dd2c374935 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:32.008931 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-11408285-6a63-41d5-9e3c-91dd2c374935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:32.021397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ee543-2701-4ea4-945d-efeb1abe9a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:32.022377 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ee543-2701-4ea4-945d-efeb1abe9a94 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:32.022879 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ee543-2701-4ea4-945d-efeb1abe9a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:32.023358 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ee543-2701-4ea4-945d-efeb1abe9a94 None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:32.024294 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ee543-2701-4ea4-945d-efeb1abe9a94 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:32.024416 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:32.024912 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ee543-2701-4ea4-945d-efeb1abe9a94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:32.026940 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ee543-2701-4ea4-945d-efeb1abe9a94 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:32.068848 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 483/980] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 03:28:31 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:32.070847 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81f01c-4c3c-4cd1-b9a4-795fe0fe2681 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:32.071405 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81f01c-4c3c-4cd1-b9a4-795fe0fe2681 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:32.071790 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81f01c-4c3c-4cd1-b9a4-795fe0fe2681 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:32.073832 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 484/981] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:28:32.084596 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134e2e1-530c-4690-9aa9-4a4c957c7b79 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:32.085037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134e2e1-530c-4690-9aa9-4a4c957c7b79 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:32.085493 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134e2e1-530c-4690-9aa9-4a4c957c7b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:32.101576 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 498/982] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 03:28:32.106064 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:32.109464 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1134e2e1-530c-4690-9aa9-4a4c957c7b79 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:32.111316 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1134e2e1-530c-4690-9aa9-4a4c957c7b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:32.195515 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb045d-e54b-426b-a823-476edcfb0c13 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:32.196097 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb045d-e54b-426b-a823-476edcfb0c13 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:32.196097 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb045d-e54b-426b-a823-476edcfb0c13 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:32.197659 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 499/984] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 03:28:32.201506 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 485/984] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 03:28:32.203888 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765919d-7fb0-4c0a-af49-43d5aa181a23 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:32.204238 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765919d-7fb0-4c0a-af49-43d5aa181a23 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:32.207253 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765919d-7fb0-4c0a-af49-43d5aa181a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:32.225366 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3765919d-7fb0-4c0a-af49-43d5aa181a23 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:32.226768 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3765919d-7fb0-4c0a-af49-43d5aa181a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:32.297518 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 500/985] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:28:32.401649 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134e2e1-530c-4690-9aa9-4a4c957c7b79 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:32.478728 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765919d-7fb0-4c0a-af49-43d5aa181a23 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:32.498223 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134e2e1-530c-4690-9aa9-4a4c957c7b79 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:32.533009 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d35d72-769b-4ec9-83fc-56e6d17c79b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:32.533617 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d35d72-769b-4ec9-83fc-56e6d17c79b9 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:32.533925 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d35d72-769b-4ec9-83fc-56e6d17c79b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:32.534201 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d35d72-769b-4ec9-83fc-56e6d17c79b9 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:32.534844 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d35d72-769b-4ec9-83fc-56e6d17c79b9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:32.536239 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d35d72-769b-4ec9-83fc-56e6d17c79b9 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:32.539575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:32.558889 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:32.580479 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765919d-7fb0-4c0a-af49-43d5aa181a23 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:32.613569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9a8a6-1127-4bf3-b933-8b7f534b4561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:32.614268 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9a8a6-1127-4bf3-b933-8b7f534b4561 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:32.614549 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9a8a6-1127-4bf3-b933-8b7f534b4561 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:32.614819 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9a8a6-1127-4bf3-b933-8b7f534b4561 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:32.615017 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 486/986] 10.222.0.33 () {60 vars in 1141 bytes} [Fri Sep 16 03:28:32 2022] POST /identity/v3/services => generated 242 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:28:32.615899 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d35d72-769b-4ec9-83fc-56e6d17c79b9 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:32.616657 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9a8a6-1127-4bf3-b933-8b7f534b4561 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:32.618102 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9a8a6-1127-4bf3-b933-8b7f534b4561 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:32.628327 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-2fd9a8a6-1127-4bf3-b933-8b7f534b4561 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 03:28:32.628327 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:32.628327 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 03:28:32.628327 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 03:28:32.628327 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 03:28:32.628327 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 03:28:32.628327 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 03:28:32.628327 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:28:32.628327 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 03:28:32.628327 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:32.628327 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 03:28:32.628327 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:32.628327 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:32.628327 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:32.628327 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:32.628327 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:32.628327 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:32.629614 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:32.629614 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:32.629614 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:32.629614 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:32.629614 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:32.629614 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:32.629614 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 03:28:32.629614 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 03:28:32.629614 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 03:28:32.629614 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 03:28:32.629614 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:32.629614 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:32.629614 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:32.629614 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:32.629614 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:32.629614 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:32.631006 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:32.631006 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:32.631006 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:32.631006 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:32.631006 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:32.631006 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:32.631006 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:32.631006 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:32.631006 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:32.631006 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:32.631006 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 03:28:32.631006 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:28:32.631006 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 03:28:32.631006 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:32.631006 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 501/987] 10.222.0.33 () {56 vars in 1126 bytes} [Fri Sep 16 03:28:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:28:32.636580 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9a8a6-1127-4bf3-b933-8b7f534b4561 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:32.755169 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d35d72-769b-4ec9-83fc-56e6d17c79b9 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:32.758327 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9a8a6-1127-4bf3-b933-8b7f534b4561 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:32.791087 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba340b-0809-4038-954f-0a60fce27708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:32.791738 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba340b-0809-4038-954f-0a60fce27708 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:32.792014 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba340b-0809-4038-954f-0a60fce27708 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:32.792295 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba340b-0809-4038-954f-0a60fce27708 None admin] PATH_INFO: `/v3/services/image` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:32.792883 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba340b-0809-4038-954f-0a60fce27708 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:32.794290 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba340b-0809-4038-954f-0a60fce27708 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:32.798188 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ffd9a-9416-4625-a6c6-db7af4794b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:32.798801 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ffd9a-9416-4625-a6c6-db7af4794b04 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:32.799085 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ffd9a-9416-4625-a6c6-db7af4794b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:32.799353 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ffd9a-9416-4625-a6c6-db7af4794b04 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:32.799982 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ffd9a-9416-4625-a6c6-db7af4794b04 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:32.800279 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ffd9a-9416-4625-a6c6-db7af4794b04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:32.802178 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ffd9a-9416-4625-a6c6-db7af4794b04 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:32.804871 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-a6ba340b-0809-4038-954f-0a60fce27708 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 03:28:32.804871 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:32.804871 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 03:28:32.804871 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 03:28:32.804871 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 03:28:32.804871 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 03:28:32.804871 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 03:28:32.804871 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:28:32.804871 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 03:28:32.804871 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:32.804871 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 03:28:32.804871 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:32.804871 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:32.804871 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:32.804871 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:32.804871 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:32.804871 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:32.806089 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:32.806089 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:32.806089 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:32.806089 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:32.806089 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:32.806089 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:32.806089 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 03:28:32.806089 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 03:28:32.806089 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 03:28:32.806089 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 03:28:32.806089 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:32.806089 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:32.806089 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:32.806089 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:32.806089 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:32.806089 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:32.807136 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:32.807136 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:32.807136 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:32.807136 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:32.807136 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:32.807136 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:32.807136 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:32.807136 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:32.807136 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:32.807136 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:32.807136 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 03:28:32.807136 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:28:32.807136 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 03:28:32.807136 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:32.807136 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 487/988] 10.222.0.33 () {56 vars in 1105 bytes} [Fri Sep 16 03:28:32 2022] GET /identity/v3/services/image => generated 86 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:32.811414 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 502/989] 10.222.0.33 () {56 vars in 1122 bytes} [Fri Sep 16 03:28:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:28:32.812161 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba340b-0809-4038-954f-0a60fce27708 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:32.816914 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ffd9a-9416-4625-a6c6-db7af4794b04 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:32.828461 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:32.880602 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:32.927802 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ffd9a-9416-4625-a6c6-db7af4794b04 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:32.928139 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba340b-0809-4038-954f-0a60fce27708 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:32.966349 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74364e-9e36-4f3a-9361-2eb2c0c6f2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:32.966897 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74364e-9e36-4f3a-9361-2eb2c0c6f2a0 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:32.967167 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74364e-9e36-4f3a-9361-2eb2c0c6f2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:32.967440 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74364e-9e36-4f3a-9361-2eb2c0c6f2a0 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:32.967960 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924904b-a735-4bc2-ba1f-9a5805c77a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:32.968103 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b74364e-9e36-4f3a-9361-2eb2c0c6f2a0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:32.968367 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b74364e-9e36-4f3a-9361-2eb2c0c6f2a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:32.968974 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924904b-a735-4bc2-ba1f-9a5805c77a75 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:32.969393 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924904b-a735-4bc2-ba1f-9a5805c77a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:32.969775 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b74364e-9e36-4f3a-9361-2eb2c0c6f2a0 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:32.970000 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924904b-a735-4bc2-ba1f-9a5805c77a75 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:32.970773 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2924904b-a735-4bc2-ba1f-9a5805c77a75 None admin] RBAC: Adding query filter params (name=image) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:32.971213 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2924904b-a735-4bc2-ba1f-9a5805c77a75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:32.972706 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2924904b-a735-4bc2-ba1f-9a5805c77a75 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:33.019363 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 503/990] 10.222.0.33 () {56 vars in 1122 bytes} [Fri Sep 16 03:28:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:28:33.021970 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 488/991] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:28:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:33.025698 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74364e-9e36-4f3a-9361-2eb2c0c6f2a0 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:33.025939 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924904b-a735-4bc2-ba1f-9a5805c77a75 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:33.102582 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:33.128034 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924904b-a735-4bc2-ba1f-9a5805c77a75 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:33.136933 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74364e-9e36-4f3a-9361-2eb2c0c6f2a0 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:33.146861 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:33.165694 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a061656-9f11-4bec-903a-acbe28f96436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:33.166351 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a061656-9f11-4bec-903a-acbe28f96436 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:33.166712 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a061656-9f11-4bec-903a-acbe28f96436 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:33.167058 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a061656-9f11-4bec-903a-acbe28f96436 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:33.167865 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a061656-9f11-4bec-903a-acbe28f96436 None admin] RBAC: Adding query filter params (interface=admin, service_id=c763da72a0f84f7a99cc6d27faa306fe, region_id=RegionOne) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:33.168246 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a061656-9f11-4bec-903a-acbe28f96436 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:33.169695 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a061656-9f11-4bec-903a-acbe28f96436 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:33.175485 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2464a77-0987-4ede-a765-61a6cd598ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:33.176333 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2464a77-0987-4ede-a765-61a6cd598ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:33.176648 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2464a77-0987-4ede-a765-61a6cd598ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:33.176928 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2464a77-0987-4ede-a765-61a6cd598ab6 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:33.181787 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 489/992] 10.222.0.33 () {56 vars in 1249 bytes} [Fri Sep 16 03:28:33 2022] GET /identity/v3/endpoints?service_id=c763da72a0f84f7a99cc6d27faa306fe&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:28:33.182034 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2464a77-0987-4ede-a765-61a6cd598ab6 None admin] RBAC: Adding query filter params (type=image) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:33.182034 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2464a77-0987-4ede-a765-61a6cd598ab6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:33.182034 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2464a77-0987-4ede-a765-61a6cd598ab6 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:33.183125 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a061656-9f11-4bec-903a-acbe28f96436 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:33.193675 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 504/993] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:28:33 2022] GET /identity/v3/services?type=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:28:33.294934 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a061656-9f11-4bec-903a-acbe28f96436 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:33.331642 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29364eb8-4fd8-488a-9a0e-0e37ad255d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:33.332274 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29364eb8-4fd8-488a-9a0e-0e37ad255d4c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:33.332552 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29364eb8-4fd8-488a-9a0e-0e37ad255d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:33.332866 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29364eb8-4fd8-488a-9a0e-0e37ad255d4c None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:33.333478 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29364eb8-4fd8-488a-9a0e-0e37ad255d4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:33.335063 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29364eb8-4fd8-488a-9a0e-0e37ad255d4c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:33.349717 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 490/994] 10.222.0.33 () {56 vars in 1087 bytes} [Fri Sep 16 03:28:33 2022] GET /identity/v3/services => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:28:34.803168 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19b2d3-8da3-40ec-8c8a-7f36a6559aad None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:34.803719 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19b2d3-8da3-40ec-8c8a-7f36a6559aad None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:34.803719 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19b2d3-8da3-40ec-8c8a-7f36a6559aad None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:34.805185 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 505/995] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:28:34.810227 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c73af1-077a-4882-968a-26e9415f5c22 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:34.810599 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c73af1-077a-4882-968a-26e9415f5c22 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:34.810779 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c73af1-077a-4882-968a-26e9415f5c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:34.829159 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-41c73af1-077a-4882-968a-26e9415f5c22 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:34.830378 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-41c73af1-077a-4882-968a-26e9415f5c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:34.872720 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:34.897626 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 491/996] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:34 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:28:35.168943 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19b2d3-8da3-40ec-8c8a-7f36a6559aad None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:35.276465 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19b2d3-8da3-40ec-8c8a-7f36a6559aad None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:35.310580 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b1fb4-a387-4da3-b89f-d78ea88125d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:35.311215 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b1fb4-a387-4da3-b89f-d78ea88125d2 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:35.311487 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b1fb4-a387-4da3-b89f-d78ea88125d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:35.311760 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b1fb4-a387-4da3-b89f-d78ea88125d2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:35.312350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b1fb4-a387-4da3-b89f-d78ea88125d2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:35.313762 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b1fb4-a387-4da3-b89f-d78ea88125d2 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:35.315478 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:35.323784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-ed0b1fb4-a387-4da3-b89f-d78ea88125d2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 03:28:35.323784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:35.323784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 03:28:35.323784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 03:28:35.323784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 03:28:35.323784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 03:28:35.323784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 03:28:35.323784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:28:35.323784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 03:28:35.323784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:35.323784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 03:28:35.323784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:35.323784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:35.323784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:35.323784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:35.323784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:35.323784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:35.324840 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:35.324840 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:35.324840 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:35.324840 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:35.324840 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:35.324840 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:35.324840 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 03:28:35.324840 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 03:28:35.324840 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 03:28:35.324840 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 03:28:35.324840 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:35.324840 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:35.324840 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:35.324840 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:35.324840 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:35.324840 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:35.326110 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:35.326110 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:35.326110 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:35.326110 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:35.326110 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:35.326110 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:35.326110 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:35.326110 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:35.326110 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:35.326110 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:35.326110 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 03:28:35.326110 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:28:35.326110 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 03:28:35.326110 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:35.327415 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 506/997] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:28:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:35.331380 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58401131-92fc-4c91-95ba-ad781e7e7d92 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:35.331380 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58401131-92fc-4c91-95ba-ad781e7e7d92 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:35.331380 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58401131-92fc-4c91-95ba-ad781e7e7d92 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:35.331621 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b1fb4-a387-4da3-b89f-d78ea88125d2 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:35.333853 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 492/998] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:28:35.337085 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326488ad-9b89-4ae5-b5e0-3a5af88d50f0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:35.337377 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326488ad-9b89-4ae5-b5e0-3a5af88d50f0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:35.337679 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326488ad-9b89-4ae5-b5e0-3a5af88d50f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:35.355582 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-326488ad-9b89-4ae5-b5e0-3a5af88d50f0 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:35.356769 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-326488ad-9b89-4ae5-b5e0-3a5af88d50f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:35.431888 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 493/999] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:35 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 03:28:35.442348 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b1fb4-a387-4da3-b89f-d78ea88125d2 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:35.476615 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c5888-d303-485f-8d14-f799849b0e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:35.477219 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c5888-d303-485f-8d14-f799849b0e13 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:35.477498 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c5888-d303-485f-8d14-f799849b0e13 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:35.477799 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c5888-d303-485f-8d14-f799849b0e13 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:35.478454 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322c5888-d303-485f-8d14-f799849b0e13 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:35.478740 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322c5888-d303-485f-8d14-f799849b0e13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:35.480083 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322c5888-d303-485f-8d14-f799849b0e13 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:35.490069 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 507/1000] 10.222.0.33 () {56 vars in 1112 bytes} [Fri Sep 16 03:28:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:35.491148 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326488ad-9b89-4ae5-b5e0-3a5af88d50f0 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:35.514704 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af981a-100f-419f-8ea9-add21593d979 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:35.514994 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af981a-100f-419f-8ea9-add21593d979 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:35.515283 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af981a-100f-419f-8ea9-add21593d979 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:35.516718 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 508/1001] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 03:28:35.521805 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fcefe-7712-4274-9d14-44d4c88b3b9f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:35.522098 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fcefe-7712-4274-9d14-44d4c88b3b9f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:35.522378 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fcefe-7712-4274-9d14-44d4c88b3b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:35.540720 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-903fcefe-7712-4274-9d14-44d4c88b3b9f None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:35.541938 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-903fcefe-7712-4274-9d14-44d4c88b3b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:35.594996 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326488ad-9b89-4ae5-b5e0-3a5af88d50f0 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:35.599974 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:35.604990 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:35.610228 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 509/1002] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:35 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 03:28:35.632529 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c69911-0515-4a18-92ec-32493a6cf488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:35.633137 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c69911-0515-4a18-92ec-32493a6cf488 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:35.633416 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c69911-0515-4a18-92ec-32493a6cf488 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:35.633722 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c69911-0515-4a18-92ec-32493a6cf488 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:35.634346 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c69911-0515-4a18-92ec-32493a6cf488 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:35.634703 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c69911-0515-4a18-92ec-32493a6cf488 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:35.640899 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c69911-0515-4a18-92ec-32493a6cf488 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:35.640899 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 494/1003] 10.222.0.33 () {56 vars in 1112 bytes} [Fri Sep 16 03:28:35 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:28:35.647385 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fcefe-7712-4274-9d14-44d4c88b3b9f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:35.701621 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c69911-0515-4a18-92ec-32493a6cf488 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:35.750936 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fcefe-7712-4274-9d14-44d4c88b3b9f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:35.785759 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ce891-3900-4724-b81c-8319d496a6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:35.786388 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ce891-3900-4724-b81c-8319d496a6a8 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:35.786670 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ce891-3900-4724-b81c-8319d496a6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:35.786945 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ce891-3900-4724-b81c-8319d496a6a8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:35.787641 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ce891-3900-4724-b81c-8319d496a6a8 None admin] RBAC: Adding query filter params (interface=public, service_id=14d02c53630e46b08570709aed52deb2, region_id=RegionOne) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:35.787949 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ce891-3900-4724-b81c-8319d496a6a8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:35.789300 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ce891-3900-4724-b81c-8319d496a6a8 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:35.794163 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 510/1004] 10.222.0.33 () {56 vars in 1251 bytes} [Fri Sep 16 03:28:35 2022] GET /identity/v3/endpoints?service_id=14d02c53630e46b08570709aed52deb2&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:35.799936 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ce891-3900-4724-b81c-8319d496a6a8 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:35.812318 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c69911-0515-4a18-92ec-32493a6cf488 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:35.847885 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b2f9e-0a8c-4883-ad1c-ea2731cd01d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:35.848518 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b2f9e-0a8c-4883-ad1c-ea2731cd01d6 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:35.848797 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b2f9e-0a8c-4883-ad1c-ea2731cd01d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:35.849068 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b2f9e-0a8c-4883-ad1c-ea2731cd01d6 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:35.849862 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b2f9e-0a8c-4883-ad1c-ea2731cd01d6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:35.851333 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b2f9e-0a8c-4883-ad1c-ea2731cd01d6 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:35.856772 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:35.899127 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ce891-3900-4724-b81c-8319d496a6a8 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:35.931981 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d8786-4c6b-4161-a4c4-7092e24bc399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:35.932585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d8786-4c6b-4161-a4c4-7092e24bc399 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:35.932861 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d8786-4c6b-4161-a4c4-7092e24bc399 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:35.933134 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d8786-4c6b-4161-a4c4-7092e24bc399 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:35.933759 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636d8786-4c6b-4161-a4c4-7092e24bc399 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:35.935108 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636d8786-4c6b-4161-a4c4-7092e24bc399 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:35.941097 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 511/1005] 10.222.0.33 () {56 vars in 1087 bytes} [Fri Sep 16 03:28:35 2022] GET /identity/v3/services => generated 1727 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:28:35.941882 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d8786-4c6b-4161-a4c4-7092e24bc399 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:35.958704 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 495/1006] 10.222.0.33 () {60 vars in 1141 bytes} [Fri Sep 16 03:28:35 2022] POST /identity/v3/services => generated 242 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:28:36.061244 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d8786-4c6b-4161-a4c4-7092e24bc399 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:36.089374 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:36.112875 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400d748-2409-4426-affb-629f00cd12c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:36.113664 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400d748-2409-4426-affb-629f00cd12c9 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:36.114086 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400d748-2409-4426-affb-629f00cd12c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:36.114431 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400d748-2409-4426-affb-629f00cd12c9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:36.115108 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1400d748-2409-4426-affb-629f00cd12c9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:36.116594 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1400d748-2409-4426-affb-629f00cd12c9 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:36.126594 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-1400d748-2409-4426-affb-629f00cd12c9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 03:28:36.126594 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:36.126594 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 03:28:36.126594 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 03:28:36.126594 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 03:28:36.126594 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 03:28:36.126594 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 03:28:36.126594 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:28:36.126594 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 03:28:36.126594 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:36.126594 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 03:28:36.126594 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:36.126594 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:36.126594 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:36.126594 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:36.126594 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:36.126594 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:36.127848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:36.127848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:36.127848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:36.127848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:36.127848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:36.127848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:36.127848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 03:28:36.127848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 03:28:36.127848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 03:28:36.127848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 03:28:36.127848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:36.127848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:36.127848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:36.127848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:36.127848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:36.127848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:36.128746 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:36.128746 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:36.128746 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:36.128746 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:36.128746 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:36.128746 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:36.128746 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:36.128746 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:36.128746 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:36.128746 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:36.128746 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 03:28:36.128746 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:28:36.128746 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 03:28:36.128746 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:36.132235 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 512/1007] 10.222.0.33 () {56 vars in 1126 bytes} [Fri Sep 16 03:28:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:36.138740 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b2f9e-0a8c-4883-ad1c-ea2731cd01d6 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:36.173516 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:36.243689 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b2f9e-0a8c-4883-ad1c-ea2731cd01d6 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:36.277779 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93181c-0d48-4389-a4c2-83ddf67687c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:36.278394 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93181c-0d48-4389-a4c2-83ddf67687c0 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:36.278673 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93181c-0d48-4389-a4c2-83ddf67687c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:36.279062 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93181c-0d48-4389-a4c2-83ddf67687c0 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:36.279693 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93181c-0d48-4389-a4c2-83ddf67687c0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:36.279998 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93181c-0d48-4389-a4c2-83ddf67687c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:36.281364 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93181c-0d48-4389-a4c2-83ddf67687c0 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:36.286425 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 496/1008] 10.222.0.33 () {56 vars in 1122 bytes} [Fri Sep 16 03:28:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:36.291955 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400d748-2409-4426-affb-629f00cd12c9 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:36.394781 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400d748-2409-4426-affb-629f00cd12c9 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:36.428467 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f66cd-027a-4cfd-89a9-f6d92fd6387b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:36.429078 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f66cd-027a-4cfd-89a9-f6d92fd6387b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:36.429357 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f66cd-027a-4cfd-89a9-f6d92fd6387b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:36.429658 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f66cd-027a-4cfd-89a9-f6d92fd6387b None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:36.430273 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f66cd-027a-4cfd-89a9-f6d92fd6387b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:36.430573 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f66cd-027a-4cfd-89a9-f6d92fd6387b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:36.431933 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f66cd-027a-4cfd-89a9-f6d92fd6387b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:36.441387 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 513/1009] 10.222.0.33 () {56 vars in 1122 bytes} [Fri Sep 16 03:28:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:36.442639 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93181c-0d48-4389-a4c2-83ddf67687c0 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:36.538861 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:36.545855 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93181c-0d48-4389-a4c2-83ddf67687c0 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:36.577731 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f725a-db1a-4edd-9222-830a25411f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:36.578361 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f725a-db1a-4edd-9222-830a25411f28 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:36.578642 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f725a-db1a-4edd-9222-830a25411f28 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:36.579285 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f725a-db1a-4edd-9222-830a25411f28 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:36.580315 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f725a-db1a-4edd-9222-830a25411f28 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:36.582258 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f725a-db1a-4edd-9222-830a25411f28 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:36.658774 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 497/1010] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:28:36 2022] POST /identity/v3/endpoints => generated 325 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:28:38.145412 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca7078-149e-467a-8eba-2e70151ea2c1 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:38.145990 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca7078-149e-467a-8eba-2e70151ea2c1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:38.145990 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca7078-149e-467a-8eba-2e70151ea2c1 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:38.147491 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 514/1011] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:28:38.152430 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf7c0a-4e94-4758-a1c7-eca51875b8e9 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:38.152822 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf7c0a-4e94-4758-a1c7-eca51875b8e9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:38.152982 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf7c0a-4e94-4758-a1c7-eca51875b8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:38.171378 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4aaf7c0a-4e94-4758-a1c7-eca51875b8e9 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:38.172572 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4aaf7c0a-4e94-4758-a1c7-eca51875b8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:38.187379 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f25d17-be0b-45b6-b308-96a6d10aa278 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:38.187660 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f25d17-be0b-45b6-b308-96a6d10aa278 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:38.187930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f25d17-be0b-45b6-b308-96a6d10aa278 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:38.189448 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 515/1012] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:28:38.194101 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c465d8-8794-48d8-ac53-47a5ff8530f2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:38.194387 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c465d8-8794-48d8-ac53-47a5ff8530f2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:38.194663 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c465d8-8794-48d8-ac53-47a5ff8530f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:38.214472 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-93c465d8-8794-48d8-ac53-47a5ff8530f2 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:38.215660 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-93c465d8-8794-48d8-ac53-47a5ff8530f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:38.246529 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 498/1013] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:38 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:28:38.259065 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:38.285660 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 516/1014] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:38 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 03:28:38.515814 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf7c0a-4e94-4758-a1c7-eca51875b8e9 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:38.555141 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c465d8-8794-48d8-ac53-47a5ff8530f2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:38.599096 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:38.617445 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf7c0a-4e94-4758-a1c7-eca51875b8e9 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:38.653278 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fba8f-1b14-4ffa-bd6c-11cc1d060f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:38.654067 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fba8f-1b14-4ffa-bd6c-11cc1d060f5a None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:38.654292 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fba8f-1b14-4ffa-bd6c-11cc1d060f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:38.654539 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fba8f-1b14-4ffa-bd6c-11cc1d060f5a None admin] PATH_INFO: `/v3/services/compute` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:38.655116 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11fba8f-1b14-4ffa-bd6c-11cc1d060f5a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:38.656489 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11fba8f-1b14-4ffa-bd6c-11cc1d060f5a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:38.664883 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c465d8-8794-48d8-ac53-47a5ff8530f2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:38.665377 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-f11fba8f-1b14-4ffa-bd6c-11cc1d060f5a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 03:28:38.665377 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:38.665377 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 03:28:38.665377 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 03:28:38.665377 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 03:28:38.665377 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 03:28:38.665377 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 03:28:38.665377 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:28:38.665377 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 03:28:38.665377 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:38.665377 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 03:28:38.665377 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:38.665377 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:38.665377 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:38.665377 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:38.665377 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:38.665377 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:38.666513 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:38.666513 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:38.666513 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:38.666513 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:38.666513 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:38.666513 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:38.666513 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 03:28:38.666513 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 03:28:38.666513 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 03:28:38.666513 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 03:28:38.666513 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:38.666513 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:38.666513 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:38.666513 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:38.666513 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:38.666513 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:38.667354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:38.667354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:38.667354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:38.667354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:38.667354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:38.667354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:38.667354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:38.667354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:38.667354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:38.667354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:38.667354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 03:28:38.667354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:28:38.667354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 03:28:38.667354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:38.667354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 499/1015] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:28:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:38.673267 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fba8f-1b14-4ffa-bd6c-11cc1d060f5a None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:38.713352 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c7c8e2-83a0-49f9-98a8-9bb9fdabc34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:38.714060 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7c8e2-83a0-49f9-98a8-9bb9fdabc34f None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:38.714346 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7c8e2-83a0-49f9-98a8-9bb9fdabc34f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:38.714623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7c8e2-83a0-49f9-98a8-9bb9fdabc34f None admin] PATH_INFO: `/v3/services/image` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:38.715230 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c7c8e2-83a0-49f9-98a8-9bb9fdabc34f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:38.716723 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c7c8e2-83a0-49f9-98a8-9bb9fdabc34f None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:38.726600 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-48c7c8e2-83a0-49f9-98a8-9bb9fdabc34f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 03:28:38.726600 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:38.726600 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 03:28:38.726600 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 03:28:38.726600 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 03:28:38.726600 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 03:28:38.726600 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 03:28:38.726600 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:28:38.726600 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 03:28:38.726600 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:38.726600 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 03:28:38.726600 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:38.726600 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:38.726600 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:38.726600 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:38.726600 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:38.726600 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:38.727714 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:38.727714 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:38.727714 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:38.727714 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:38.727714 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:38.727714 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:38.727714 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 03:28:38.727714 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 03:28:38.727714 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 03:28:38.727714 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 03:28:38.727714 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:38.727714 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:38.727714 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:38.727714 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:38.727714 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:38.727714 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:38.728575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:38.728575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:38.728575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:38.728575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:38.728575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:38.728575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:38.728575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:38.728575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:38.728575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:38.728575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:38.728575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 03:28:38.728575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:28:38.728575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 03:28:38.728575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:38.728575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 517/1016] 10.222.0.33 () {56 vars in 1105 bytes} [Fri Sep 16 03:28:38 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:28:38.734150 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c7c8e2-83a0-49f9-98a8-9bb9fdabc34f None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:38.782367 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:38.794049 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fba8f-1b14-4ffa-bd6c-11cc1d060f5a None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:38.829586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c272a-b5fc-4c09-a98c-59d646082d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:38.830221 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c272a-b5fc-4c09-a98c-59d646082d3a None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:38.830506 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c272a-b5fc-4c09-a98c-59d646082d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:38.830778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c272a-b5fc-4c09-a98c-59d646082d3a None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:38.831400 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c272a-b5fc-4c09-a98c-59d646082d3a None admin] RBAC: Adding query filter params (name=compute) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:38.831704 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c272a-b5fc-4c09-a98c-59d646082d3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:38.833608 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c272a-b5fc-4c09-a98c-59d646082d3a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:38.838297 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 500/1017] 10.222.0.33 () {56 vars in 1112 bytes} [Fri Sep 16 03:28:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:28:38.843965 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce99cce-ad00-4180-9be6-70af89d585e4 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:38.844249 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce99cce-ad00-4180-9be6-70af89d585e4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:38.844521 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce99cce-ad00-4180-9be6-70af89d585e4 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:38.845743 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 501/1018] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:28:38.846020 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c7c8e2-83a0-49f9-98a8-9bb9fdabc34f None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:38.846436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce99cce-ad00-4180-9be6-70af89d585e4 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:38.857643 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:38.883430 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb8b32-5c54-4a8d-aafa-bf6e0edd9005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:38.884037 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb8b32-5c54-4a8d-aafa-bf6e0edd9005 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:38.884318 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb8b32-5c54-4a8d-aafa-bf6e0edd9005 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:38.884591 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb8b32-5c54-4a8d-aafa-bf6e0edd9005 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:38.885214 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb8b32-5c54-4a8d-aafa-bf6e0edd9005 None admin] RBAC: Adding query filter params (name=image) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:38.885516 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb8b32-5c54-4a8d-aafa-bf6e0edd9005 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:38.886907 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb8b32-5c54-4a8d-aafa-bf6e0edd9005 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:38.892013 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 518/1019] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:28:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:38.893142 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ecd29c-0c1f-44c0-a513-37c4ef704484 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:38.893430 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ecd29c-0c1f-44c0-a513-37c4ef704484 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:38.893736 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ecd29c-0c1f-44c0-a513-37c4ef704484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:38.911775 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a4ecd29c-0c1f-44c0-a513-37c4ef704484 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:38.912967 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a4ecd29c-0c1f-44c0-a513-37c4ef704484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:38.946926 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce99cce-ad00-4180-9be6-70af89d585e4 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:38.985682 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 519/1020] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:38 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:28:38.985853 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c3aab9-091e-4139-92ac-5231b1927b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:38.985853 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3aab9-091e-4139-92ac-5231b1927b47 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:38.986066 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ecd29c-0c1f-44c0-a513-37c4ef704484 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:38.986165 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3aab9-091e-4139-92ac-5231b1927b47 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:38.986165 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3aab9-091e-4139-92ac-5231b1927b47 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:38.986165 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c3aab9-091e-4139-92ac-5231b1927b47 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:38.986165 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c3aab9-091e-4139-92ac-5231b1927b47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:38.986165 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c3aab9-091e-4139-92ac-5231b1927b47 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:38.991462 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 502/1021] 10.222.0.33 () {56 vars in 1112 bytes} [Fri Sep 16 03:28:38 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:38.996931 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c3aab9-091e-4139-92ac-5231b1927b47 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:39.014726 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:39.068219 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:39.088553 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ecd29c-0c1f-44c0-a513-37c4ef704484 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:39.098036 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c3aab9-091e-4139-92ac-5231b1927b47 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:39.124970 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f03dc-aad8-4802-abca-0cda3e8dbe85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:39.125938 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f03dc-aad8-4802-abca-0cda3e8dbe85 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:39.126457 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f03dc-aad8-4802-abca-0cda3e8dbe85 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:39.127324 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f03dc-aad8-4802-abca-0cda3e8dbe85 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:39.128115 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f03dc-aad8-4802-abca-0cda3e8dbe85 None admin] RBAC: Adding query filter params (type=image) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:39.128584 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f03dc-aad8-4802-abca-0cda3e8dbe85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:39.130633 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f03dc-aad8-4802-abca-0cda3e8dbe85 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:39.130753 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a74080-b61c-49cb-84fb-294bd39b5616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:39.131458 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a74080-b61c-49cb-84fb-294bd39b5616 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:39.131789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a74080-b61c-49cb-84fb-294bd39b5616 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:39.132072 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a74080-b61c-49cb-84fb-294bd39b5616 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:39.132735 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a74080-b61c-49cb-84fb-294bd39b5616 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:39.134136 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a74080-b61c-49cb-84fb-294bd39b5616 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:39.136714 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 520/1022] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:28:38 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:39.142432 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f03dc-aad8-4802-abca-0cda3e8dbe85 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:39.233932 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:39.239549 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f03dc-aad8-4802-abca-0cda3e8dbe85 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:39.272957 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d363445-21f2-4e4c-9e29-bd7a2cb1a60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:39.273559 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d363445-21f2-4e4c-9e29-bd7a2cb1a60d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:39.273867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d363445-21f2-4e4c-9e29-bd7a2cb1a60d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:39.274138 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d363445-21f2-4e4c-9e29-bd7a2cb1a60d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:39.274826 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d363445-21f2-4e4c-9e29-bd7a2cb1a60d None admin] RBAC: Adding query filter params (interface=public, service_id=645024acd97a403f85225b8a4be6ef8c, region_id=RegionOne) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:39.275134 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d363445-21f2-4e4c-9e29-bd7a2cb1a60d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:39.276480 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d363445-21f2-4e4c-9e29-bd7a2cb1a60d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:39.281230 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 521/1023] 10.222.0.33 () {56 vars in 1251 bytes} [Fri Sep 16 03:28:39 2022] GET /identity/v3/endpoints?service_id=645024acd97a403f85225b8a4be6ef8c&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:39.282007 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d363445-21f2-4e4c-9e29-bd7a2cb1a60d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:39.357751 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 503/1024] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:28:38 2022] POST /identity/v3/endpoints => generated 334 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:28:39.358415 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a74080-b61c-49cb-84fb-294bd39b5616 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:39.385542 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d363445-21f2-4e4c-9e29-bd7a2cb1a60d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:39.436817 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3bd828-c849-46d4-9f92-1a06662af7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:39.437468 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3bd828-c849-46d4-9f92-1a06662af7f6 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:39.437783 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3bd828-c849-46d4-9f92-1a06662af7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:39.438086 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3bd828-c849-46d4-9f92-1a06662af7f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:39.439283 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3bd828-c849-46d4-9f92-1a06662af7f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:39.440750 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3bd828-c849-46d4-9f92-1a06662af7f6 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:39.443231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 522/1025] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:28:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:39.449115 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3bd828-c849-46d4-9f92-1a06662af7f6 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:39.476797 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:39.481726 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a74080-b61c-49cb-84fb-294bd39b5616 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:39.511105 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:39.519564 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cd72c-ee9e-4e03-884f-3a5be19dda50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:39.521215 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cd72c-ee9e-4e03-884f-3a5be19dda50 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:39.521592 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cd72c-ee9e-4e03-884f-3a5be19dda50 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:39.521999 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cd72c-ee9e-4e03-884f-3a5be19dda50 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:39.522647 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395cd72c-ee9e-4e03-884f-3a5be19dda50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:39.524032 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395cd72c-ee9e-4e03-884f-3a5be19dda50 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:39.531375 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 504/1026] 10.222.0.33 () {56 vars in 1087 bytes} [Fri Sep 16 03:28:39 2022] GET /identity/v3/services => generated 1957 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:28:39.569240 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3bd828-c849-46d4-9f92-1a06662af7f6 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:39.611820 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff4ee7b-4350-4150-91a2-6f960a06d9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:39.612364 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4ee7b-4350-4150-91a2-6f960a06d9cc None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:39.612643 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4ee7b-4350-4150-91a2-6f960a06d9cc None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:39.612914 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4ee7b-4350-4150-91a2-6f960a06d9cc None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:39.613581 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff4ee7b-4350-4150-91a2-6f960a06d9cc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:39.615588 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff4ee7b-4350-4150-91a2-6f960a06d9cc None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:39.702573 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 523/1027] 10.222.0.33 () {60 vars in 1141 bytes} [Fri Sep 16 03:28:39 2022] POST /identity/v3/projects => generated 311 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:28:41.647769 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ad4d2-e709-43dc-a783-122ac666cf70 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:41.648289 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ad4d2-e709-43dc-a783-122ac666cf70 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:41.648367 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ad4d2-e709-43dc-a783-122ac666cf70 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:41.649719 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 505/1028] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:28:41.654803 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ca56a-fe4b-45d4-b5be-85427591961c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:41.655209 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ca56a-fe4b-45d4-b5be-85427591961c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:41.655370 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ca56a-fe4b-45d4-b5be-85427591961c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:41.674008 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9f1ca56a-fe4b-45d4-b5be-85427591961c None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:41.675191 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9f1ca56a-fe4b-45d4-b5be-85427591961c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:41.696716 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a96b0-103f-4740-ad30-11e95b2f935a None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:41.697051 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a96b0-103f-4740-ad30-11e95b2f935a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:41.697268 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a96b0-103f-4740-ad30-11e95b2f935a None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:41.699293 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 506/1029] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:28:41.704160 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908b33c-1a33-4b9e-92ec-9270972be229 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:41.704943 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908b33c-1a33-4b9e-92ec-9270972be229 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:41.704943 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908b33c-1a33-4b9e-92ec-9270972be229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:41.724249 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d908b33c-1a33-4b9e-92ec-9270972be229 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:41.725615 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d908b33c-1a33-4b9e-92ec-9270972be229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:41.752312 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 524/1030] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:41 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:28:41.801507 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 507/1031] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:41 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 03:28:41.881264 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e69977-d569-42ee-a338-d6d2189775dc None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:41.881569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e69977-d569-42ee-a338-d6d2189775dc None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:41.881859 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e69977-d569-42ee-a338-d6d2189775dc None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:41.883365 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 525/1032] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:28:41.888376 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb3258-48e0-44cc-bed9-c1fe4a74d2fc None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:41.888665 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb3258-48e0-44cc-bed9-c1fe4a74d2fc None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:41.888942 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb3258-48e0-44cc-bed9-c1fe4a74d2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:41.907242 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5ccb3258-48e0-44cc-bed9-c1fe4a74d2fc None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:41.908372 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5ccb3258-48e0-44cc-bed9-c1fe4a74d2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:41.977782 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 508/1033] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:41 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:28:42.018504 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e69977-d569-42ee-a338-d6d2189775dc None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:42.028266 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:42.079704 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb3258-48e0-44cc-bed9-c1fe4a74d2fc None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:42.123352 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e69977-d569-42ee-a338-d6d2189775dc None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:42.133127 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:42.163374 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23f88a-f342-4b99-9c15-354714efa302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:42.163926 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23f88a-f342-4b99-9c15-354714efa302 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:42.164204 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23f88a-f342-4b99-9c15-354714efa302 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:42.164476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23f88a-f342-4b99-9c15-354714efa302 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:42.174775 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b23f88a-f342-4b99-9c15-354714efa302 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:28:42.180280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-3b23f88a-f342-4b99-9c15-354714efa302 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 03:28:42.180280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:42.180280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:42.180280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:42.180280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:42.180280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:42.180280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:42.180280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:42.180280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:42.180280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:42.180280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:42.180280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:42.180280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:28:42.180280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:28:42.180280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:28:42.180280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:28:42.181247 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:28:42.181247 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:28:42.181247 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:28:42.181247 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:28:42.181247 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:42.181247 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:42.181247 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:42.181247 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:42.181247 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:42.181247 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:42.181247 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:42.181247 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:42.181247 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:42.181247 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:42.181247 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:42.181247 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:42.182148 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:42.182148 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:42.182148 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:42.182148 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:42.182148 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:28:42.182148 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:28:42.182148 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:28:42.182148 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:28:42.182148 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:28:42.182148 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:28:42.182148 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 03:28:42.182148 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:42.182148 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 526/1034] 10.222.0.33 () {56 vars in 1120 bytes} [Fri Sep 16 03:28:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:42.185623 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb3258-48e0-44cc-bed9-c1fe4a74d2fc None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:42.187437 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23f88a-f342-4b99-9c15-354714efa302 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:42.222243 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d69d3f-6e94-4eae-a07c-ab25416a30ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:42.222799 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d69d3f-6e94-4eae-a07c-ab25416a30ac None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:42.223591 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d69d3f-6e94-4eae-a07c-ab25416a30ac None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:42.223863 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d69d3f-6e94-4eae-a07c-ab25416a30ac None admin] PATH_INFO: `/v3/services/image` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:42.224754 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d69d3f-6e94-4eae-a07c-ab25416a30ac None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:42.225913 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d69d3f-6e94-4eae-a07c-ab25416a30ac None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:42.234569 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-32d69d3f-6e94-4eae-a07c-ab25416a30ac None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 03:28:42.234569 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:42.234569 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 03:28:42.234569 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 03:28:42.234569 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 03:28:42.234569 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 03:28:42.234569 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 03:28:42.234569 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:28:42.234569 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 03:28:42.234569 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:42.234569 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 03:28:42.234569 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:42.234569 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:42.234569 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:42.234569 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:42.234569 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:42.234569 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:42.235544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:42.235544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:42.235544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:42.235544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:42.235544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:42.235544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:42.235544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 03:28:42.235544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 03:28:42.235544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 03:28:42.235544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 03:28:42.235544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:42.235544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:42.235544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:42.235544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:42.235544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:42.235544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:42.236379 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:42.236379 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:42.236379 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:42.236379 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:42.236379 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:42.236379 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:42.236379 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:42.236379 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:42.236379 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:42.236379 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:42.236379 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 03:28:42.236379 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:28:42.236379 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 03:28:42.236379 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:42.236379 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 509/1035] 10.222.0.33 () {56 vars in 1105 bytes} [Fri Sep 16 03:28:42 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:28:42.242776 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d69d3f-6e94-4eae-a07c-ab25416a30ac None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:42.262957 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:42.296643 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23f88a-f342-4b99-9c15-354714efa302 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:42.330017 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da417e-3de1-437b-8f24-8f61d3e66a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:42.330648 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da417e-3de1-437b-8f24-8f61d3e66a5c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:42.330938 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da417e-3de1-437b-8f24-8f61d3e66a5c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:42.331206 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da417e-3de1-437b-8f24-8f61d3e66a5c None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:42.331863 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da417e-3de1-437b-8f24-8f61d3e66a5c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:42.332165 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da417e-3de1-437b-8f24-8f61d3e66a5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:42.333565 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da417e-3de1-437b-8f24-8f61d3e66a5c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:42.339821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d69d3f-6e94-4eae-a07c-ab25416a30ac None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:42.341291 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 527/1036] 10.222.0.33 () {56 vars in 1115 bytes} [Fri Sep 16 03:28:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:28:42.342094 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da417e-3de1-437b-8f24-8f61d3e66a5c None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:42.356554 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:42.374475 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480159f-f361-43e3-bec4-fcebef45e20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:42.375073 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480159f-f361-43e3-bec4-fcebef45e20e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:42.375347 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480159f-f361-43e3-bec4-fcebef45e20e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:42.375658 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480159f-f361-43e3-bec4-fcebef45e20e None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:42.376277 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480159f-f361-43e3-bec4-fcebef45e20e None admin] RBAC: Adding query filter params (name=image) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:42.376574 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480159f-f361-43e3-bec4-fcebef45e20e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:42.377957 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480159f-f361-43e3-bec4-fcebef45e20e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:42.382645 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 510/1037] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:28:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:28:42.383412 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480159f-f361-43e3-bec4-fcebef45e20e None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:42.441999 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da417e-3de1-437b-8f24-8f61d3e66a5c None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:42.467668 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:42.475973 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d822b-b853-41b5-85d6-2d599c9f1845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:42.476602 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d822b-b853-41b5-85d6-2d599c9f1845 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:42.483417 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d822b-b853-41b5-85d6-2d599c9f1845 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:42.483417 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d822b-b853-41b5-85d6-2d599c9f1845 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:42.483417 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d822b-b853-41b5-85d6-2d599c9f1845 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:42.483417 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d822b-b853-41b5-85d6-2d599c9f1845 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:42.483417 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 528/1038] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:28:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:42.483777 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480159f-f361-43e3-bec4-fcebef45e20e None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:42.483855 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d822b-b853-41b5-85d6-2d599c9f1845 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:42.514785 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fde283-10b0-4dd2-9b27-74f224a34e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:42.515409 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fde283-10b0-4dd2-9b27-74f224a34e39 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:42.515688 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fde283-10b0-4dd2-9b27-74f224a34e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:42.515959 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fde283-10b0-4dd2-9b27-74f224a34e39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:42.526718 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fde283-10b0-4dd2-9b27-74f224a34e39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:42.528157 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fde283-10b0-4dd2-9b27-74f224a34e39 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:42.542270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-99fde283-10b0-4dd2-9b27-74f224a34e39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:42.542270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:42.542270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:42.542270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:42.542270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:42.542270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:42.542270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:42.542270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:42.542270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:42.542270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:42.542270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:42.542270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:42.542270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:28:42.542270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:28:42.542270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:28:42.542270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:28:42.543395 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:42.543395 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:42.543395 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:42.543395 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:42.543395 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:42.543395 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:42.543395 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:42.543395 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:42.543395 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:42.543395 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:42.543395 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:42.543395 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:42.543395 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:42.543395 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:42.543395 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:42.543395 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:42.543395 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:28:42.544497 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:28:42.544497 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:42.544497 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:42.544497 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 511/1039] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:28:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:42.544497 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fde283-10b0-4dd2-9b27-74f224a34e39 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:42.574729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:42.585228 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d822b-b853-41b5-85d6-2d599c9f1845 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:42.620000 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d68a0-448c-448d-ae7c-096e280f28db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:42.620606 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d68a0-448c-448d-ae7c-096e280f28db None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:42.620889 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d68a0-448c-448d-ae7c-096e280f28db None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:42.621162 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d68a0-448c-448d-ae7c-096e280f28db None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:42.621815 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d68a0-448c-448d-ae7c-096e280f28db None admin] RBAC: Adding query filter params (type=image) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:42.622119 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d68a0-448c-448d-ae7c-096e280f28db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:42.623477 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d68a0-448c-448d-ae7c-096e280f28db None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:42.628212 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 529/1040] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:28:42 2022] GET /identity/v3/services?type=image => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:42.628981 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d68a0-448c-448d-ae7c-096e280f28db None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:42.642572 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fde283-10b0-4dd2-9b27-74f224a34e39 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:42.675962 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937df02-943d-40c1-83bd-e9bc8967468c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:42.676601 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937df02-943d-40c1-83bd-e9bc8967468c None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:42.676992 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937df02-943d-40c1-83bd-e9bc8967468c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:42.677335 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937df02-943d-40c1-83bd-e9bc8967468c None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:42.678091 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937df02-943d-40c1-83bd-e9bc8967468c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:42.679592 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937df02-943d-40c1-83bd-e9bc8967468c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:42.688498 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:42.728302 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d68a0-448c-448d-ae7c-096e280f28db None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:42.761623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ff655-e4f5-403a-b03d-b6d13ddcc943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:42.763517 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ff655-e4f5-403a-b03d-b6d13ddcc943 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:42.763517 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ff655-e4f5-403a-b03d-b6d13ddcc943 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:42.763517 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ff655-e4f5-403a-b03d-b6d13ddcc943 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:42.763517 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ff655-e4f5-403a-b03d-b6d13ddcc943 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:42.763925 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ff655-e4f5-403a-b03d-b6d13ddcc943 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:42.765036 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ff655-e4f5-403a-b03d-b6d13ddcc943 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:42.777850 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 530/1041] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:42.778680 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ff655-e4f5-403a-b03d-b6d13ddcc943 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:42.798740 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 512/1042] 10.222.0.33 () {60 vars in 1132 bytes} [Fri Sep 16 03:28:42 2022] POST /identity/v3/users => generated 285 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:28:42.798740 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937df02-943d-40c1-83bd-e9bc8967468c None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:42.890850 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ff655-e4f5-403a-b03d-b6d13ddcc943 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:42.891598 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:42.905216 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937df02-943d-40c1-83bd-e9bc8967468c None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:42.913894 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:42.932068 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a4efa-4004-4aa8-b8f3-ea816f2a5e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:42.932704 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a4efa-4004-4aa8-b8f3-ea816f2a5e6b None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:42.932987 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a4efa-4004-4aa8-b8f3-ea816f2a5e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:42.933261 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a4efa-4004-4aa8-b8f3-ea816f2a5e6b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:42.933980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a4efa-4004-4aa8-b8f3-ea816f2a5e6b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:42.935661 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a4efa-4004-4aa8-b8f3-ea816f2a5e6b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:42.946620 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295f959-8e4c-42e5-813b-1ed347bcaa46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:42.947279 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295f959-8e4c-42e5-813b-1ed347bcaa46 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:42.947566 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295f959-8e4c-42e5-813b-1ed347bcaa46 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:42.947844 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295f959-8e4c-42e5-813b-1ed347bcaa46 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:42.956740 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f295f959-8e4c-42e5-813b-1ed347bcaa46 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:42.958189 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f295f959-8e4c-42e5-813b-1ed347bcaa46 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:42.970000 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-f295f959-8e4c-42e5-813b-1ed347bcaa46 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 03:28:42.970000 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:42.970000 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:42.970000 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:42.970000 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:42.970000 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:42.970000 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:42.970000 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:42.970000 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:42.970000 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:42.970000 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:42.970000 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:42.970000 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 03:28:42.970000 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 03:28:42.970000 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 03:28:42.970000 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 03:28:42.971037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:42.971037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:42.971037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 03:28:42.971037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:28:42.971037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 03:28:42.971037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:28:42.971037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:42.971037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:42.971037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:42.971037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:42.971037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:42.971037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:42.971037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:42.971037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:42.971037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:42.971037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:42.971037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:42.971037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:42.971972 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:42.971972 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:42.971972 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 03:28:42.971972 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 03:28:42.971972 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 03:28:42.971972 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 03:28:42.971972 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 03:28:42.971972 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 03:28:42.971972 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 03:28:42.971972 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:42.971972 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 513/1043] 10.222.0.33 () {56 vars in 1093 bytes} [Fri Sep 16 03:28:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:42.977335 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295f959-8e4c-42e5-813b-1ed347bcaa46 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:43.042568 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 531/1044] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:28:42 2022] POST /identity/v3/endpoints => generated 327 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:28:43.087362 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295f959-8e4c-42e5-813b-1ed347bcaa46 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:43.132347 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830049b-3e4c-4f2b-a41b-4426562d0d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:43.132975 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830049b-3e4c-4f2b-a41b-4426562d0d4d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:43.133252 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830049b-3e4c-4f2b-a41b-4426562d0d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:43.133519 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830049b-3e4c-4f2b-a41b-4426562d0d4d None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:43.134287 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a830049b-3e4c-4f2b-a41b-4426562d0d4d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:43.134592 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a830049b-3e4c-4f2b-a41b-4426562d0d4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:43.136051 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a830049b-3e4c-4f2b-a41b-4426562d0d4d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:43.160549 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 514/1045] 10.222.0.33 () {56 vars in 1133 bytes} [Fri Sep 16 03:28:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:28:43.162306 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a4efa-4004-4aa8-b8f3-ea816f2a5e6b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:43.269144 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a4efa-4004-4aa8-b8f3-ea816f2a5e6b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:43.303876 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7602b-c560-4367-9373-147e6397fdc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:43.304568 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7602b-c560-4367-9373-147e6397fdc9 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:43.304855 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7602b-c560-4367-9373-147e6397fdc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:43.305125 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7602b-c560-4367-9373-147e6397fdc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:43.352150 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:43.374039 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7602b-c560-4367-9373-147e6397fdc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:43.375479 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7602b-c560-4367-9373-147e6397fdc9 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:43.478695 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 532/1046] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:28:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 03:28:43.479868 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830049b-3e4c-4f2b-a41b-4426562d0d4d None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:43.482735 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:43.580829 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830049b-3e4c-4f2b-a41b-4426562d0d4d None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:43.614946 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a1437-a34d-4a02-abe2-82b9225f23fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:43.615581 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a1437-a34d-4a02-abe2-82b9225f23fb None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:43.615859 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a1437-a34d-4a02-abe2-82b9225f23fb None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:43.616131 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a1437-a34d-4a02-abe2-82b9225f23fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:43.626076 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a1437-a34d-4a02-abe2-82b9225f23fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:43.627539 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a1437-a34d-4a02-abe2-82b9225f23fb None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:43.642397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-3b1a1437-a34d-4a02-abe2-82b9225f23fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:43.642397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:43.642397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:43.642397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:43.642397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:43.642397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:43.642397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:43.642397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:43.642397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:43.642397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:43.642397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:43.642397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:43.642397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:28:43.642397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:28:43.642397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:28:43.642397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:28:43.643345 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:43.643345 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:43.643345 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:43.643345 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:43.643345 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:43.643345 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:43.643345 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:43.643345 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:43.643345 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:43.643345 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:43.643345 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:43.643345 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:43.643345 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:43.643345 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:43.643345 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:43.643345 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:43.643345 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:28:43.649523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:28:43.649523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:43.649523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:43.649523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 515/1047] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:28:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:43.649794 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7602b-c560-4367-9373-147e6397fdc9 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:43.735392 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:43.760681 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7602b-c560-4367-9373-147e6397fdc9 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:43.794870 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d10dab-3ed8-40c5-8ed2-adc6b7b9bf8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:43.795482 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d10dab-3ed8-40c5-8ed2-adc6b7b9bf8b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:43.795760 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d10dab-3ed8-40c5-8ed2-adc6b7b9bf8b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:43.796028 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d10dab-3ed8-40c5-8ed2-adc6b7b9bf8b None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:43.796656 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d10dab-3ed8-40c5-8ed2-adc6b7b9bf8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:43.796954 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d10dab-3ed8-40c5-8ed2-adc6b7b9bf8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:43.798325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d10dab-3ed8-40c5-8ed2-adc6b7b9bf8b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:43.814010 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 533/1048] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:28:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:43.815265 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a1437-a34d-4a02-abe2-82b9225f23fb None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:43.871601 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:43.915271 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a1437-a34d-4a02-abe2-82b9225f23fb None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:43.950113 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb1510-736f-4a8f-a6bb-b59469c9a996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:43.950766 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb1510-736f-4a8f-a6bb-b59469c9a996 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:43.951044 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb1510-736f-4a8f-a6bb-b59469c9a996 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:43.951313 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb1510-736f-4a8f-a6bb-b59469c9a996 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:43.958617 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb1510-736f-4a8f-a6bb-b59469c9a996 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:43.960062 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb1510-736f-4a8f-a6bb-b59469c9a996 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:43.971288 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-4bcb1510-736f-4a8f-a6bb-b59469c9a996 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:28:43.971288 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:43.971288 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:43.971288 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:43.971288 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:43.971288 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:43.971288 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:43.971288 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:43.971288 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:43.971288 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:43.971288 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:43.971288 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:43.971288 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 03:28:43.971288 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 03:28:43.971288 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 03:28:43.972183 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 03:28:43.972183 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:43.972183 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:43.972183 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:43.972183 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:43.972183 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:43.972183 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:43.972183 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:43.972183 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:43.972183 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:43.972183 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:43.972183 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:43.972183 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:43.972183 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:43.972183 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:43.972183 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:43.972183 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:43.973153 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 03:28:43.973153 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 03:28:43.973153 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 03:28:43.973153 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 03:28:43.973153 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 03:28:43.973153 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 03:28:43.973153 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:28:43.973153 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:43.977282 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 516/1049] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:28:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:43.978699 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d10dab-3ed8-40c5-8ed2-adc6b7b9bf8b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:44.080835 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d10dab-3ed8-40c5-8ed2-adc6b7b9bf8b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:44.113545 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2fbf6d-1b36-467b-9f02-68901d71de36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:44.114695 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fbf6d-1b36-467b-9f02-68901d71de36 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:44.114974 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fbf6d-1b36-467b-9f02-68901d71de36 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:44.115244 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fbf6d-1b36-467b-9f02-68901d71de36 None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:44.115935 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2fbf6d-1b36-467b-9f02-68901d71de36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:44.116230 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2fbf6d-1b36-467b-9f02-68901d71de36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:44.117663 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2fbf6d-1b36-467b-9f02-68901d71de36 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:44.120190 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:44.133147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 534/1050] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 03:28:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:44.137814 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb1510-736f-4a8f-a6bb-b59469c9a996 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:44.239263 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb1510-736f-4a8f-a6bb-b59469c9a996 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:44.252631 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:44.273736 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae08a9-7f87-4f29-bb4b-a450aaa0dc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:44.274346 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae08a9-7f87-4f29-bb4b-a450aaa0dc15 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:44.274627 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae08a9-7f87-4f29-bb4b-a450aaa0dc15 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:44.274901 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae08a9-7f87-4f29-bb4b-a450aaa0dc15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:44.275630 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae08a9-7f87-4f29-bb4b-a450aaa0dc15 None admin] RBAC: Adding query filter params (role.id=da747e5ab1c6405a97b406d925ebd4b4, scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2, user.id=c09d1a4ac8b64921a6b05fcd567bb770) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:44.275939 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae08a9-7f87-4f29-bb4b-a450aaa0dc15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:44.277411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae08a9-7f87-4f29-bb4b-a450aaa0dc15 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:44.289909 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 517/1051] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:28:44 2022] GET /identity/v3/role_assignments?user.id=c09d1a4ac8b64921a6b05fcd567bb770&scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2&role.id=da747e5ab1c6405a97b406d925ebd4b4 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:28:45.013450 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ca35b-179a-4a9b-980e-471a9fe4b8ab None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:45.014078 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ca35b-179a-4a9b-980e-471a9fe4b8ab None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:45.014078 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ca35b-179a-4a9b-980e-471a9fe4b8ab None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:45.015515 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 535/1052] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:28:45.021228 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3aeb0-34c9-4dd3-989f-0170741de707 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:45.021648 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3aeb0-34c9-4dd3-989f-0170741de707 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:45.021830 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3aeb0-34c9-4dd3-989f-0170741de707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:45.040149 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8ae3aeb0-34c9-4dd3-989f-0170741de707 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:45.041340 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8ae3aeb0-34c9-4dd3-989f-0170741de707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:45.109868 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 518/1053] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:28:45.229679 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81597195-5a22-4ea6-9600-def2b4b9b454 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:45.229679 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81597195-5a22-4ea6-9600-def2b4b9b454 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:45.230487 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81597195-5a22-4ea6-9600-def2b4b9b454 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:45.232306 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 536/1054] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:28:45.237051 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52475a-715c-42ff-851e-d08fd54f2a0e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:45.237345 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52475a-715c-42ff-851e-d08fd54f2a0e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:45.237642 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52475a-715c-42ff-851e-d08fd54f2a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:45.256835 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3a52475a-715c-42ff-851e-d08fd54f2a0e None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:45.258043 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3a52475a-715c-42ff-851e-d08fd54f2a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:45.323722 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 519/1055] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:28:45.377090 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81597195-5a22-4ea6-9600-def2b4b9b454 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:45.483285 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81597195-5a22-4ea6-9600-def2b4b9b454 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:45.517060 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88865f1-ec86-4747-8202-33b86309b5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:45.517708 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88865f1-ec86-4747-8202-33b86309b5ed None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:45.517989 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88865f1-ec86-4747-8202-33b86309b5ed None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:45.518257 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88865f1-ec86-4747-8202-33b86309b5ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:45.528916 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88865f1-ec86-4747-8202-33b86309b5ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:28:45.533613 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-d88865f1-ec86-4747-8202-33b86309b5ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:28:45.533613 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:45.533613 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:45.533613 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:45.533613 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:45.533613 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:45.533613 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:45.533613 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:45.533613 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:45.533613 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:45.533613 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:45.533613 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:45.533613 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:28:45.533613 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:28:45.533613 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:28:45.533613 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:28:45.534623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:28:45.534623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:28:45.534623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:28:45.534623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:28:45.534623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:45.534623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:45.534623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:45.534623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:45.534623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:45.534623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:45.534623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:45.534623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:45.534623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:45.534623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:45.534623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:45.534623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:45.536163 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:45.536163 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:45.536163 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:45.536163 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:45.536163 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:28:45.536163 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:28:45.536163 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:28:45.536163 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:28:45.536163 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:28:45.536163 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:28:45.536163 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:28:45.536163 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:45.537959 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 537/1056] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 03:28:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:45.541139 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52475a-715c-42ff-851e-d08fd54f2a0e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:45.579667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:45.587258 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88865f1-ec86-4747-8202-33b86309b5ed None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:45.640387 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52475a-715c-42ff-851e-d08fd54f2a0e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:45.650561 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:45.675395 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc890117-9d1a-4c86-bffa-6fc27e0b7dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:45.676009 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc890117-9d1a-4c86-bffa-6fc27e0b7dcd None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:45.676288 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc890117-9d1a-4c86-bffa-6fc27e0b7dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:45.676560 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc890117-9d1a-4c86-bffa-6fc27e0b7dcd None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:45.677223 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc890117-9d1a-4c86-bffa-6fc27e0b7dcd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:45.677526 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc890117-9d1a-4c86-bffa-6fc27e0b7dcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:45.678965 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc890117-9d1a-4c86-bffa-6fc27e0b7dcd None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:45.687398 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 520/1057] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:28:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:28:45.693673 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc890117-9d1a-4c86-bffa-6fc27e0b7dcd None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:45.709076 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88865f1-ec86-4747-8202-33b86309b5ed None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:45.744110 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cedbd5-7f37-4b32-9672-5afef60909f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:45.744718 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cedbd5-7f37-4b32-9672-5afef60909f3 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:45.745002 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cedbd5-7f37-4b32-9672-5afef60909f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:45.745277 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cedbd5-7f37-4b32-9672-5afef60909f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:45.797014 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:45.800072 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc890117-9d1a-4c86-bffa-6fc27e0b7dcd None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:45.819921 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cedbd5-7f37-4b32-9672-5afef60909f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:45.821376 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cedbd5-7f37-4b32-9672-5afef60909f3 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:45.836579 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141977f-3898-441e-9708-a17491a58b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:45.837195 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141977f-3898-441e-9708-a17491a58b37 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:45.837467 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141977f-3898-441e-9708-a17491a58b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:45.837793 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141977f-3898-441e-9708-a17491a58b37 None admin] PATH_INFO: `/v3/users/342eed0b73c34e3abd15d35965b36281` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:45.851791 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6141977f-3898-441e-9708-a17491a58b37 None admin] RBAC: Authorizing `identity:get_user(user_id=342eed0b73c34e3abd15d35965b36281)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:45.853230 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6141977f-3898-441e-9708-a17491a58b37 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:45.859650 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 521/1058] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:28:45 2022] GET /identity/v3/users/342eed0b73c34e3abd15d35965b36281 => generated 285 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:45.860462 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141977f-3898-441e-9708-a17491a58b37 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:45.879005 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:45.928781 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 538/1059] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:28:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 16 03:28:45.935093 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cedbd5-7f37-4b32-9672-5afef60909f3 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:45.966843 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141977f-3898-441e-9708-a17491a58b37 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:46.001495 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0a280-9a3c-4291-9515-b4607d78517e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:46.002191 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0a280-9a3c-4291-9515-b4607d78517e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:46.002470 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0a280-9a3c-4291-9515-b4607d78517e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:46.002739 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0a280-9a3c-4291-9515-b4607d78517e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:46.029897 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:46.072348 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa0a280-9a3c-4291-9515-b4607d78517e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:46.074454 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa0a280-9a3c-4291-9515-b4607d78517e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:46.085596 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cedbd5-7f37-4b32-9672-5afef60909f3 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:46.120523 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95431ed-3c2f-41c0-9276-12371f6331ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:46.121077 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95431ed-3c2f-41c0-9276-12371f6331ba None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:46.121369 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95431ed-3c2f-41c0-9276-12371f6331ba None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:46.121640 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95431ed-3c2f-41c0-9276-12371f6331ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:46.133612 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95431ed-3c2f-41c0-9276-12371f6331ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:46.135341 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95431ed-3c2f-41c0-9276-12371f6331ba None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:46.151591 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-c95431ed-3c2f-41c0-9276-12371f6331ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:46.151591 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:46.151591 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:46.151591 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:46.151591 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:46.151591 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:46.151591 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:46.151591 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:46.151591 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:46.151591 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:46.151591 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:46.151591 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:46.151591 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:28:46.151591 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:28:46.151591 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:28:46.151591 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:28:46.152585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:46.152585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:46.152585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:46.152585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:46.152585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:46.152585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:46.152585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:46.152585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:46.152585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:46.152585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:46.152585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:46.152585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:46.152585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:46.152585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:46.152585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:46.152585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:46.152585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:28:46.153504 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:28:46.153504 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:46.153504 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:46.153504 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 539/1060] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:28:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:28:46.158624 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95431ed-3c2f-41c0-9276-12371f6331ba None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:46.171772 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:46.185381 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 522/1061] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:28:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 16 03:28:46.186451 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0a280-9a3c-4291-9515-b4607d78517e None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:46.245250 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:46.281606 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95431ed-3c2f-41c0-9276-12371f6331ba None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:46.287659 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0a280-9a3c-4291-9515-b4607d78517e None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:46.317582 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e9d3e-45c1-41a4-b67f-cbf5071e0b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:46.318221 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e9d3e-45c1-41a4-b67f-cbf5071e0b50 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:46.318499 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e9d3e-45c1-41a4-b67f-cbf5071e0b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:46.318773 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e9d3e-45c1-41a4-b67f-cbf5071e0b50 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:46.319400 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e9d3e-45c1-41a4-b67f-cbf5071e0b50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:46.319717 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e9d3e-45c1-41a4-b67f-cbf5071e0b50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:46.321101 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e9d3e-45c1-41a4-b67f-cbf5071e0b50 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:46.324034 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6a0ec-64be-4917-ac4e-0e342231f9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:46.324698 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6a0ec-64be-4917-ac4e-0e342231f9f3 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:46.324981 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6a0ec-64be-4917-ac4e-0e342231f9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:46.325258 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6a0ec-64be-4917-ac4e-0e342231f9f3 None admin] PATH_INFO: `/v3/projects/45c5245a99b6423681ad2847c995bcbe` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:46.326510 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6a0ec-64be-4917-ac4e-0e342231f9f3 None admin] RBAC: Authorizing `identity:get_project(project_id=45c5245a99b6423681ad2847c995bcbe)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:46.327998 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6a0ec-64be-4917-ac4e-0e342231f9f3 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:46.335558 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 523/1062] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:28:46 2022] GET /identity/v3/projects/45c5245a99b6423681ad2847c995bcbe => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:46.336790 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6a0ec-64be-4917-ac4e-0e342231f9f3 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:46.340125 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 540/1063] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:28:46.448560 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6a0ec-64be-4917-ac4e-0e342231f9f3 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:46.461260 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165bb5d-6b8e-4f42-bb86-ecd285b0d31b None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:46.461553 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165bb5d-6b8e-4f42-bb86-ecd285b0d31b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:46.461877 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165bb5d-6b8e-4f42-bb86-ecd285b0d31b None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:46.463348 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 541/1064] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 03:28:46.468880 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb63c70-477e-4923-969a-93e9a893d5cb None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:46.469209 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb63c70-477e-4923-969a-93e9a893d5cb None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:46.469443 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb63c70-477e-4923-969a-93e9a893d5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:46.478335 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:46.488159 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5bdb36-e464-4f10-a94c-8358cc93a317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:46.488828 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bdb36-e464-4f10-a94c-8358cc93a317 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:46.489086 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2eb63c70-477e-4923-969a-93e9a893d5cb None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:46.489193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bdb36-e464-4f10-a94c-8358cc93a317 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:46.489366 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bdb36-e464-4f10-a94c-8358cc93a317 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:46.490144 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5bdb36-e464-4f10-a94c-8358cc93a317 None admin] RBAC: Adding query filter params (role.id=4ffac54101e248479bcdc0e54890020f, scope.project.id=45c5245a99b6423681ad2847c995bcbe, user.id=342eed0b73c34e3abd15d35965b36281) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:46.490392 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2eb63c70-477e-4923-969a-93e9a893d5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:46.495939 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5bdb36-e464-4f10-a94c-8358cc93a317 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:46.495939 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5bdb36-e464-4f10-a94c-8358cc93a317 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:46.505784 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 524/1065] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:28:46 2022] GET /identity/v3/role_assignments?user.id=342eed0b73c34e3abd15d35965b36281&scope.project.id=45c5245a99b6423681ad2847c995bcbe&role.id=4ffac54101e248479bcdc0e54890020f => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:46.574046 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:46.579948 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 542/1066] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 03:28:46.856780 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5bdb36-e464-4f10-a94c-8358cc93a317 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:46.958554 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5bdb36-e464-4f10-a94c-8358cc93a317 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:46.989408 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b6137-4e0b-4fe8-a367-74553cf90814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:46.990074 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b6137-4e0b-4fe8-a367-74553cf90814 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:46.990355 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b6137-4e0b-4fe8-a367-74553cf90814 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:46.990625 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b6137-4e0b-4fe8-a367-74553cf90814 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:47.001123 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b6137-4e0b-4fe8-a367-74553cf90814 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:28:47.006567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-a43b6137-4e0b-4fe8-a367-74553cf90814 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 03:28:47.006567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:47.006567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:47.006567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:47.006567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:47.006567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:47.006567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:47.006567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:47.006567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:47.006567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:47.006567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:47.006567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:47.006567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:28:47.006567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:28:47.006567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:28:47.006567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:28:47.007671 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:28:47.007671 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:28:47.007671 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:28:47.007671 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:28:47.007671 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:47.007671 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:47.007671 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:47.007671 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:47.007671 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:47.007671 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:47.007671 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:47.007671 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:47.007671 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:47.007671 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:47.007671 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:47.007671 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:47.017873 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:47.017873 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:47.017873 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:47.017873 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:47.017873 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:28:47.017873 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:28:47.017873 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:28:47.017873 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:28:47.017873 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:28:47.017873 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:28:47.017873 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 03:28:47.017873 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:47.017873 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 525/1067] 10.222.0.33 () {56 vars in 1120 bytes} [Fri Sep 16 03:28:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:47.018627 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb63c70-477e-4923-969a-93e9a893d5cb None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:47.110569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb63c70-477e-4923-969a-93e9a893d5cb None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:47.143585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856c948-e74f-4276-b113-51ef0ec29f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:47.144191 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856c948-e74f-4276-b113-51ef0ec29f8b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:47.144474 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856c948-e74f-4276-b113-51ef0ec29f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:47.145502 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856c948-e74f-4276-b113-51ef0ec29f8b None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:47.146196 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856c948-e74f-4276-b113-51ef0ec29f8b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:47.146501 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856c948-e74f-4276-b113-51ef0ec29f8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:47.147866 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856c948-e74f-4276-b113-51ef0ec29f8b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:47.155735 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 543/1068] 10.222.0.33 () {56 vars in 1115 bytes} [Fri Sep 16 03:28:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:47.162074 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b6137-4e0b-4fe8-a367-74553cf90814 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:47.210648 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:47.258149 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b6137-4e0b-4fe8-a367-74553cf90814 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:47.291842 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6291407-3b43-4814-bd47-35ad80149c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:47.292462 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6291407-3b43-4814-bd47-35ad80149c1e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:47.292738 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6291407-3b43-4814-bd47-35ad80149c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:47.293008 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6291407-3b43-4814-bd47-35ad80149c1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:47.303122 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6291407-3b43-4814-bd47-35ad80149c1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:47.304555 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6291407-3b43-4814-bd47-35ad80149c1e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:47.318684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-f6291407-3b43-4814-bd47-35ad80149c1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:47.318684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:47.318684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:47.318684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:47.318684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:47.318684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:47.318684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:47.318684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:47.318684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:47.318684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:47.318684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:47.318684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:47.318684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:28:47.318684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:28:47.318684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:28:47.318684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:28:47.319858 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:47.319858 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:47.319858 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:47.319858 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:47.319858 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:47.319858 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:47.319858 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:47.319858 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:47.319858 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:47.319858 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:47.319858 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:47.319858 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:47.319858 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:47.319858 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:47.319858 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:47.319858 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:47.319858 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:28:47.320747 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:28:47.320747 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:47.320747 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:47.320747 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 526/1069] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:28:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:47.325579 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856c948-e74f-4276-b113-51ef0ec29f8b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:47.385945 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:47.426227 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856c948-e74f-4276-b113-51ef0ec29f8b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:47.459337 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b17636-08a5-4fd0-8469-e49d74c0f238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:47.459939 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b17636-08a5-4fd0-8469-e49d74c0f238 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:47.460221 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b17636-08a5-4fd0-8469-e49d74c0f238 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:47.460492 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b17636-08a5-4fd0-8469-e49d74c0f238 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:47.461172 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b17636-08a5-4fd0-8469-e49d74c0f238 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:47.461427 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b17636-08a5-4fd0-8469-e49d74c0f238 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:47.462855 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b17636-08a5-4fd0-8469-e49d74c0f238 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:47.474237 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 544/1070] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:47.479905 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6291407-3b43-4814-bd47-35ad80149c1e None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:47.576057 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6291407-3b43-4814-bd47-35ad80149c1e None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:47.577596 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:47.609396 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d6c45-a057-4136-8956-ee3d591b54dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:47.610045 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d6c45-a057-4136-8956-ee3d591b54dd None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:47.610328 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d6c45-a057-4136-8956-ee3d591b54dd None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:47.610660 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d6c45-a057-4136-8956-ee3d591b54dd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:47.618776 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d6c45-a057-4136-8956-ee3d591b54dd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:47.620215 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d6c45-a057-4136-8956-ee3d591b54dd None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:47.631523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-089d6c45-a057-4136-8956-ee3d591b54dd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 03:28:47.631523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:47.631523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:47.631523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:47.631523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:47.631523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:47.631523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:47.631523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:47.631523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:47.631523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:47.631523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:47.631523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:47.631523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 03:28:47.631523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 03:28:47.631523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 03:28:47.631523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 03:28:47.632681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:47.632681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:47.632681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 03:28:47.632681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:28:47.632681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 03:28:47.632681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:28:47.632681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:47.632681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:47.632681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:47.632681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:47.632681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:47.632681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:47.632681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:47.632681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:47.632681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:47.632681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:47.632681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:47.632681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:47.634016 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:47.634016 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:47.634016 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 03:28:47.634016 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 03:28:47.634016 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 03:28:47.634016 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 03:28:47.634016 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 03:28:47.634016 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 03:28:47.634016 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 03:28:47.634016 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:47.634943 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 527/1071] 10.222.0.33 () {56 vars in 1093 bytes} [Fri Sep 16 03:28:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:47.638319 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b17636-08a5-4fd0-8469-e49d74c0f238 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:47.739663 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b17636-08a5-4fd0-8469-e49d74c0f238 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:47.759639 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:47.773761 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc0ea7-f725-4e87-a712-a394c9b0895c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:47.774363 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc0ea7-f725-4e87-a712-a394c9b0895c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:47.774645 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc0ea7-f725-4e87-a712-a394c9b0895c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:47.774920 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc0ea7-f725-4e87-a712-a394c9b0895c None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:47.775638 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbc0ea7-f725-4e87-a712-a394c9b0895c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:47.775944 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbc0ea7-f725-4e87-a712-a394c9b0895c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:47.777363 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbc0ea7-f725-4e87-a712-a394c9b0895c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:47.795179 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 545/1072] 10.222.0.33 () {56 vars in 1133 bytes} [Fri Sep 16 03:28:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:28:47.800889 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d6c45-a057-4136-8956-ee3d591b54dd None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:47.898444 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d6c45-a057-4136-8956-ee3d591b54dd None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:47.930461 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53310c5a-dbae-48a6-b76e-bd46fa1a4d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:47.931080 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53310c5a-dbae-48a6-b76e-bd46fa1a4d76 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:47.931362 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53310c5a-dbae-48a6-b76e-bd46fa1a4d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:47.931633 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53310c5a-dbae-48a6-b76e-bd46fa1a4d76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:47.942389 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53310c5a-dbae-48a6-b76e-bd46fa1a4d76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:47.943824 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53310c5a-dbae-48a6-b76e-bd46fa1a4d76 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:47.957545 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-53310c5a-dbae-48a6-b76e-bd46fa1a4d76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:47.957545 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:47.957545 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:47.957545 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:47.957545 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:47.957545 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:47.957545 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:47.957545 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:47.957545 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:47.957545 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:47.957545 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:47.957545 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:47.957545 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:28:47.957545 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:28:47.957545 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:28:47.957545 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:28:47.960111 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:47.960111 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:47.960111 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:47.960111 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:47.960111 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:47.960111 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:47.960111 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:47.960111 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:47.960111 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:47.960111 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:47.960111 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:47.960111 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:47.960111 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:47.960111 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:47.960111 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:47.960111 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:47.960111 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:28:47.960999 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:28:47.960999 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:47.960999 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:47.960999 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 528/1073] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:28:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:47.964669 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc0ea7-f725-4e87-a712-a394c9b0895c None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:48.060878 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc0ea7-f725-4e87-a712-a394c9b0895c None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:48.093299 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95bf32c-e7d3-478f-bb64-c1b36e986bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:48.093938 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bf32c-e7d3-478f-bb64-c1b36e986bdb None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:48.094223 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bf32c-e7d3-478f-bb64-c1b36e986bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:48.094498 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bf32c-e7d3-478f-bb64-c1b36e986bdb None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:48.095134 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95bf32c-e7d3-478f-bb64-c1b36e986bdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:48.095438 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95bf32c-e7d3-478f-bb64-c1b36e986bdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:48.096795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95bf32c-e7d3-478f-bb64-c1b36e986bdb None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:48.108486 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 546/1074] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:48.114570 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53310c5a-dbae-48a6-b76e-bd46fa1a4d76 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:48.130371 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:48.211662 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53310c5a-dbae-48a6-b76e-bd46fa1a4d76 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:48.244821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa126dc-f96e-4b4a-b3be-eba76f158a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:48.245448 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa126dc-f96e-4b4a-b3be-eba76f158a59 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:48.245765 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa126dc-f96e-4b4a-b3be-eba76f158a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:48.246042 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa126dc-f96e-4b4a-b3be-eba76f158a59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:48.252708 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa126dc-f96e-4b4a-b3be-eba76f158a59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:48.254230 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa126dc-f96e-4b4a-b3be-eba76f158a59 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:48.265186 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-faa126dc-f96e-4b4a-b3be-eba76f158a59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:28:48.265186 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:48.265186 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:48.265186 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:48.265186 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:48.265186 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:48.265186 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:48.265186 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:48.265186 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:48.265186 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:48.265186 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:48.265186 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:48.265186 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 03:28:48.265186 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 03:28:48.265186 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 03:28:48.266114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 03:28:48.266114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:48.266114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:48.266114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:48.266114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:48.266114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:48.266114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:48.266114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:48.266114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:48.266114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:48.266114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:48.266114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:48.266114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:48.266114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:48.266114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:48.266114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:48.266114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:48.267059 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 03:28:48.267059 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 03:28:48.267059 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 03:28:48.267059 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 03:28:48.267059 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 03:28:48.267059 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 03:28:48.267059 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:28:48.267059 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:48.267059 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 529/1075] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:28:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:48.273925 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95bf32c-e7d3-478f-bb64-c1b36e986bdb None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:48.313913 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:48.372049 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95bf32c-e7d3-478f-bb64-c1b36e986bdb None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:48.404719 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a32a04-57d8-4d2f-b780-88804dda0f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:48.405323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a32a04-57d8-4d2f-b780-88804dda0f03 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:48.405604 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a32a04-57d8-4d2f-b780-88804dda0f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:48.405901 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a32a04-57d8-4d2f-b780-88804dda0f03 None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:48.406589 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a32a04-57d8-4d2f-b780-88804dda0f03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:48.406893 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a32a04-57d8-4d2f-b780-88804dda0f03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:48.408327 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a32a04-57d8-4d2f-b780-88804dda0f03 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:48.419843 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 547/1076] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 03:28:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:48.425808 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa126dc-f96e-4b4a-b3be-eba76f158a59 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:48.501905 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:48.529750 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa126dc-f96e-4b4a-b3be-eba76f158a59 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:48.564284 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b40c4d-c776-4b24-bf2a-7e15deca3356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:48.564874 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b40c4d-c776-4b24-bf2a-7e15deca3356 None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:48.565162 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b40c4d-c776-4b24-bf2a-7e15deca3356 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:48.565442 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b40c4d-c776-4b24-bf2a-7e15deca3356 None admin] PATH_INFO: `/v3/projects/a0e46c2a2c62402dbf6d8461204b47d2/users/c09d1a4ac8b64921a6b05fcd567bb770/roles/da747e5ab1c6405a97b406d925ebd4b4` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:48.568184 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b40c4d-c776-4b24-bf2a-7e15deca3356 None admin] RBAC: Authorizing `identity:create_grant(project_id=a0e46c2a2c62402dbf6d8461204b47d2, user_id=c09d1a4ac8b64921a6b05fcd567bb770, role_id=da747e5ab1c6405a97b406d925ebd4b4)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:48.569617 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b40c4d-c776-4b24-bf2a-7e15deca3356 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:48.615313 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858a823-9a47-4396-b75d-73ba38697d29 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:48.615602 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858a823-9a47-4396-b75d-73ba38697d29 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:48.615880 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858a823-9a47-4396-b75d-73ba38697d29 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:48.617217 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 548/1077] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 03:28:48.622080 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43239d-c918-4f54-91e1-6f0da23c3e85 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:48.622364 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43239d-c918-4f54-91e1-6f0da23c3e85 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:48.622656 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43239d-c918-4f54-91e1-6f0da23c3e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:48.641313 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4e43239d-c918-4f54-91e1-6f0da23c3e85 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:48.642370 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 530/1078] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 03:28:48 2022] PUT /identity/v3/projects/a0e46c2a2c62402dbf6d8461204b47d2/users/c09d1a4ac8b64921a6b05fcd567bb770/roles/da747e5ab1c6405a97b406d925ebd4b4 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:28:48.642717 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4e43239d-c918-4f54-91e1-6f0da23c3e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:48.718958 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 549/1079] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 03:28:48.985981 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b40c4d-c776-4b24-bf2a-7e15deca3356 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:49.083847 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b40c4d-c776-4b24-bf2a-7e15deca3356 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:49.117126 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af3fff-3410-4a01-bac1-74ab4679ea6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:49.117781 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af3fff-3410-4a01-bac1-74ab4679ea6b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:49.118064 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af3fff-3410-4a01-bac1-74ab4679ea6b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:49.118337 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af3fff-3410-4a01-bac1-74ab4679ea6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:49.120116 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:49.129041 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af3fff-3410-4a01-bac1-74ab4679ea6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:28:49.138008 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-f1af3fff-3410-4a01-bac1-74ab4679ea6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:28:49.138008 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:49.138008 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:49.138008 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:49.138008 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:49.138008 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:49.138008 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:49.138008 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:49.138008 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:49.138008 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:49.138008 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:49.138008 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:49.138008 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:28:49.138008 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:28:49.138008 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:28:49.138008 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:28:49.139114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:28:49.139114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:28:49.139114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:28:49.139114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:28:49.139114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:49.139114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:49.139114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:49.139114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:49.139114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:49.139114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:49.139114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:49.139114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:49.139114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:49.139114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:49.139114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:49.139114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:49.140116 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:49.140116 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:49.140116 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:49.140116 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:49.140116 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:28:49.140116 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:28:49.140116 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:28:49.140116 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:28:49.140116 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:28:49.140116 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:28:49.140116 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:28:49.140116 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:49.140116 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 531/1080] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 03:28:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:49.141118 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43239d-c918-4f54-91e1-6f0da23c3e85 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:49.169010 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:49.238638 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43239d-c918-4f54-91e1-6f0da23c3e85 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:49.271091 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ece475-121f-45df-84f5-6c230e4cbbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:49.271696 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ece475-121f-45df-84f5-6c230e4cbbd7 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:49.271971 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ece475-121f-45df-84f5-6c230e4cbbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:49.272238 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ece475-121f-45df-84f5-6c230e4cbbd7 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:49.272889 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ece475-121f-45df-84f5-6c230e4cbbd7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:49.273186 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ece475-121f-45df-84f5-6c230e4cbbd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:49.274557 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ece475-121f-45df-84f5-6c230e4cbbd7 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:49.282372 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 550/1081] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:28:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:49.288657 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af3fff-3410-4a01-bac1-74ab4679ea6b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:49.385883 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af3fff-3410-4a01-bac1-74ab4679ea6b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:49.418762 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a0811-2d05-4d8e-af79-1c7876336243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:49.419393 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a0811-2d05-4d8e-af79-1c7876336243 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:49.419672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a0811-2d05-4d8e-af79-1c7876336243 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:49.419953 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a0811-2d05-4d8e-af79-1c7876336243 None admin] PATH_INFO: `/v3/users/342eed0b73c34e3abd15d35965b36281` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:49.421065 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a0811-2d05-4d8e-af79-1c7876336243 None admin] RBAC: Authorizing `identity:get_user(user_id=342eed0b73c34e3abd15d35965b36281)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:49.422518 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a0811-2d05-4d8e-af79-1c7876336243 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:49.424089 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 532/1082] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:28:49 2022] GET /identity/v3/users/342eed0b73c34e3abd15d35965b36281 => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:49.429970 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ece475-121f-45df-84f5-6c230e4cbbd7 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:49.520550 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:49.529822 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ece475-121f-45df-84f5-6c230e4cbbd7 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:49.563921 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68ad25-19c5-4421-ac03-a7c89b5e17ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:49.564546 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68ad25-19c5-4421-ac03-a7c89b5e17ae None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:49.564827 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68ad25-19c5-4421-ac03-a7c89b5e17ae None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:49.565101 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68ad25-19c5-4421-ac03-a7c89b5e17ae None admin] PATH_INFO: `/v3/projects/45c5245a99b6423681ad2847c995bcbe` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:49.566243 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68ad25-19c5-4421-ac03-a7c89b5e17ae None admin] RBAC: Authorizing `identity:get_project(project_id=45c5245a99b6423681ad2847c995bcbe)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:49.568222 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68ad25-19c5-4421-ac03-a7c89b5e17ae None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:49.569842 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 551/1083] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:28:49 2022] GET /identity/v3/projects/45c5245a99b6423681ad2847c995bcbe => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:28:49.575781 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a0811-2d05-4d8e-af79-1c7876336243 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:49.634740 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:49.673131 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a0811-2d05-4d8e-af79-1c7876336243 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:49.708166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ea24e-80bd-4ba7-a932-d3e4b761d279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:49.708822 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ea24e-80bd-4ba7-a932-d3e4b761d279 None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:49.709100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ea24e-80bd-4ba7-a932-d3e4b761d279 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:49.709367 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ea24e-80bd-4ba7-a932-d3e4b761d279 None admin] PATH_INFO: `/v3/projects/45c5245a99b6423681ad2847c995bcbe/users/342eed0b73c34e3abd15d35965b36281/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:49.711277 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ea24e-80bd-4ba7-a932-d3e4b761d279 None admin] RBAC: Authorizing `identity:create_grant(project_id=45c5245a99b6423681ad2847c995bcbe, user_id=342eed0b73c34e3abd15d35965b36281, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:49.712702 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ea24e-80bd-4ba7-a932-d3e4b761d279 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:49.784376 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 533/1084] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 03:28:49 2022] PUT /identity/v3/projects/45c5245a99b6423681ad2847c995bcbe/users/342eed0b73c34e3abd15d35965b36281/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:28:50.777316 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72427c37-26bc-4451-ada2-437473e61bbb None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:50.777840 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72427c37-26bc-4451-ada2-437473e61bbb None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:50.777959 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72427c37-26bc-4451-ada2-437473e61bbb None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:50.779242 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 552/1085] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:28:50.784607 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4b94e-19ce-4728-b692-87d2e97619c5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:50.784987 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4b94e-19ce-4728-b692-87d2e97619c5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:50.785163 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4b94e-19ce-4728-b692-87d2e97619c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:50.805641 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-15a4b94e-19ce-4728-b692-87d2e97619c5 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:50.806854 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-15a4b94e-19ce-4728-b692-87d2e97619c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:50.870897 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 534/1086] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:28:51.137163 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72427c37-26bc-4451-ada2-437473e61bbb None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:51.234118 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72427c37-26bc-4451-ada2-437473e61bbb None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:51.266403 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afaee7-a698-4031-b2e2-b364a41d527b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:51.267013 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afaee7-a698-4031-b2e2-b364a41d527b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:51.267290 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afaee7-a698-4031-b2e2-b364a41d527b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:51.267559 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afaee7-a698-4031-b2e2-b364a41d527b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:51.278054 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9afaee7-a698-4031-b2e2-b364a41d527b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:28:51.282712 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-b9afaee7-a698-4031-b2e2-b364a41d527b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 03:28:51.282712 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:51.282712 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:51.282712 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:51.282712 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:51.282712 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:51.282712 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:51.282712 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:51.282712 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:51.282712 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:51.282712 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:51.282712 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:51.282712 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:28:51.282712 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:28:51.282712 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:28:51.282712 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:28:51.283641 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:28:51.283641 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:28:51.283641 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:28:51.283641 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:28:51.283641 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:51.283641 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:51.283641 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:51.283641 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:51.283641 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:51.283641 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:51.283641 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:51.283641 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:51.283641 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:51.283641 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:51.283641 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:51.283641 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:51.284496 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:51.284496 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:51.284496 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:51.284496 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:51.284496 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:28:51.284496 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:28:51.284496 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:28:51.284496 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:28:51.284496 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:28:51.284496 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:28:51.284496 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 03:28:51.284496 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:51.285790 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 553/1087] 10.222.0.33 () {56 vars in 1120 bytes} [Fri Sep 16 03:28:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:51.289660 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4b94e-19ce-4728-b692-87d2e97619c5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:51.339708 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:51.384327 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4b94e-19ce-4728-b692-87d2e97619c5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:51.418773 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fe5bb-3cd9-4c1e-8322-2bbe927b45d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:51.419312 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fe5bb-3cd9-4c1e-8322-2bbe927b45d4 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:51.419597 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fe5bb-3cd9-4c1e-8322-2bbe927b45d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:51.419874 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fe5bb-3cd9-4c1e-8322-2bbe927b45d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:51.420543 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6fe5bb-3cd9-4c1e-8322-2bbe927b45d4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:51.420848 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6fe5bb-3cd9-4c1e-8322-2bbe927b45d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:51.422267 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6fe5bb-3cd9-4c1e-8322-2bbe927b45d4 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:51.430728 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 535/1088] 10.222.0.33 () {56 vars in 1115 bytes} [Fri Sep 16 03:28:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:51.436552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afaee7-a698-4031-b2e2-b364a41d527b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:51.455887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:51.532853 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afaee7-a698-4031-b2e2-b364a41d527b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:51.565545 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c8ed4-2492-4efa-bdcc-e0c8d499bbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:51.566189 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c8ed4-2492-4efa-bdcc-e0c8d499bbee None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:51.567074 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c8ed4-2492-4efa-bdcc-e0c8d499bbee None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:51.567347 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c8ed4-2492-4efa-bdcc-e0c8d499bbee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:51.576919 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9c8ed4-2492-4efa-bdcc-e0c8d499bbee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:51.578374 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9c8ed4-2492-4efa-bdcc-e0c8d499bbee None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:51.592274 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-ad9c8ed4-2492-4efa-bdcc-e0c8d499bbee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:51.592274 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:51.592274 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:51.592274 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:51.592274 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:51.592274 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:51.592274 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:51.592274 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:51.592274 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:51.592274 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:51.592274 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:51.592274 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:51.592274 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:28:51.592274 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:28:51.592274 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:28:51.592274 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:28:51.593228 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:51.593228 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:51.593228 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:51.593228 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:51.593228 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:51.593228 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:51.593228 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:51.593228 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:51.593228 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:51.593228 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:51.593228 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:51.593228 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:51.593228 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:51.593228 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:51.593228 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:51.593228 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:51.593228 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:28:51.594461 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:28:51.594461 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:51.594461 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:51.594461 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 554/1089] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:28:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:28:51.599101 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fe5bb-3cd9-4c1e-8322-2bbe927b45d4 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:51.698609 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fe5bb-3cd9-4c1e-8322-2bbe927b45d4 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:51.712135 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:51.731323 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec1902-7956-4bb2-b94d-3aca3dc891ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:51.731925 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec1902-7956-4bb2-b94d-3aca3dc891ce None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:51.732205 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec1902-7956-4bb2-b94d-3aca3dc891ce None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:51.732477 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec1902-7956-4bb2-b94d-3aca3dc891ce None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:51.733108 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec1902-7956-4bb2-b94d-3aca3dc891ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:51.733410 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec1902-7956-4bb2-b94d-3aca3dc891ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:51.734814 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec1902-7956-4bb2-b94d-3aca3dc891ce None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:51.746935 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 536/1090] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:51.752550 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c8ed4-2492-4efa-bdcc-e0c8d499bbee None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:51.824361 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:51.856706 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c8ed4-2492-4efa-bdcc-e0c8d499bbee None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:51.889493 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5747823-b72e-4919-87e8-4a5f8e522a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:51.890142 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5747823-b72e-4919-87e8-4a5f8e522a57 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:51.890422 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5747823-b72e-4919-87e8-4a5f8e522a57 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:51.890690 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5747823-b72e-4919-87e8-4a5f8e522a57 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:51.895732 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258ba2f-c2f8-4489-aaf0-26235b607027 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:51.896213 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258ba2f-c2f8-4489-aaf0-26235b607027 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:51.896305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258ba2f-c2f8-4489-aaf0-26235b607027 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:51.897577 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 537/1091] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 03:28:51.899153 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5747823-b72e-4919-87e8-4a5f8e522a57 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:51.900586 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5747823-b72e-4919-87e8-4a5f8e522a57 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:51.902546 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1f840-9d46-441d-8562-234df4b7d499 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:51.902827 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1f840-9d46-441d-8562-234df4b7d499 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:51.903099 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1f840-9d46-441d-8562-234df4b7d499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:51.911958 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-e5747823-b72e-4919-87e8-4a5f8e522a57 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 03:28:51.911958 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:51.911958 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:51.911958 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:51.911958 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:51.911958 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:51.911958 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:51.911958 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:51.911958 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:51.911958 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:51.911958 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:51.911958 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:51.911958 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 03:28:51.911958 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 03:28:51.911958 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 03:28:51.911958 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 03:28:51.913063 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:51.913063 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:51.913063 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 03:28:51.913063 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:28:51.913063 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 03:28:51.913063 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:28:51.913063 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:51.913063 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:51.913063 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:51.913063 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:51.913063 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:51.913063 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:51.913063 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:51.913063 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:51.913063 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:51.913063 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:51.913063 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:51.913063 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:51.914069 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:51.914069 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:51.914069 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 03:28:51.914069 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 03:28:51.914069 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 03:28:51.914069 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 03:28:51.914069 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 03:28:51.914069 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 03:28:51.914069 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 03:28:51.914069 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:51.914069 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 555/1092] 10.222.0.33 () {56 vars in 1093 bytes} [Fri Sep 16 03:28:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:28:51.918514 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5747823-b72e-4919-87e8-4a5f8e522a57 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:51.920694 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d7f1f840-9d46-441d-8562-234df4b7d499 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:51.921957 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d7f1f840-9d46-441d-8562-234df4b7d499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:51.989160 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 538/1093] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 03:28:52.015358 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5747823-b72e-4919-87e8-4a5f8e522a57 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:52.043231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:52.048801 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c1f12-290d-4ac6-b617-0419ac504db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:52.049407 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c1f12-290d-4ac6-b617-0419ac504db0 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:52.049751 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c1f12-290d-4ac6-b617-0419ac504db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:52.050069 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c1f12-290d-4ac6-b617-0419ac504db0 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:52.050764 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c1f12-290d-4ac6-b617-0419ac504db0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:52.051084 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c1f12-290d-4ac6-b617-0419ac504db0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:52.052505 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c1f12-290d-4ac6-b617-0419ac504db0 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:52.070064 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 556/1094] 10.222.0.33 () {56 vars in 1133 bytes} [Fri Sep 16 03:28:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:52.075908 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f1f840-9d46-441d-8562-234df4b7d499 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:52.178496 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f1f840-9d46-441d-8562-234df4b7d499 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:52.181566 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:52.212251 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d630572-b1af-4a55-81f9-0c0cbe859ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:52.212854 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d630572-b1af-4a55-81f9-0c0cbe859ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:52.213132 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d630572-b1af-4a55-81f9-0c0cbe859ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:52.213404 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d630572-b1af-4a55-81f9-0c0cbe859ba1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:52.255109 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c1f12-290d-4ac6-b617-0419ac504db0 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:52.280101 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d630572-b1af-4a55-81f9-0c0cbe859ba1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:52.281564 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d630572-b1af-4a55-81f9-0c0cbe859ba1 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:52.353021 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c1f12-290d-4ac6-b617-0419ac504db0 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:52.375882 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 539/1095] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:28:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 03:28:52.382222 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d630572-b1af-4a55-81f9-0c0cbe859ba1 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:52.384769 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:52.386998 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e12b8-c72d-4517-89ed-90f2bcc3a2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:52.387628 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e12b8-c72d-4517-89ed-90f2bcc3a2b3 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:52.387906 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e12b8-c72d-4517-89ed-90f2bcc3a2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:52.388181 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e12b8-c72d-4517-89ed-90f2bcc3a2b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:52.398588 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e12b8-c72d-4517-89ed-90f2bcc3a2b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:28:52.403410 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-364e12b8-c72d-4517-89ed-90f2bcc3a2b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:28:52.403410 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:52.403410 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:52.403410 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:52.403410 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:52.403410 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:52.403410 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:52.403410 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:52.403410 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:52.403410 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:52.403410 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:52.403410 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:52.403410 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:28:52.403410 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:28:52.403410 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:28:52.403410 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:28:52.404527 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:28:52.404527 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:28:52.404527 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:28:52.404527 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:28:52.404527 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:52.404527 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:52.404527 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:52.404527 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:52.404527 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:52.404527 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:52.404527 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:52.404527 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:52.404527 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:52.404527 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:52.404527 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:52.404527 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:52.405756 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:52.405756 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:52.405756 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:52.405756 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:52.405756 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:28:52.405756 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:28:52.405756 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:28:52.405756 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:28:52.405756 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:28:52.405756 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:28:52.405756 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:28:52.405756 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:28:52.405756 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 557/1096] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 03:28:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:28:52.410312 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e12b8-c72d-4517-89ed-90f2bcc3a2b3 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:52.458870 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:52.481003 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d630572-b1af-4a55-81f9-0c0cbe859ba1 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:52.509059 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e12b8-c72d-4517-89ed-90f2bcc3a2b3 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:52.516304 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b613179-ec84-4b03-9f89-5b82097cf17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:52.517004 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b613179-ec84-4b03-9f89-5b82097cf17a None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:52.517323 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b613179-ec84-4b03-9f89-5b82097cf17a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:52.517600 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b613179-ec84-4b03-9f89-5b82097cf17a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:52.527818 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b613179-ec84-4b03-9f89-5b82097cf17a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:52.529331 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b613179-ec84-4b03-9f89-5b82097cf17a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:52.544357 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-7b613179-ec84-4b03-9f89-5b82097cf17a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:52.544357 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:52.544357 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:52.544357 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:52.544357 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:52.544357 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:52.544357 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:52.544357 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:52.544357 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:52.544357 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:52.544357 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:52.544357 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:52.544357 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:28:52.544357 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:28:52.544357 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:28:52.544357 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:28:52.545309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:52.545309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:52.545309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:52.545309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:52.545309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:52.545309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:52.545309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:52.545309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:52.545309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:52.545309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:52.545309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:52.545309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:52.545309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:52.545309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:52.545309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:52.545309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:52.545309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:28:52.546412 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:28:52.546412 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:28:52.546412 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:52.546747 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7bbee-f28c-42de-8e7d-c0a393143af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:52.546747 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7bbee-f28c-42de-8e7d-c0a393143af6 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:52.546747 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7bbee-f28c-42de-8e7d-c0a393143af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:52.546975 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 540/1097] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:28:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:28:52.547050 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7bbee-f28c-42de-8e7d-c0a393143af6 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:52.547050 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b7bbee-f28c-42de-8e7d-c0a393143af6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:52.547050 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b7bbee-f28c-42de-8e7d-c0a393143af6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:52.547778 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b7bbee-f28c-42de-8e7d-c0a393143af6 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:52.551652 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b613179-ec84-4b03-9f89-5b82097cf17a None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:52.561041 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 558/1098] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:28:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:28:52.562236 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7bbee-f28c-42de-8e7d-c0a393143af6 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:52.606127 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:52.650179 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b613179-ec84-4b03-9f89-5b82097cf17a None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:52.658532 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7bbee-f28c-42de-8e7d-c0a393143af6 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:52.668969 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:52.686265 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1766b-3032-465a-bb0d-466fa3d8098b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:52.686873 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1766b-3032-465a-bb0d-466fa3d8098b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:52.687153 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1766b-3032-465a-bb0d-466fa3d8098b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:52.687428 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1766b-3032-465a-bb0d-466fa3d8098b None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:52.688059 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1766b-3032-465a-bb0d-466fa3d8098b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:52.688486 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1766b-3032-465a-bb0d-466fa3d8098b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:52.690342 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1766b-3032-465a-bb0d-466fa3d8098b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:52.695350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43298df-5210-453a-a109-7932cfc7ed2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:52.695993 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43298df-5210-453a-a109-7932cfc7ed2a None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:52.696275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43298df-5210-453a-a109-7932cfc7ed2a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:52.696576 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43298df-5210-453a-a109-7932cfc7ed2a None admin] PATH_INFO: `/v3/users/342eed0b73c34e3abd15d35965b36281` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:52.697760 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43298df-5210-453a-a109-7932cfc7ed2a None admin] RBAC: Authorizing `identity:get_user(user_id=342eed0b73c34e3abd15d35965b36281)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:52.703475 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43298df-5210-453a-a109-7932cfc7ed2a None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:52.703475 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 559/1099] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:28:52 2022] GET /identity/v3/users/342eed0b73c34e3abd15d35965b36281 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:28:52.706421 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43298df-5210-453a-a109-7932cfc7ed2a None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:52.707943 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 541/1100] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:28:52.713334 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1766b-3032-465a-bb0d-466fa3d8098b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:52.806043 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43298df-5210-453a-a109-7932cfc7ed2a None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:52.812722 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1766b-3032-465a-bb0d-466fa3d8098b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:52.828483 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:52.839042 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b0af3-f3c4-4628-aabf-0fb8f4935673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:52.839655 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b0af3-f3c4-4628-aabf-0fb8f4935673 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:52.841026 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b0af3-f3c4-4628-aabf-0fb8f4935673 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:52.841026 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b0af3-f3c4-4628-aabf-0fb8f4935673 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:52.845377 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d15651-2633-41b2-9c8f-d2a7d8f305cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:52.846026 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d15651-2633-41b2-9c8f-d2a7d8f305cf None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:52.846308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d15651-2633-41b2-9c8f-d2a7d8f305cf None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:52.846576 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d15651-2633-41b2-9c8f-d2a7d8f305cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:52.855314 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d15651-2633-41b2-9c8f-d2a7d8f305cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:52.856761 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d15651-2633-41b2-9c8f-d2a7d8f305cf None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:52.868338 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-d7d15651-2633-41b2-9c8f-d2a7d8f305cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:28:52.868338 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:28:52.868338 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:28:52.868338 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:28:52.868338 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:28:52.868338 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:28:52.868338 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:28:52.868338 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:28:52.868338 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:28:52.868338 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:28:52.868338 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:28:52.868338 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:28:52.868338 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 03:28:52.868338 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 03:28:52.868338 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 03:28:52.869279 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 03:28:52.869279 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:28:52.869279 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:28:52.869279 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:28:52.869279 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:28:52.869279 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:28:52.869279 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:28:52.869279 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:28:52.869279 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:28:52.869279 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:28:52.869279 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:28:52.869279 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:28:52.869279 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:28:52.869279 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:28:52.869279 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:28:52.869279 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:28:52.869279 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:28:52.880197 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 03:28:52.880197 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 03:28:52.880197 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 03:28:52.880197 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 03:28:52.880197 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 03:28:52.880197 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 03:28:52.880197 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:28:52.880197 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:28:52.880197 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 542/1101] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:28:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:28:52.880197 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d15651-2633-41b2-9c8f-d2a7d8f305cf None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:52.886937 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:52.908815 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b0af3-f3c4-4628-aabf-0fb8f4935673 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:52.910811 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b0af3-f3c4-4628-aabf-0fb8f4935673 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:52.978520 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d15651-2633-41b2-9c8f-d2a7d8f305cf None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:53.010958 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 560/1102] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:28:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 16 03:28:53.011984 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6baa0e-d492-4090-8710-c49e145208d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:53.012596 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6baa0e-d492-4090-8710-c49e145208d7 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:53.012881 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6baa0e-d492-4090-8710-c49e145208d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:53.013157 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6baa0e-d492-4090-8710-c49e145208d7 None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:53.013874 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6baa0e-d492-4090-8710-c49e145208d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:53.014230 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6baa0e-d492-4090-8710-c49e145208d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:53.015789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6baa0e-d492-4090-8710-c49e145208d7 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:53.016930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b0af3-f3c4-4628-aabf-0fb8f4935673 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:53.033593 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 543/1103] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 03:28:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:28:53.034750 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6baa0e-d492-4090-8710-c49e145208d7 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:53.068528 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:53.093173 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:53.113969 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b0af3-f3c4-4628-aabf-0fb8f4935673 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:53.131725 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6baa0e-d492-4090-8710-c49e145208d7 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:53.148561 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669f71d-e6e5-4c4b-add5-15d9c4db8450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:53.149196 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669f71d-e6e5-4c4b-add5-15d9c4db8450 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:53.149475 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669f71d-e6e5-4c4b-add5-15d9c4db8450 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:53.149778 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669f71d-e6e5-4c4b-add5-15d9c4db8450 None admin] PATH_INFO: `/v3/projects/45c5245a99b6423681ad2847c995bcbe` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:53.150888 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669f71d-e6e5-4c4b-add5-15d9c4db8450 None admin] RBAC: Authorizing `identity:get_project(project_id=45c5245a99b6423681ad2847c995bcbe)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:53.152308 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669f71d-e6e5-4c4b-add5-15d9c4db8450 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:53.158788 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 561/1104] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:28:53 2022] GET /identity/v3/projects/45c5245a99b6423681ad2847c995bcbe => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:28:53.159922 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669f71d-e6e5-4c4b-add5-15d9c4db8450 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:53.169986 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd946d7-4f04-4bb2-b2cf-8330e206c905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:53.170584 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd946d7-4f04-4bb2-b2cf-8330e206c905 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:53.170864 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd946d7-4f04-4bb2-b2cf-8330e206c905 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:53.171133 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd946d7-4f04-4bb2-b2cf-8330e206c905 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:53.171847 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd946d7-4f04-4bb2-b2cf-8330e206c905 None admin] RBAC: Adding query filter params (role.id=da747e5ab1c6405a97b406d925ebd4b4, scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2, user.id=c09d1a4ac8b64921a6b05fcd567bb770) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:53.172150 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd946d7-4f04-4bb2-b2cf-8330e206c905 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:53.173592 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd946d7-4f04-4bb2-b2cf-8330e206c905 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:53.179491 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 544/1105] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:28:53 2022] GET /identity/v3/role_assignments?user.id=c09d1a4ac8b64921a6b05fcd567bb770&scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2&role.id=da747e5ab1c6405a97b406d925ebd4b4 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:53.263698 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669f71d-e6e5-4c4b-add5-15d9c4db8450 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:53.299762 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96187f2b-5b42-4ef3-9c0d-bb884d612d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:53.300388 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96187f2b-5b42-4ef3-9c0d-bb884d612d61 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:53.300663 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96187f2b-5b42-4ef3-9c0d-bb884d612d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:53.301150 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96187f2b-5b42-4ef3-9c0d-bb884d612d61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:53.301927 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96187f2b-5b42-4ef3-9c0d-bb884d612d61 None admin] RBAC: Adding query filter params (role.id=4ffac54101e248479bcdc0e54890020f, scope.project.id=45c5245a99b6423681ad2847c995bcbe, user.id=342eed0b73c34e3abd15d35965b36281) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:53.302234 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96187f2b-5b42-4ef3-9c0d-bb884d612d61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:53.303717 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96187f2b-5b42-4ef3-9c0d-bb884d612d61 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:53.310082 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 562/1106] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:28:53 2022] GET /identity/v3/role_assignments?user.id=342eed0b73c34e3abd15d35965b36281&scope.project.id=45c5245a99b6423681ad2847c995bcbe&role.id=4ffac54101e248479bcdc0e54890020f => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:28:55.466111 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d311b2-ad00-42e7-9d26-78dd28e0e709 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:55.466634 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d311b2-ad00-42e7-9d26-78dd28e0e709 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:55.466634 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d311b2-ad00-42e7-9d26-78dd28e0e709 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:55.467971 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 545/1107] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:28:55.473920 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249030c-e874-4be2-89f4-e771e91af006 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:55.474357 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249030c-e874-4be2-89f4-e771e91af006 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:55.474454 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249030c-e874-4be2-89f4-e771e91af006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:55.492146 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f249030c-e874-4be2-89f4-e771e91af006 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:55.493329 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f249030c-e874-4be2-89f4-e771e91af006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:55.496040 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:55.556816 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 563/1108] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:28:55.826050 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d311b2-ad00-42e7-9d26-78dd28e0e709 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:55.919835 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:55.923484 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d311b2-ad00-42e7-9d26-78dd28e0e709 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:55.956619 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176e4b4-471b-4863-b47e-af94264f75fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:55.957265 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176e4b4-471b-4863-b47e-af94264f75fb None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:55.957545 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176e4b4-471b-4863-b47e-af94264f75fb None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:55.957847 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176e4b4-471b-4863-b47e-af94264f75fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:55.958951 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176e4b4-471b-4863-b47e-af94264f75fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:55.960377 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176e4b4-471b-4863-b47e-af94264f75fb None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:55.961949 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 546/1109] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:28:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:55.967507 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f249030c-e874-4be2-89f4-e771e91af006 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:56.061359 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f249030c-e874-4be2-89f4-e771e91af006 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:56.093957 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d612670-d61c-4b69-bf41-d32d0c19ada1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:56.094498 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d612670-d61c-4b69-bf41-d32d0c19ada1 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:56.094777 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d612670-d61c-4b69-bf41-d32d0c19ada1 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:56.095046 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d612670-d61c-4b69-bf41-d32d0c19ada1 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:56.095688 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d612670-d61c-4b69-bf41-d32d0c19ada1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:56.097104 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d612670-d61c-4b69-bf41-d32d0c19ada1 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:56.108118 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:56.221808 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 564/1110] 10.222.0.33 () {60 vars in 1132 bytes} [Fri Sep 16 03:28:55 2022] POST /identity/v3/users => generated 286 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:28:58.376345 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06ce40-a32b-4f61-bfe6-0a23afe6cd7a None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:58.376837 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06ce40-a32b-4f61-bfe6-0a23afe6cd7a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:58.376837 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06ce40-a32b-4f61-bfe6-0a23afe6cd7a None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:58.378170 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 547/1111] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:28:58.383955 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a93087-8bd7-4c9d-8b04-7e0560a9daa9 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:58.384340 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a93087-8bd7-4c9d-8b04-7e0560a9daa9 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:58.384507 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a93087-8bd7-4c9d-8b04-7e0560a9daa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:58.402507 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-79a93087-8bd7-4c9d-8b04-7e0560a9daa9 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:28:58.403686 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-79a93087-8bd7-4c9d-8b04-7e0560a9daa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:28:58.467315 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 565/1112] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:28:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:28:58.739985 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06ce40-a32b-4f61-bfe6-0a23afe6cd7a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:58.836639 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06ce40-a32b-4f61-bfe6-0a23afe6cd7a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:58.869586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc681f-1b8c-4570-9fee-ec47fe2a16d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:58.870227 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc681f-1b8c-4570-9fee-ec47fe2a16d2 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:58.870506 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc681f-1b8c-4570-9fee-ec47fe2a16d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:58.870778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc681f-1b8c-4570-9fee-ec47fe2a16d2 None admin] PATH_INFO: `/v3/roles/fcb362c8a9fd47fbbb6b14397cae171c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:58.872159 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc681f-1b8c-4570-9fee-ec47fe2a16d2 None admin] RBAC: Authorizing `identity:get_role(role_id=fcb362c8a9fd47fbbb6b14397cae171c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:58.873522 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc681f-1b8c-4570-9fee-ec47fe2a16d2 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:58.874833 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 548/1113] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:28:58 2022] GET /identity/v3/roles/fcb362c8a9fd47fbbb6b14397cae171c => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:58.880474 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a93087-8bd7-4c9d-8b04-7e0560a9daa9 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:58.975773 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a93087-8bd7-4c9d-8b04-7e0560a9daa9 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:59.000220 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:59.008346 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae471b-7644-4eef-ad34-ec2e0f6d6707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:59.008958 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae471b-7644-4eef-ad34-ec2e0f6d6707 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:59.009233 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae471b-7644-4eef-ad34-ec2e0f6d6707 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:59.009508 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae471b-7644-4eef-ad34-ec2e0f6d6707 None admin] PATH_INFO: `/v3/users/937ddf26cd4c402eb546335206f7a905` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:59.022686 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeae471b-7644-4eef-ad34-ec2e0f6d6707 None admin] RBAC: Authorizing `identity:get_user(user_id=937ddf26cd4c402eb546335206f7a905)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:59.024103 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeae471b-7644-4eef-ad34-ec2e0f6d6707 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:59.025666 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 566/1114] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:28:58 2022] GET /identity/v3/users/937ddf26cd4c402eb546335206f7a905 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:59.031427 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc681f-1b8c-4570-9fee-ec47fe2a16d2 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:59.065167 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:59.127271 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc681f-1b8c-4570-9fee-ec47fe2a16d2 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:59.159738 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b1e71-4b01-41c0-8c72-c5066521df42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:59.160862 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b1e71-4b01-41c0-8c72-c5066521df42 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:59.161141 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b1e71-4b01-41c0-8c72-c5066521df42 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:59.161415 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b1e71-4b01-41c0-8c72-c5066521df42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:59.224627 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b1e71-4b01-41c0-8c72-c5066521df42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:59.226151 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b1e71-4b01-41c0-8c72-c5066521df42 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:59.256992 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:59.318288 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 549/1115] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:28:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 03:28:59.324196 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae471b-7644-4eef-ad34-ec2e0f6d6707 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:59.418750 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae471b-7644-4eef-ad34-ec2e0f6d6707 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:59.451081 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88accdd0-5d90-49d8-b730-7898e5a0504b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:59.451695 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88accdd0-5d90-49d8-b730-7898e5a0504b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:59.451979 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88accdd0-5d90-49d8-b730-7898e5a0504b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:59.452249 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88accdd0-5d90-49d8-b730-7898e5a0504b None admin] PATH_INFO: `/v3/projects/45c5245a99b6423681ad2847c995bcbe` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:59.453341 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88accdd0-5d90-49d8-b730-7898e5a0504b None admin] RBAC: Authorizing `identity:get_project(project_id=45c5245a99b6423681ad2847c995bcbe)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:59.454775 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88accdd0-5d90-49d8-b730-7898e5a0504b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:59.456341 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 567/1116] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:28:59 2022] GET /identity/v3/projects/45c5245a99b6423681ad2847c995bcbe => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:28:59.462379 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b1e71-4b01-41c0-8c72-c5066521df42 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:28:59.557542 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b1e71-4b01-41c0-8c72-c5066521df42 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:28:59.589367 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11dcb80-cfb8-482a-bfad-84c22b51ecc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:28:59.589986 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11dcb80-cfb8-482a-bfad-84c22b51ecc1 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:28:59.590266 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11dcb80-cfb8-482a-bfad-84c22b51ecc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:28:59.590539 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11dcb80-cfb8-482a-bfad-84c22b51ecc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:28:59.591243 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11dcb80-cfb8-482a-bfad-84c22b51ecc1 None admin] RBAC: Adding query filter params (role.id=fcb362c8a9fd47fbbb6b14397cae171c, scope.project.id=45c5245a99b6423681ad2847c995bcbe, user.id=937ddf26cd4c402eb546335206f7a905) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:28:59.591547 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11dcb80-cfb8-482a-bfad-84c22b51ecc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:28:59.592951 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11dcb80-cfb8-482a-bfad-84c22b51ecc1 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:28:59.595679 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:28:59.598948 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 550/1117] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:28:59 2022] GET /identity/v3/role_assignments?user.id=937ddf26cd4c402eb546335206f7a905&scope.project.id=45c5245a99b6423681ad2847c995bcbe&role.id=fcb362c8a9fd47fbbb6b14397cae171c => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:29:01.679338 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921c3d9-f067-4525-be06-1964a004851d None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:01.679867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921c3d9-f067-4525-be06-1964a004851d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:01.679867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921c3d9-f067-4525-be06-1964a004851d None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:01.681203 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 568/1118] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:29:01.686232 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1dac29-8ac0-482b-be74-8fb0363ee96e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:01.686600 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1dac29-8ac0-482b-be74-8fb0363ee96e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:01.686778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1dac29-8ac0-482b-be74-8fb0363ee96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:01.705096 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7c1dac29-8ac0-482b-be74-8fb0363ee96e None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:29:01.706300 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7c1dac29-8ac0-482b-be74-8fb0363ee96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:29:01.769240 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 551/1119] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:29:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:29:02.035005 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921c3d9-f067-4525-be06-1964a004851d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:02.087839 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:02.134954 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921c3d9-f067-4525-be06-1964a004851d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:02.167770 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041cdc1-c39e-4b09-bb44-bb73bd81491f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:02.168387 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041cdc1-c39e-4b09-bb44-bb73bd81491f None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:02.168662 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041cdc1-c39e-4b09-bb44-bb73bd81491f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:02.168930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041cdc1-c39e-4b09-bb44-bb73bd81491f None admin] PATH_INFO: `/v3/roles/fcb362c8a9fd47fbbb6b14397cae171c` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:02.170324 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041cdc1-c39e-4b09-bb44-bb73bd81491f None admin] RBAC: Authorizing `identity:get_role(role_id=fcb362c8a9fd47fbbb6b14397cae171c)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:02.171671 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041cdc1-c39e-4b09-bb44-bb73bd81491f None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:02.172969 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 569/1120] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:29:02 2022] GET /identity/v3/roles/fcb362c8a9fd47fbbb6b14397cae171c => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:29:02.179271 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1dac29-8ac0-482b-be74-8fb0363ee96e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:02.272983 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1dac29-8ac0-482b-be74-8fb0363ee96e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:02.299897 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:02.305461 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb8fd7-911d-4ad2-afa3-4897b8e30f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:02.306105 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb8fd7-911d-4ad2-afa3-4897b8e30f41 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:02.306382 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb8fd7-911d-4ad2-afa3-4897b8e30f41 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:02.306652 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb8fd7-911d-4ad2-afa3-4897b8e30f41 None admin] PATH_INFO: `/v3/users/937ddf26cd4c402eb546335206f7a905` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:02.307762 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb8fd7-911d-4ad2-afa3-4897b8e30f41 None admin] RBAC: Authorizing `identity:get_user(user_id=937ddf26cd4c402eb546335206f7a905)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:02.309216 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb8fd7-911d-4ad2-afa3-4897b8e30f41 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:02.310791 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 552/1121] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:29:02 2022] GET /identity/v3/users/937ddf26cd4c402eb546335206f7a905 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:29:02.316841 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041cdc1-c39e-4b09-bb44-bb73bd81491f None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:02.411963 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041cdc1-c39e-4b09-bb44-bb73bd81491f None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:02.430884 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:02.444389 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5c9a9-2503-4fb4-8942-13b165b4e52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:02.444996 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5c9a9-2503-4fb4-8942-13b165b4e52c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:02.445274 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5c9a9-2503-4fb4-8942-13b165b4e52c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:02.445543 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5c9a9-2503-4fb4-8942-13b165b4e52c None admin] PATH_INFO: `/v3/projects/45c5245a99b6423681ad2847c995bcbe` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:02.446661 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5c9a9-2503-4fb4-8942-13b165b4e52c None admin] RBAC: Authorizing `identity:get_project(project_id=45c5245a99b6423681ad2847c995bcbe)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:02.448066 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5c9a9-2503-4fb4-8942-13b165b4e52c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:02.449651 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 570/1122] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:29:02 2022] GET /identity/v3/projects/45c5245a99b6423681ad2847c995bcbe => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:29:02.455774 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb8fd7-911d-4ad2-afa3-4897b8e30f41 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:02.552606 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb8fd7-911d-4ad2-afa3-4897b8e30f41 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:02.584979 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a3f49-d942-4a9a-b808-d15e6c5c8ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:02.585651 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a3f49-d942-4a9a-b808-d15e6c5c8ee1 None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:02.585936 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a3f49-d942-4a9a-b808-d15e6c5c8ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:02.586211 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a3f49-d942-4a9a-b808-d15e6c5c8ee1 None admin] PATH_INFO: `/v3/projects/45c5245a99b6423681ad2847c995bcbe/users/937ddf26cd4c402eb546335206f7a905/roles/fcb362c8a9fd47fbbb6b14397cae171c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:02.588331 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a3f49-d942-4a9a-b808-d15e6c5c8ee1 None admin] RBAC: Authorizing `identity:create_grant(project_id=45c5245a99b6423681ad2847c995bcbe, user_id=937ddf26cd4c402eb546335206f7a905, role_id=fcb362c8a9fd47fbbb6b14397cae171c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:02.589781 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a3f49-d942-4a9a-b808-d15e6c5c8ee1 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:02.656365 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 553/1123] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 03:29:02 2022] PUT /identity/v3/projects/45c5245a99b6423681ad2847c995bcbe/users/937ddf26cd4c402eb546335206f7a905/roles/fcb362c8a9fd47fbbb6b14397cae171c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:29:04.745432 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c07cbd-fe37-4fdf-8e64-172ab687fec4 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:04.745970 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c07cbd-fe37-4fdf-8e64-172ab687fec4 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:04.746065 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c07cbd-fe37-4fdf-8e64-172ab687fec4 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:04.747344 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 571/1124] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:29:04.752481 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d47e3-042f-4a31-9de4-69896d932e1a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:04.752855 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d47e3-042f-4a31-9de4-69896d932e1a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:04.753025 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d47e3-042f-4a31-9de4-69896d932e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:04.772017 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ad9d47e3-042f-4a31-9de4-69896d932e1a None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:29:04.773188 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ad9d47e3-042f-4a31-9de4-69896d932e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:29:04.822749 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:04.836006 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 554/1125] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:29:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:29:05.100990 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c07cbd-fe37-4fdf-8e64-172ab687fec4 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:05.198649 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c07cbd-fe37-4fdf-8e64-172ab687fec4 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:05.231660 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd5dc0-9d63-41d8-b561-227cf226297d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:05.232269 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd5dc0-9d63-41d8-b561-227cf226297d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:05.232552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd5dc0-9d63-41d8-b561-227cf226297d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:05.232828 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd5dc0-9d63-41d8-b561-227cf226297d None admin] PATH_INFO: `/v3/roles/fcb362c8a9fd47fbbb6b14397cae171c` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:05.234241 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd5dc0-9d63-41d8-b561-227cf226297d None admin] RBAC: Authorizing `identity:get_role(role_id=fcb362c8a9fd47fbbb6b14397cae171c)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:05.235602 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd5dc0-9d63-41d8-b561-227cf226297d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:05.236879 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 572/1126] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:29:05 2022] GET /identity/v3/roles/fcb362c8a9fd47fbbb6b14397cae171c => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:29:05.242373 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d47e3-042f-4a31-9de4-69896d932e1a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:05.337265 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d47e3-042f-4a31-9de4-69896d932e1a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:05.369256 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b1d1a-e1c5-4106-86c5-4c8aa24f80d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:05.369850 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b1d1a-e1c5-4106-86c5-4c8aa24f80d5 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:05.370137 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b1d1a-e1c5-4106-86c5-4c8aa24f80d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:05.370413 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b1d1a-e1c5-4106-86c5-4c8aa24f80d5 None admin] PATH_INFO: `/v3/users/937ddf26cd4c402eb546335206f7a905` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:05.371525 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b1d1a-e1c5-4106-86c5-4c8aa24f80d5 None admin] RBAC: Authorizing `identity:get_user(user_id=937ddf26cd4c402eb546335206f7a905)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:05.372951 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b1d1a-e1c5-4106-86c5-4c8aa24f80d5 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:05.374533 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 555/1127] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:29:05 2022] GET /identity/v3/users/937ddf26cd4c402eb546335206f7a905 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:29:05.380403 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd5dc0-9d63-41d8-b561-227cf226297d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:05.434788 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:05.476145 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd5dc0-9d63-41d8-b561-227cf226297d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:05.509064 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65261ad-15d5-4e4a-ad09-c68257a72c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:05.509671 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65261ad-15d5-4e4a-ad09-c68257a72c78 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:05.509956 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65261ad-15d5-4e4a-ad09-c68257a72c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:05.510231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65261ad-15d5-4e4a-ad09-c68257a72c78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:05.588631 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65261ad-15d5-4e4a-ad09-c68257a72c78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:05.590102 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65261ad-15d5-4e4a-ad09-c68257a72c78 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:05.644379 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:05.687547 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 573/1128] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:29:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 03:29:05.693522 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b1d1a-e1c5-4106-86c5-4c8aa24f80d5 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:05.747457 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:05.789147 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b1d1a-e1c5-4106-86c5-4c8aa24f80d5 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:05.820568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05366eeb-bef2-45f4-8b13-e20b7c528a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:05.821178 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05366eeb-bef2-45f4-8b13-e20b7c528a65 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:05.821454 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05366eeb-bef2-45f4-8b13-e20b7c528a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:05.821750 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05366eeb-bef2-45f4-8b13-e20b7c528a65 None admin] PATH_INFO: `/v3/projects/45c5245a99b6423681ad2847c995bcbe` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:05.822840 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05366eeb-bef2-45f4-8b13-e20b7c528a65 None admin] RBAC: Authorizing `identity:get_project(project_id=45c5245a99b6423681ad2847c995bcbe)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:05.824267 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05366eeb-bef2-45f4-8b13-e20b7c528a65 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:05.825879 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 556/1129] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:29:05 2022] GET /identity/v3/projects/45c5245a99b6423681ad2847c995bcbe => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:29:05.832501 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65261ad-15d5-4e4a-ad09-c68257a72c78 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:05.927047 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65261ad-15d5-4e4a-ad09-c68257a72c78 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:05.959026 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e9049-42f1-4aa7-b073-c2e6993930fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:05.959614 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e9049-42f1-4aa7-b073-c2e6993930fd None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:05.959890 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e9049-42f1-4aa7-b073-c2e6993930fd None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:05.960160 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e9049-42f1-4aa7-b073-c2e6993930fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:05.960864 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e9049-42f1-4aa7-b073-c2e6993930fd None admin] RBAC: Adding query filter params (role.id=fcb362c8a9fd47fbbb6b14397cae171c, scope.project.id=45c5245a99b6423681ad2847c995bcbe, user.id=937ddf26cd4c402eb546335206f7a905) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:29:05.961166 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e9049-42f1-4aa7-b073-c2e6993930fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:05.962595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e9049-42f1-4aa7-b073-c2e6993930fd None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:05.968191 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 574/1130] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:29:05 2022] GET /identity/v3/role_assignments?user.id=937ddf26cd4c402eb546335206f7a905&scope.project.id=45c5245a99b6423681ad2847c995bcbe&role.id=fcb362c8a9fd47fbbb6b14397cae171c => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:29:08.110692 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90b958-4ae6-42f8-a4eb-e730b2e3fb2c None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:08.111222 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90b958-4ae6-42f8-a4eb-e730b2e3fb2c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:08.111222 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90b958-4ae6-42f8-a4eb-e730b2e3fb2c None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:08.112572 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 557/1131] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:29:08.117744 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc5a52-b784-4324-bdcd-8bae05f7ff23 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:08.118183 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc5a52-b784-4324-bdcd-8bae05f7ff23 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:08.118315 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc5a52-b784-4324-bdcd-8bae05f7ff23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:08.135953 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9bfc5a52-b784-4324-bdcd-8bae05f7ff23 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:29:08.137118 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9bfc5a52-b784-4324-bdcd-8bae05f7ff23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:29:08.151398 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:08.201537 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 575/1132] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:29:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:29:08.470436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90b958-4ae6-42f8-a4eb-e730b2e3fb2c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:08.568729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90b958-4ae6-42f8-a4eb-e730b2e3fb2c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:08.590850 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:08.601414 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca0733-6ace-4c0c-9f75-8128b94ef018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:08.602058 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca0733-6ace-4c0c-9f75-8128b94ef018 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:08.613452 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca0733-6ace-4c0c-9f75-8128b94ef018 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:08.613452 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca0733-6ace-4c0c-9f75-8128b94ef018 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:08.613452 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca0733-6ace-4c0c-9f75-8128b94ef018 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:08.613452 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca0733-6ace-4c0c-9f75-8128b94ef018 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:08.613452 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 558/1133] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:29:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:29:08.613959 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc5a52-b784-4324-bdcd-8bae05f7ff23 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:08.709234 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc5a52-b784-4324-bdcd-8bae05f7ff23 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:08.741844 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f2be95-2087-4775-a7a7-8c1ecdd9f423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:08.742380 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2be95-2087-4775-a7a7-8c1ecdd9f423 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:08.742654 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2be95-2087-4775-a7a7-8c1ecdd9f423 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:08.742919 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2be95-2087-4775-a7a7-8c1ecdd9f423 None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:08.743573 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f2be95-2087-4775-a7a7-8c1ecdd9f423 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:08.744979 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f2be95-2087-4775-a7a7-8c1ecdd9f423 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:08.848391 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 576/1134] 10.222.0.33 () {60 vars in 1141 bytes} [Fri Sep 16 03:29:08 2022] POST /identity/v3/projects => generated 311 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:29:11.017483 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573af834-b1fe-4ce7-bda1-5358d679f02a None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:11.018046 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573af834-b1fe-4ce7-bda1-5358d679f02a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:11.018046 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573af834-b1fe-4ce7-bda1-5358d679f02a None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:11.019395 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 559/1135] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:29:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:29:11.025491 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94adc03-c92a-40f7-b1b2-610a416f32fb None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:11.025925 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94adc03-c92a-40f7-b1b2-610a416f32fb None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:11.026091 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94adc03-c92a-40f7-b1b2-610a416f32fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:11.032279 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:11.044050 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b94adc03-c92a-40f7-b1b2-610a416f32fb None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:29:11.052014 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b94adc03-c92a-40f7-b1b2-610a416f32fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:29:11.109700 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 577/1136] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:29:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 03:29:11.376853 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573af834-b1fe-4ce7-bda1-5358d679f02a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:11.474093 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573af834-b1fe-4ce7-bda1-5358d679f02a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:11.506064 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782e39a-e063-4639-a626-f78f84f0957f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:11.506677 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782e39a-e063-4639-a626-f78f84f0957f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:11.506955 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782e39a-e063-4639-a626-f78f84f0957f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:11.507228 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782e39a-e063-4639-a626-f78f84f0957f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:11.508339 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782e39a-e063-4639-a626-f78f84f0957f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:11.509792 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782e39a-e063-4639-a626-f78f84f0957f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:11.511331 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 560/1137] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:29:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:29:11.516868 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94adc03-c92a-40f7-b1b2-610a416f32fb None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:11.611057 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94adc03-c92a-40f7-b1b2-610a416f32fb None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:11.639579 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:11.644815 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9618c0-efb2-45f4-9e40-647719515eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:11.645697 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9618c0-efb2-45f4-9e40-647719515eef None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:11.645983 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9618c0-efb2-45f4-9e40-647719515eef None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:11.646257 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9618c0-efb2-45f4-9e40-647719515eef None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:11.646921 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9618c0-efb2-45f4-9e40-647719515eef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:11.648333 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9618c0-efb2-45f4-9e40-647719515eef None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:11.766800 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 578/1138] 10.222.0.33 () {60 vars in 1132 bytes} [Fri Sep 16 03:29:11 2022] POST /identity/v3/users => generated 286 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:29:13.954815 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717f99a-d465-4a43-9ad8-665408db15b9 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:13.955322 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717f99a-d465-4a43-9ad8-665408db15b9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:13.955437 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717f99a-d465-4a43-9ad8-665408db15b9 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:13.957174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 561/1139] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:29:13.962745 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a3255-2937-442c-941e-edd2796203c2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:13.963131 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a3255-2937-442c-941e-edd2796203c2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:13.963298 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a3255-2937-442c-941e-edd2796203c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:13.982372 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e21a3255-2937-442c-941e-edd2796203c2 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:29:13.983560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e21a3255-2937-442c-941e-edd2796203c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:29:14.048374 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 579/1140] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:29:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 03:29:14.316518 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d717f99a-d465-4a43-9ad8-665408db15b9 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:14.373253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:14.413315 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d717f99a-d465-4a43-9ad8-665408db15b9 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:14.445996 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd952c-8be7-4742-9729-2e5f04f21884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:14.446607 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd952c-8be7-4742-9729-2e5f04f21884 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:14.446885 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd952c-8be7-4742-9729-2e5f04f21884 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:14.447155 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd952c-8be7-4742-9729-2e5f04f21884 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:14.456785 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd952c-8be7-4742-9729-2e5f04f21884 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:29:14.461482 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-82fd952c-8be7-4742-9729-2e5f04f21884 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:29:14.461482 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:29:14.461482 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:29:14.461482 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:29:14.461482 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:29:14.461482 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:29:14.461482 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:29:14.461482 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:29:14.461482 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:29:14.461482 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:29:14.461482 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:29:14.461482 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:29:14.461482 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:29:14.461482 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:29:14.461482 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:29:14.461482 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:29:14.462568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:29:14.462568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:29:14.462568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:29:14.462568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:29:14.462568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:29:14.462568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:29:14.462568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:29:14.462568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:29:14.462568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:29:14.462568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:29:14.462568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:29:14.462568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:29:14.462568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:29:14.462568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:29:14.462568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:29:14.462568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:29:14.463456 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:29:14.463456 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:29:14.463456 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:29:14.463456 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:29:14.463456 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:29:14.463456 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:29:14.463456 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:29:14.463456 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:29:14.463456 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:29:14.463456 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:29:14.463456 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:29:14.463456 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:29:14.463456 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 562/1141] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 03:29:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:29:14.468422 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a3255-2937-442c-941e-edd2796203c2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:14.564853 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a3255-2937-442c-941e-edd2796203c2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:14.581481 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:14.598318 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195e91e-8b02-482c-ae89-c352bb8cf3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:14.598923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195e91e-8b02-482c-ae89-c352bb8cf3e5 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:14.599206 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195e91e-8b02-482c-ae89-c352bb8cf3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:14.599481 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195e91e-8b02-482c-ae89-c352bb8cf3e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:14.600136 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d195e91e-8b02-482c-ae89-c352bb8cf3e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:29:14.600439 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d195e91e-8b02-482c-ae89-c352bb8cf3e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:14.601824 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d195e91e-8b02-482c-ae89-c352bb8cf3e5 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:14.609871 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 580/1142] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:29:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:29:14.616404 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd952c-8be7-4742-9729-2e5f04f21884 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:14.712194 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd952c-8be7-4742-9729-2e5f04f21884 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:14.731448 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:14.744873 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f3a06-5010-4cff-8de1-77fa4d1524ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:14.745525 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f3a06-5010-4cff-8de1-77fa4d1524ac None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:14.745811 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f3a06-5010-4cff-8de1-77fa4d1524ac None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:14.746086 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f3a06-5010-4cff-8de1-77fa4d1524ac None admin] PATH_INFO: `/v3/users/12f78f36bd6e4f6d93dcdcae911ed224` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:14.759307 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f3a06-5010-4cff-8de1-77fa4d1524ac None admin] RBAC: Authorizing `identity:get_user(user_id=12f78f36bd6e4f6d93dcdcae911ed224)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:14.760750 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f3a06-5010-4cff-8de1-77fa4d1524ac None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:14.762388 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 563/1143] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:29:14 2022] GET /identity/v3/users/12f78f36bd6e4f6d93dcdcae911ed224 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:29:14.768190 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195e91e-8b02-482c-ae89-c352bb8cf3e5 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:14.866519 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195e91e-8b02-482c-ae89-c352bb8cf3e5 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:14.898839 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478d7db-0f1c-489c-a40d-95e5f97fb93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:14.899435 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478d7db-0f1c-489c-a40d-95e5f97fb93f None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:14.899716 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478d7db-0f1c-489c-a40d-95e5f97fb93f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:14.899990 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478d7db-0f1c-489c-a40d-95e5f97fb93f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:14.945829 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:14.965052 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5478d7db-0f1c-489c-a40d-95e5f97fb93f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:14.966533 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5478d7db-0f1c-489c-a40d-95e5f97fb93f None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:15.069064 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 581/1144] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:29:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 03:29:15.075028 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f3a06-5010-4cff-8de1-77fa4d1524ac None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:15.169951 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f3a06-5010-4cff-8de1-77fa4d1524ac None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:15.202106 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba5d61-a85a-4c41-a0bd-c0ed3822bc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:15.202811 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba5d61-a85a-4c41-a0bd-c0ed3822bc96 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:15.203085 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba5d61-a85a-4c41-a0bd-c0ed3822bc96 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:15.203355 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba5d61-a85a-4c41-a0bd-c0ed3822bc96 None admin] PATH_INFO: `/v3/projects/5589fd751d3246d4b651f0ad43309848` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:15.204437 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba5d61-a85a-4c41-a0bd-c0ed3822bc96 None admin] RBAC: Authorizing `identity:get_project(project_id=5589fd751d3246d4b651f0ad43309848)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:15.205883 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba5d61-a85a-4c41-a0bd-c0ed3822bc96 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:15.208036 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 564/1145] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:29:15 2022] GET /identity/v3/projects/5589fd751d3246d4b651f0ad43309848 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:29:15.214129 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478d7db-0f1c-489c-a40d-95e5f97fb93f None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:15.290985 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:15.308980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478d7db-0f1c-489c-a40d-95e5f97fb93f None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:15.342477 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ee9c8-3003-4e36-9a34-b0c8e650c925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:15.343065 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ee9c8-3003-4e36-9a34-b0c8e650c925 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:15.343342 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ee9c8-3003-4e36-9a34-b0c8e650c925 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:15.343608 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ee9c8-3003-4e36-9a34-b0c8e650c925 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:15.344312 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ee9c8-3003-4e36-9a34-b0c8e650c925 None admin] RBAC: Adding query filter params (role.id=4ffac54101e248479bcdc0e54890020f, scope.project.id=5589fd751d3246d4b651f0ad43309848, user.id=12f78f36bd6e4f6d93dcdcae911ed224) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:29:15.344619 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ee9c8-3003-4e36-9a34-b0c8e650c925 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:15.346056 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ee9c8-3003-4e36-9a34-b0c8e650c925 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:15.351135 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 582/1146] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:29:15 2022] GET /identity/v3/role_assignments?user.id=12f78f36bd6e4f6d93dcdcae911ed224&scope.project.id=5589fd751d3246d4b651f0ad43309848&role.id=4ffac54101e248479bcdc0e54890020f => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:29:17.472180 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89550bac-7b75-4d7e-a47c-58dc757e733c None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:17.472733 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89550bac-7b75-4d7e-a47c-58dc757e733c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:17.472733 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89550bac-7b75-4d7e-a47c-58dc757e733c None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:17.474105 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 565/1147] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:29:17.479275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2cc76-c4f9-4764-a82b-0b1149ff1c69 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:17.479710 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2cc76-c4f9-4764-a82b-0b1149ff1c69 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:17.479811 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2cc76-c4f9-4764-a82b-0b1149ff1c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:17.498806 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-26c2cc76-c4f9-4764-a82b-0b1149ff1c69 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:29:17.499975 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-26c2cc76-c4f9-4764-a82b-0b1149ff1c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:29:17.564131 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 583/1148] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:29:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:29:17.829468 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89550bac-7b75-4d7e-a47c-58dc757e733c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:17.875833 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:17.927271 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89550bac-7b75-4d7e-a47c-58dc757e733c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:17.958958 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda528fa-e96b-48eb-8da4-76a93ed3cec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:17.959571 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda528fa-e96b-48eb-8da4-76a93ed3cec8 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:17.959850 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda528fa-e96b-48eb-8da4-76a93ed3cec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:17.960119 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda528fa-e96b-48eb-8da4-76a93ed3cec8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:17.969586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda528fa-e96b-48eb-8da4-76a93ed3cec8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:29:17.974880 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-eda528fa-e96b-48eb-8da4-76a93ed3cec8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:29:17.974880 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:29:17.974880 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:29:17.974880 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:29:17.974880 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:29:17.974880 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:29:17.974880 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:29:17.974880 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:29:17.974880 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:29:17.974880 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:29:17.974880 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:29:17.974880 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:29:17.974880 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:29:17.974880 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:29:17.974880 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:29:17.974880 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:29:17.976049 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:29:17.976049 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:29:17.976049 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:29:17.976049 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:29:17.976049 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:29:17.976049 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:29:17.976049 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:29:17.976049 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:29:17.976049 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:29:17.976049 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:29:17.976049 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:29:17.976049 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:29:17.976049 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:29:17.976049 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:29:17.976049 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:29:17.976049 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:29:17.977333 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:29:17.977333 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:29:17.977333 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:29:17.977333 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:29:17.977333 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:29:17.977333 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:29:17.977333 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:29:17.977333 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:29:17.977333 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:29:17.977333 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:29:17.977333 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:29:17.977333 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:29:17.977333 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 566/1149] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 03:29:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:29:17.981925 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2cc76-c4f9-4764-a82b-0b1149ff1c69 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:18.052155 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:18.075855 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2cc76-c4f9-4764-a82b-0b1149ff1c69 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:18.109515 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed24e2c-e75b-451c-9c56-054842763c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:18.110089 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed24e2c-e75b-451c-9c56-054842763c1d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:18.110374 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed24e2c-e75b-451c-9c56-054842763c1d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:18.110644 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed24e2c-e75b-451c-9c56-054842763c1d None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:18.111298 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed24e2c-e75b-451c-9c56-054842763c1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:29:18.111604 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed24e2c-e75b-451c-9c56-054842763c1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:18.112990 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed24e2c-e75b-451c-9c56-054842763c1d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:18.120735 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 584/1150] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:29:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:29:18.126411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda528fa-e96b-48eb-8da4-76a93ed3cec8 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:18.223281 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda528fa-e96b-48eb-8da4-76a93ed3cec8 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:18.230148 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:18.255709 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f9e60-dd5b-4029-ac48-d7aaa8827028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:18.256428 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f9e60-dd5b-4029-ac48-d7aaa8827028 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:18.256703 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f9e60-dd5b-4029-ac48-d7aaa8827028 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:18.256973 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f9e60-dd5b-4029-ac48-d7aaa8827028 None admin] PATH_INFO: `/v3/users/12f78f36bd6e4f6d93dcdcae911ed224` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:18.258098 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f9e60-dd5b-4029-ac48-d7aaa8827028 None admin] RBAC: Authorizing `identity:get_user(user_id=12f78f36bd6e4f6d93dcdcae911ed224)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:18.259508 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f9e60-dd5b-4029-ac48-d7aaa8827028 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:18.261031 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 567/1151] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:29:18 2022] GET /identity/v3/users/12f78f36bd6e4f6d93dcdcae911ed224 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:29:18.266679 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed24e2c-e75b-451c-9c56-054842763c1d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:18.362427 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed24e2c-e75b-451c-9c56-054842763c1d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:18.395259 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830fcd42-ea20-48c4-90f8-d74bb0c78319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:18.395869 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fcd42-ea20-48c4-90f8-d74bb0c78319 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:18.396148 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fcd42-ea20-48c4-90f8-d74bb0c78319 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:18.396419 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fcd42-ea20-48c4-90f8-d74bb0c78319 None admin] PATH_INFO: `/v3/projects/5589fd751d3246d4b651f0ad43309848` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:18.397527 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830fcd42-ea20-48c4-90f8-d74bb0c78319 None admin] RBAC: Authorizing `identity:get_project(project_id=5589fd751d3246d4b651f0ad43309848)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:18.398977 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830fcd42-ea20-48c4-90f8-d74bb0c78319 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:18.400547 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 585/1152] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:29:18 2022] GET /identity/v3/projects/5589fd751d3246d4b651f0ad43309848 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:29:18.406244 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f9e60-dd5b-4029-ac48-d7aaa8827028 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:18.499404 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f9e60-dd5b-4029-ac48-d7aaa8827028 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:18.532137 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6453f7-3fe9-47b8-bd45-23e69c43f795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:18.532769 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6453f7-3fe9-47b8-bd45-23e69c43f795 None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:18.533045 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6453f7-3fe9-47b8-bd45-23e69c43f795 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:18.533312 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6453f7-3fe9-47b8-bd45-23e69c43f795 None admin] PATH_INFO: `/v3/projects/5589fd751d3246d4b651f0ad43309848/users/12f78f36bd6e4f6d93dcdcae911ed224/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:18.535172 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6453f7-3fe9-47b8-bd45-23e69c43f795 None admin] RBAC: Authorizing `identity:create_grant(project_id=5589fd751d3246d4b651f0ad43309848, user_id=12f78f36bd6e4f6d93dcdcae911ed224, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:18.536571 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6453f7-3fe9-47b8-bd45-23e69c43f795 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:18.629122 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 568/1153] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 03:29:18 2022] PUT /identity/v3/projects/5589fd751d3246d4b651f0ad43309848/users/12f78f36bd6e4f6d93dcdcae911ed224/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:29:20.717322 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f19181-385c-48bd-a4dd-2593a554f08b None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:20.717828 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f19181-385c-48bd-a4dd-2593a554f08b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:20.717930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f19181-385c-48bd-a4dd-2593a554f08b None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:20.719237 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 586/1154] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:29:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:29:20.725110 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105bc90-b98a-415b-b2fa-545f83081abb None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:20.725527 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105bc90-b98a-415b-b2fa-545f83081abb None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:20.725672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105bc90-b98a-415b-b2fa-545f83081abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:20.743198 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5105bc90-b98a-415b-b2fa-545f83081abb None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:29:20.744376 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5105bc90-b98a-415b-b2fa-545f83081abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:29:20.770168 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:20.807996 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 569/1155] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:29:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:29:21.085443 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f19181-385c-48bd-a4dd-2593a554f08b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:21.089292 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:21.184610 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f19181-385c-48bd-a4dd-2593a554f08b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:21.217497 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3698686-e14d-4c49-924f-bb1be2033def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:21.218138 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3698686-e14d-4c49-924f-bb1be2033def None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:21.218422 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3698686-e14d-4c49-924f-bb1be2033def None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:21.218697 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3698686-e14d-4c49-924f-bb1be2033def None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:21.228503 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3698686-e14d-4c49-924f-bb1be2033def None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:29:21.233280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-b3698686-e14d-4c49-924f-bb1be2033def None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:29:21.233280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:29:21.233280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:29:21.233280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:29:21.233280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:29:21.233280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:29:21.233280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:29:21.233280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:29:21.233280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:29:21.233280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:29:21.233280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:29:21.233280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:29:21.233280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:29:21.233280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:29:21.233280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:29:21.233280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:29:21.234400 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:29:21.234400 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:29:21.234400 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:29:21.234400 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:29:21.234400 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:29:21.234400 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:29:21.234400 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:29:21.234400 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:29:21.234400 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:29:21.234400 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:29:21.234400 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:29:21.234400 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:29:21.234400 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:29:21.234400 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:29:21.234400 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:29:21.234400 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:29:21.235435 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:29:21.235435 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:29:21.235435 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:29:21.235435 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:29:21.235435 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:29:21.235435 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:29:21.235435 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:29:21.235435 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:29:21.235435 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:29:21.235435 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:29:21.235435 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:29:21.235435 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:29:21.235435 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 587/1156] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 03:29:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:29:21.240361 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105bc90-b98a-415b-b2fa-545f83081abb None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:21.339614 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105bc90-b98a-415b-b2fa-545f83081abb None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:21.371399 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e2463-3f83-4c2d-a8f4-5f3a1775bbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:21.371997 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e2463-3f83-4c2d-a8f4-5f3a1775bbc5 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:21.372277 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e2463-3f83-4c2d-a8f4-5f3a1775bbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:21.372552 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e2463-3f83-4c2d-a8f4-5f3a1775bbc5 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:21.373205 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e2463-3f83-4c2d-a8f4-5f3a1775bbc5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:29:21.373504 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e2463-3f83-4c2d-a8f4-5f3a1775bbc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:21.374892 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e2463-3f83-4c2d-a8f4-5f3a1775bbc5 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:21.383052 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 570/1157] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:29:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:29:21.388897 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3698686-e14d-4c49-924f-bb1be2033def None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:21.450138 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:21.484703 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3698686-e14d-4c49-924f-bb1be2033def None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:21.518113 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab48f33-d128-48d6-8ce2-ac98978eeb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:21.518744 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab48f33-d128-48d6-8ce2-ac98978eeb53 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:21.519023 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab48f33-d128-48d6-8ce2-ac98978eeb53 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:21.519322 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab48f33-d128-48d6-8ce2-ac98978eeb53 None admin] PATH_INFO: `/v3/users/12f78f36bd6e4f6d93dcdcae911ed224` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:21.520687 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab48f33-d128-48d6-8ce2-ac98978eeb53 None admin] RBAC: Authorizing `identity:get_user(user_id=12f78f36bd6e4f6d93dcdcae911ed224)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:21.522133 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab48f33-d128-48d6-8ce2-ac98978eeb53 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:21.523672 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 588/1158] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:29:21 2022] GET /identity/v3/users/12f78f36bd6e4f6d93dcdcae911ed224 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:29:21.529215 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e2463-3f83-4c2d-a8f4-5f3a1775bbc5 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:21.556318 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:21.626103 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e2463-3f83-4c2d-a8f4-5f3a1775bbc5 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:21.658137 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd17325-b8ce-40a1-b742-a515d988277f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:21.658729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd17325-b8ce-40a1-b742-a515d988277f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:21.659036 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd17325-b8ce-40a1-b742-a515d988277f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:21.659308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd17325-b8ce-40a1-b742-a515d988277f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:21.723253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd17325-b8ce-40a1-b742-a515d988277f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:21.724700 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd17325-b8ce-40a1-b742-a515d988277f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:21.749304 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:21.819084 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 571/1159] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:29:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 03:29:21.824983 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab48f33-d128-48d6-8ce2-ac98978eeb53 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:21.923170 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab48f33-d128-48d6-8ce2-ac98978eeb53 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:21.950814 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:21.955451 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aaeb4a-39ef-4d47-b17c-2dbdc7a23d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:21.956860 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aaeb4a-39ef-4d47-b17c-2dbdc7a23d58 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:21.957136 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aaeb4a-39ef-4d47-b17c-2dbdc7a23d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:21.957402 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aaeb4a-39ef-4d47-b17c-2dbdc7a23d58 None admin] PATH_INFO: `/v3/projects/5589fd751d3246d4b651f0ad43309848` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:21.958531 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aaeb4a-39ef-4d47-b17c-2dbdc7a23d58 None admin] RBAC: Authorizing `identity:get_project(project_id=5589fd751d3246d4b651f0ad43309848)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:21.959943 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aaeb4a-39ef-4d47-b17c-2dbdc7a23d58 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:21.961524 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 589/1160] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:29:21 2022] GET /identity/v3/projects/5589fd751d3246d4b651f0ad43309848 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:29:21.967788 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd17325-b8ce-40a1-b742-a515d988277f None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:22.061658 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd17325-b8ce-40a1-b742-a515d988277f None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:22.086795 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:22.095105 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e358219-a674-4587-b30e-c12aebfb0011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:22.095698 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e358219-a674-4587-b30e-c12aebfb0011 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:22.095977 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e358219-a674-4587-b30e-c12aebfb0011 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:22.096252 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e358219-a674-4587-b30e-c12aebfb0011 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:22.100703 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e358219-a674-4587-b30e-c12aebfb0011 None admin] RBAC: Adding query filter params (role.id=4ffac54101e248479bcdc0e54890020f, scope.project.id=5589fd751d3246d4b651f0ad43309848, user.id=12f78f36bd6e4f6d93dcdcae911ed224) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:29:22.100703 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e358219-a674-4587-b30e-c12aebfb0011 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:22.100703 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e358219-a674-4587-b30e-c12aebfb0011 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:22.104172 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 572/1161] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:29:21 2022] GET /identity/v3/role_assignments?user.id=12f78f36bd6e4f6d93dcdcae911ed224&scope.project.id=5589fd751d3246d4b651f0ad43309848&role.id=4ffac54101e248479bcdc0e54890020f => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:29:24.269318 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b79851-50d0-42ad-bcbf-4fa30974df9f None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:24.270128 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b79851-50d0-42ad-bcbf-4fa30974df9f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:24.270240 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b79851-50d0-42ad-bcbf-4fa30974df9f None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:24.271521 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 590/1162] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:29:24.276759 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821167c-6267-4cab-8627-c7622a770042 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:24.277175 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821167c-6267-4cab-8627-c7622a770042 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:24.277306 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821167c-6267-4cab-8627-c7622a770042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:24.296190 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2821167c-6267-4cab-8627-c7622a770042 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:29:24.297367 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2821167c-6267-4cab-8627-c7622a770042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:29:24.360542 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 573/1163] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:29:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:29:24.626967 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b79851-50d0-42ad-bcbf-4fa30974df9f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:24.724497 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b79851-50d0-42ad-bcbf-4fa30974df9f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:24.757145 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5714078-46c4-4fcc-a346-bca5d62fc5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:24.757766 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5714078-46c4-4fcc-a346-bca5d62fc5ff None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:24.758043 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5714078-46c4-4fcc-a346-bca5d62fc5ff None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:24.758312 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5714078-46c4-4fcc-a346-bca5d62fc5ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:24.819907 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:24.822042 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5714078-46c4-4fcc-a346-bca5d62fc5ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:24.823464 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5714078-46c4-4fcc-a346-bca5d62fc5ff None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:24.916259 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 591/1164] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:29:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 03:29:24.922220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821167c-6267-4cab-8627-c7622a770042 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:25.016726 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821167c-6267-4cab-8627-c7622a770042 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:25.036329 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:25.049504 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99982cd9-ea60-4fb8-b37f-d3190f11f33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:25.050153 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99982cd9-ea60-4fb8-b37f-d3190f11f33e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:25.050437 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99982cd9-ea60-4fb8-b37f-d3190f11f33e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:25.050709 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99982cd9-ea60-4fb8-b37f-d3190f11f33e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:25.057026 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99982cd9-ea60-4fb8-b37f-d3190f11f33e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:25.058479 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99982cd9-ea60-4fb8-b37f-d3190f11f33e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:25.070441 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-99982cd9-ea60-4fb8-b37f-d3190f11f33e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 16 03:29:25.070441 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:29:25.070441 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 16 03:29:25.070441 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 16 03:29:25.070441 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 03:29:25.070441 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 03:29:25.070441 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 03:29:25.070441 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 03:29:25.070441 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 16 03:29:25.070441 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:29:25.070441 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 03:29:25.070441 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:29:25.070441 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:29:25.070441 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:29:25.070441 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:29:25.070441 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:29:25.070441 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:29:25.071628 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:29:25.071628 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:29:25.071628 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:29:25.071628 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:29:25.071628 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:29:25.071628 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:29:25.071628 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:29:25.071628 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:29:25.071628 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:29:25.071628 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:29:25.071628 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:29:25.071628 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:29:25.071628 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:29:25.071628 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:29:25.071628 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:29:25.071628 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:29:25.072917 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:29:25.072917 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:29:25.072917 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:29:25.072917 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:29:25.072917 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:29:25.072917 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:29:25.072917 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:29:25.072917 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:29:25.072917 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:29:25.072917 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:29:25.072917 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 16 03:29:25.072917 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:29:25.072917 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 16 03:29:25.072917 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:29:25.072917 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 574/1165] 10.222.0.33 () {56 vars in 1117 bytes} [Fri Sep 16 03:29:24 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:29:25.077446 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5714078-46c4-4fcc-a346-bca5d62fc5ff None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:25.169596 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:25.172396 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5714078-46c4-4fcc-a346-bca5d62fc5ff None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:25.205877 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ad1a8-f718-412d-90d3-44fd51af5f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:25.206477 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ad1a8-f718-412d-90d3-44fd51af5f50 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:25.206757 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ad1a8-f718-412d-90d3-44fd51af5f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:25.207030 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ad1a8-f718-412d-90d3-44fd51af5f50 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:25.207659 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ad1a8-f718-412d-90d3-44fd51af5f50 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:29:25.207963 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ad1a8-f718-412d-90d3-44fd51af5f50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:25.209311 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ad1a8-f718-412d-90d3-44fd51af5f50 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:25.216155 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 592/1166] 10.222.0.33 () {56 vars in 1115 bytes} [Fri Sep 16 03:29:25 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:29:27.305872 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84140b-cc36-4f27-bcb1-816e7425d52c None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:27.306433 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84140b-cc36-4f27-bcb1-816e7425d52c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:27.306433 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84140b-cc36-4f27-bcb1-816e7425d52c None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:27.307796 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 575/1167] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:29:27.313094 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7eaf6-608b-469c-9c39-496036fb45f0 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:27.313483 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7eaf6-608b-469c-9c39-496036fb45f0 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:27.313688 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7eaf6-608b-469c-9c39-496036fb45f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:27.331503 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e6c7eaf6-608b-469c-9c39-496036fb45f0 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:29:27.332688 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e6c7eaf6-608b-469c-9c39-496036fb45f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:29:27.397056 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 593/1168] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:29:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:29:27.667777 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84140b-cc36-4f27-bcb1-816e7425d52c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:27.767095 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84140b-cc36-4f27-bcb1-816e7425d52c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:27.798968 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b43af-604a-4986-a9e8-6a1b17e797f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:27.800132 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b43af-604a-4986-a9e8-6a1b17e797f2 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:27.800409 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b43af-604a-4986-a9e8-6a1b17e797f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:27.800674 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b43af-604a-4986-a9e8-6a1b17e797f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:27.801328 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b43af-604a-4986-a9e8-6a1b17e797f2 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:27.802717 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b43af-604a-4986-a9e8-6a1b17e797f2 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:27.891021 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 576/1169] 10.222.0.33 () {60 vars in 1138 bytes} [Fri Sep 16 03:29:27 2022] POST /identity/v3/domains => generated 267 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:29:30.036672 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2171b-b966-4ab4-a45e-4000eec0034a None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:30.037192 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2171b-b966-4ab4-a45e-4000eec0034a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:30.037306 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2171b-b966-4ab4-a45e-4000eec0034a None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:30.038594 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 594/1170] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:29:30.043727 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0a42f-bb14-41db-aa81-c0df84349b07 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:30.044091 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0a42f-bb14-41db-aa81-c0df84349b07 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:30.044283 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0a42f-bb14-41db-aa81-c0df84349b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:30.062105 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-9bc0a42f-bb14-41db-aa81-c0df84349b07 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:29:30.063285 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9bc0a42f-bb14-41db-aa81-c0df84349b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:29:30.096736 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:30.127010 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 577/1171] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:29:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:29:30.393783 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2171b-b966-4ab4-a45e-4000eec0034a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:30.484604 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:30.492215 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2171b-b966-4ab4-a45e-4000eec0034a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:30.526054 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69b259-07b9-4b36-94cd-11f2c7c9ed55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:30.527023 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69b259-07b9-4b36-94cd-11f2c7c9ed55 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:30.527305 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69b259-07b9-4b36-94cd-11f2c7c9ed55 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:30.527579 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69b259-07b9-4b36-94cd-11f2c7c9ed55 None admin] PATH_INFO: `/v3/domains/2e525e5809ae4ee38f4f8928553266d2` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:30.537614 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa69b259-07b9-4b36-94cd-11f2c7c9ed55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=2e525e5809ae4ee38f4f8928553266d2)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:30.539084 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa69b259-07b9-4b36-94cd-11f2c7c9ed55 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:30.540633 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 595/1172] 10.222.0.33 () {56 vars in 1183 bytes} [Fri Sep 16 03:29:30 2022] GET /identity/v3/domains/2e525e5809ae4ee38f4f8928553266d2 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:29:30.546374 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0a42f-bb14-41db-aa81-c0df84349b07 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:30.640084 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0a42f-bb14-41db-aa81-c0df84349b07 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:30.672009 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c261506-a369-41ae-b3fb-04af1c94c503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:30.672545 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c261506-a369-41ae-b3fb-04af1c94c503 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:30.672822 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c261506-a369-41ae-b3fb-04af1c94c503 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:30.673098 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c261506-a369-41ae-b3fb-04af1c94c503 None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:30.673753 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c261506-a369-41ae-b3fb-04af1c94c503 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:30.675729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c261506-a369-41ae-b3fb-04af1c94c503 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:30.738729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 578/1173] 10.222.0.33 () {60 vars in 1141 bytes} [Fri Sep 16 03:29:30 2022] POST /identity/v3/projects => generated 361 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:29:32.904751 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad0903-4c22-4147-b15f-501a672352e1 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:32.905282 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad0903-4c22-4147-b15f-501a672352e1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:32.905282 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad0903-4c22-4147-b15f-501a672352e1 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:32.906655 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 596/1174] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:29:32.912565 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78036413-ac86-4491-8ac3-e87c7171b080 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:32.912929 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78036413-ac86-4491-8ac3-e87c7171b080 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:32.913118 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78036413-ac86-4491-8ac3-e87c7171b080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:32.930643 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-78036413-ac86-4491-8ac3-e87c7171b080 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:29:32.931811 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-78036413-ac86-4491-8ac3-e87c7171b080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:29:32.947419 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:32.997336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 579/1175] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:29:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:29:33.271731 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad0903-4c22-4147-b15f-501a672352e1 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:33.369209 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad0903-4c22-4147-b15f-501a672352e1 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:33.402517 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1ff2d-4318-4ddd-94bf-01bf392b3bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:33.403131 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1ff2d-4318-4ddd-94bf-01bf392b3bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:33.403412 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1ff2d-4318-4ddd-94bf-01bf392b3bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:33.403684 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1ff2d-4318-4ddd-94bf-01bf392b3bd9 None admin] PATH_INFO: `/v3/domains/2e525e5809ae4ee38f4f8928553266d2` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:33.404790 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1ff2d-4318-4ddd-94bf-01bf392b3bd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=2e525e5809ae4ee38f4f8928553266d2)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:33.406245 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1ff2d-4318-4ddd-94bf-01bf392b3bd9 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:33.407774 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 597/1176] 10.222.0.33 () {56 vars in 1183 bytes} [Fri Sep 16 03:29:33 2022] GET /identity/v3/domains/2e525e5809ae4ee38f4f8928553266d2 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:29:33.413382 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78036413-ac86-4491-8ac3-e87c7171b080 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:33.506690 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78036413-ac86-4491-8ac3-e87c7171b080 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:33.538473 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d170b-0f4f-46e3-86f6-3fbc3df64126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:33.539043 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d170b-0f4f-46e3-86f6-3fbc3df64126 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:33.539319 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d170b-0f4f-46e3-86f6-3fbc3df64126 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:33.539591 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d170b-0f4f-46e3-86f6-3fbc3df64126 None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:33.540265 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398d170b-0f4f-46e3-86f6-3fbc3df64126 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:33.541717 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398d170b-0f4f-46e3-86f6-3fbc3df64126 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:33.626709 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 580/1177] 10.222.0.33 () {60 vars in 1132 bytes} [Fri Sep 16 03:29:33 2022] POST /identity/v3/users => generated 311 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:29:35.768435 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb63e2e-081e-431b-a9a8-e7472cd48b57 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:35.768905 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb63e2e-081e-431b-a9a8-e7472cd48b57 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:35.768989 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb63e2e-081e-431b-a9a8-e7472cd48b57 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:35.770736 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 598/1178] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:29:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:29:35.775837 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdaebb-e9a2-42ab-b728-2e4680c6f778 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:35.776222 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdaebb-e9a2-42ab-b728-2e4680c6f778 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:35.776377 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdaebb-e9a2-42ab-b728-2e4680c6f778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:35.794485 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-efcdaebb-e9a2-42ab-b728-2e4680c6f778 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:29:35.795656 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-efcdaebb-e9a2-42ab-b728-2e4680c6f778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:29:35.797531 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:35.859036 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 581/1179] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:29:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:29:36.122597 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb63e2e-081e-431b-a9a8-e7472cd48b57 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:36.146558 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:36.219726 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb63e2e-081e-431b-a9a8-e7472cd48b57 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:36.252335 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98a6d9-dada-423a-9cfc-f06f94c07ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:36.252946 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98a6d9-dada-423a-9cfc-f06f94c07ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:36.253225 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98a6d9-dada-423a-9cfc-f06f94c07ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:36.253495 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98a6d9-dada-423a-9cfc-f06f94c07ad6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:36.263164 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98a6d9-dada-423a-9cfc-f06f94c07ad6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:29:36.267929 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-6d98a6d9-dada-423a-9cfc-f06f94c07ad6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:29:36.267929 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:29:36.267929 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:29:36.267929 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:29:36.267929 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:29:36.267929 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:29:36.267929 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:29:36.267929 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:29:36.267929 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:29:36.267929 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:29:36.267929 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:29:36.267929 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:29:36.267929 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:29:36.267929 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:29:36.267929 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:29:36.267929 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:29:36.269028 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:29:36.269028 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:29:36.269028 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:29:36.269028 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:29:36.269028 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:29:36.269028 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:29:36.269028 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:29:36.269028 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:29:36.269028 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:29:36.269028 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:29:36.269028 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:29:36.269028 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:29:36.269028 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:29:36.269028 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:29:36.269028 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:29:36.269028 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:29:36.270341 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:29:36.270341 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:29:36.270341 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:29:36.270341 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:29:36.270341 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:29:36.270341 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:29:36.270341 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:29:36.270341 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:29:36.270341 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:29:36.270341 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:29:36.270341 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:29:36.270341 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:29:36.270341 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 599/1180] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 03:29:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:29:36.275094 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdaebb-e9a2-42ab-b728-2e4680c6f778 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:36.368891 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdaebb-e9a2-42ab-b728-2e4680c6f778 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:36.400661 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc751c9-8d60-48fe-8515-a5700e7a75e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:36.401193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc751c9-8d60-48fe-8515-a5700e7a75e8 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:36.401469 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc751c9-8d60-48fe-8515-a5700e7a75e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:36.401766 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc751c9-8d60-48fe-8515-a5700e7a75e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:36.402416 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc751c9-8d60-48fe-8515-a5700e7a75e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:29:36.402713 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc751c9-8d60-48fe-8515-a5700e7a75e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:36.404060 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc751c9-8d60-48fe-8515-a5700e7a75e8 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:36.409324 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:36.412481 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 582/1181] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:29:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:29:36.418234 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98a6d9-dada-423a-9cfc-f06f94c07ad6 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:36.497277 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:36.514142 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98a6d9-dada-423a-9cfc-f06f94c07ad6 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:36.547268 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d39b398-f80e-47aa-877c-a11a050d1a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:36.547881 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d39b398-f80e-47aa-877c-a11a050d1a29 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:36.548158 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d39b398-f80e-47aa-877c-a11a050d1a29 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:36.548429 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d39b398-f80e-47aa-877c-a11a050d1a29 None admin] PATH_INFO: `/v3/users/8ddf853457b843f69ee26bde20dba5e1` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:36.560761 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d39b398-f80e-47aa-877c-a11a050d1a29 None admin] RBAC: Authorizing `identity:get_user(user_id=8ddf853457b843f69ee26bde20dba5e1)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:36.562213 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d39b398-f80e-47aa-877c-a11a050d1a29 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:36.563766 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 600/1182] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:29:36 2022] GET /identity/v3/users/8ddf853457b843f69ee26bde20dba5e1 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:29:36.569584 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc751c9-8d60-48fe-8515-a5700e7a75e8 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:36.666300 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc751c9-8d60-48fe-8515-a5700e7a75e8 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:36.698132 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90d01d-ea66-4547-9ccb-41265dd572a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:36.698738 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90d01d-ea66-4547-9ccb-41265dd572a7 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:36.699021 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90d01d-ea66-4547-9ccb-41265dd572a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:36.699295 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90d01d-ea66-4547-9ccb-41265dd572a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:36.761530 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:36.763625 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90d01d-ea66-4547-9ccb-41265dd572a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:36.765055 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90d01d-ea66-4547-9ccb-41265dd572a7 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:36.859484 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 583/1183] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:29:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 03:29:36.865475 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d39b398-f80e-47aa-877c-a11a050d1a29 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:36.961335 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d39b398-f80e-47aa-877c-a11a050d1a29 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:36.993144 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f02fa5-b8bc-42c1-b476-138edbd21107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:36.993787 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f02fa5-b8bc-42c1-b476-138edbd21107 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:36.994069 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f02fa5-b8bc-42c1-b476-138edbd21107 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:36.994339 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f02fa5-b8bc-42c1-b476-138edbd21107 None admin] PATH_INFO: `/v3/projects/e1eafbd97e134cd3b1f28f63811e956f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:36.995437 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f02fa5-b8bc-42c1-b476-138edbd21107 None admin] RBAC: Authorizing `identity:get_project(project_id=e1eafbd97e134cd3b1f28f63811e956f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:36.996852 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f02fa5-b8bc-42c1-b476-138edbd21107 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:36.998463 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 601/1184] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:29:36 2022] GET /identity/v3/projects/e1eafbd97e134cd3b1f28f63811e956f => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:29:37.004866 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90d01d-ea66-4547-9ccb-41265dd572a7 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:37.097040 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:37.099937 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90d01d-ea66-4547-9ccb-41265dd572a7 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:37.132848 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5799d-186d-4346-903a-094ff2eba4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:37.133443 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5799d-186d-4346-903a-094ff2eba4e1 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:37.133746 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5799d-186d-4346-903a-094ff2eba4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:37.134015 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5799d-186d-4346-903a-094ff2eba4e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:37.134723 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5799d-186d-4346-903a-094ff2eba4e1 None admin] RBAC: Adding query filter params (role.id=4ffac54101e248479bcdc0e54890020f, scope.project.id=e1eafbd97e134cd3b1f28f63811e956f, user.id=8ddf853457b843f69ee26bde20dba5e1) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:29:37.135026 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5799d-186d-4346-903a-094ff2eba4e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:37.136436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5799d-186d-4346-903a-094ff2eba4e1 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:37.141573 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 584/1185] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:29:37 2022] GET /identity/v3/role_assignments?user.id=8ddf853457b843f69ee26bde20dba5e1&scope.project.id=e1eafbd97e134cd3b1f28f63811e956f&role.id=4ffac54101e248479bcdc0e54890020f => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:29:39.251677 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997620c-7d48-468b-831d-f91591a2f192 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:39.252716 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997620c-7d48-468b-831d-f91591a2f192 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:39.252716 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997620c-7d48-468b-831d-f91591a2f192 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:39.254070 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 602/1186] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:29:39.259081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93754026-dae1-4c9d-9256-f5b7591f994f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:39.259483 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93754026-dae1-4c9d-9256-f5b7591f994f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:39.259625 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93754026-dae1-4c9d-9256-f5b7591f994f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:39.278063 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-93754026-dae1-4c9d-9256-f5b7591f994f None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:29:39.279235 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-93754026-dae1-4c9d-9256-f5b7591f994f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:29:39.342255 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 585/1187] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:29:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:29:39.607948 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997620c-7d48-468b-831d-f91591a2f192 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:39.618682 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:39.708587 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997620c-7d48-468b-831d-f91591a2f192 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:39.740918 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7158c11-dec6-4b7e-8790-1a7e3e249576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:39.741528 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7158c11-dec6-4b7e-8790-1a7e3e249576 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:39.741831 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7158c11-dec6-4b7e-8790-1a7e3e249576 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:39.742100 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7158c11-dec6-4b7e-8790-1a7e3e249576 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:39.751683 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7158c11-dec6-4b7e-8790-1a7e3e249576 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:29:39.756320 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-d7158c11-dec6-4b7e-8790-1a7e3e249576 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:29:39.756320 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:29:39.756320 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:29:39.756320 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:29:39.756320 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:29:39.756320 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:29:39.756320 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:29:39.756320 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:29:39.756320 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:29:39.756320 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:29:39.756320 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:29:39.756320 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:29:39.756320 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:29:39.756320 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:29:39.756320 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:29:39.756320 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:29:39.757417 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:29:39.757417 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:29:39.757417 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:29:39.757417 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:29:39.757417 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:29:39.757417 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:29:39.757417 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:29:39.757417 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:29:39.757417 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:29:39.757417 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:29:39.757417 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:29:39.757417 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:29:39.757417 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:29:39.757417 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:29:39.757417 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:29:39.757417 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:29:39.758505 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:29:39.758505 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:29:39.758505 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:29:39.758505 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:29:39.758505 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:29:39.758505 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:29:39.758505 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:29:39.758505 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:29:39.758505 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:29:39.758505 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:29:39.758505 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:29:39.758505 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:29:39.758505 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 603/1188] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 03:29:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:29:39.763389 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93754026-dae1-4c9d-9256-f5b7591f994f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:39.851783 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:39.858144 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93754026-dae1-4c9d-9256-f5b7591f994f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:39.890553 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab324c62-a0de-42be-abf7-68ce56b91d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:39.891145 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab324c62-a0de-42be-abf7-68ce56b91d1f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:39.891421 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab324c62-a0de-42be-abf7-68ce56b91d1f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:39.891688 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab324c62-a0de-42be-abf7-68ce56b91d1f None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:39.892332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab324c62-a0de-42be-abf7-68ce56b91d1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:29:39.893205 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab324c62-a0de-42be-abf7-68ce56b91d1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:39.894578 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab324c62-a0de-42be-abf7-68ce56b91d1f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:39.902683 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 586/1189] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:29:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:29:39.908282 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7158c11-dec6-4b7e-8790-1a7e3e249576 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:39.972011 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:40.003393 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7158c11-dec6-4b7e-8790-1a7e3e249576 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:40.036611 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de892316-e4ad-40ea-9ff5-c76ec5aee3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:40.037220 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de892316-e4ad-40ea-9ff5-c76ec5aee3ef None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:40.037495 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de892316-e4ad-40ea-9ff5-c76ec5aee3ef None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:40.037791 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de892316-e4ad-40ea-9ff5-c76ec5aee3ef None admin] PATH_INFO: `/v3/users/8ddf853457b843f69ee26bde20dba5e1` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:40.038891 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de892316-e4ad-40ea-9ff5-c76ec5aee3ef None admin] RBAC: Authorizing `identity:get_user(user_id=8ddf853457b843f69ee26bde20dba5e1)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:40.040296 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de892316-e4ad-40ea-9ff5-c76ec5aee3ef None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:40.041865 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 604/1190] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:29:39 2022] GET /identity/v3/users/8ddf853457b843f69ee26bde20dba5e1 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:29:40.047592 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab324c62-a0de-42be-abf7-68ce56b91d1f None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:40.143757 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab324c62-a0de-42be-abf7-68ce56b91d1f None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:40.175519 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ed1df-85c4-41fb-8ab3-781989faacfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:40.176128 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ed1df-85c4-41fb-8ab3-781989faacfe None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:40.176404 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ed1df-85c4-41fb-8ab3-781989faacfe None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:40.176674 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ed1df-85c4-41fb-8ab3-781989faacfe None admin] PATH_INFO: `/v3/projects/e1eafbd97e134cd3b1f28f63811e956f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:40.177799 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ed1df-85c4-41fb-8ab3-781989faacfe None admin] RBAC: Authorizing `identity:get_project(project_id=e1eafbd97e134cd3b1f28f63811e956f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:40.179216 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ed1df-85c4-41fb-8ab3-781989faacfe None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:40.180802 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 587/1191] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:29:40 2022] GET /identity/v3/projects/e1eafbd97e134cd3b1f28f63811e956f => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:29:40.186810 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de892316-e4ad-40ea-9ff5-c76ec5aee3ef None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:40.280978 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de892316-e4ad-40ea-9ff5-c76ec5aee3ef None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:40.313324 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf34ef-c6b3-4eeb-a79b-91016ae49e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:40.313987 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf34ef-c6b3-4eeb-a79b-91016ae49e94 None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:40.314268 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf34ef-c6b3-4eeb-a79b-91016ae49e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:40.315121 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf34ef-c6b3-4eeb-a79b-91016ae49e94 None admin] PATH_INFO: `/v3/projects/e1eafbd97e134cd3b1f28f63811e956f/users/8ddf853457b843f69ee26bde20dba5e1/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:40.317001 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf34ef-c6b3-4eeb-a79b-91016ae49e94 None admin] RBAC: Authorizing `identity:create_grant(project_id=e1eafbd97e134cd3b1f28f63811e956f, user_id=8ddf853457b843f69ee26bde20dba5e1, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:40.318446 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf34ef-c6b3-4eeb-a79b-91016ae49e94 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:40.321356 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:40.405010 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 605/1192] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 03:29:40 2022] PUT /identity/v3/projects/e1eafbd97e134cd3b1f28f63811e956f/users/8ddf853457b843f69ee26bde20dba5e1/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:29:42.518269 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b92e82-0dd7-43ea-ae13-d685a4bbc5cb None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:42.518816 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b92e82-0dd7-43ea-ae13-d685a4bbc5cb None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:42.518816 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b92e82-0dd7-43ea-ae13-d685a4bbc5cb None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:42.520407 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 588/1193] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:29:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:29:42.525704 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b675e-20e4-4bd2-abd7-34964a6f687f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:42.526084 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b675e-20e4-4bd2-abd7-34964a6f687f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:42.526261 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b675e-20e4-4bd2-abd7-34964a6f687f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:42.544631 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-320b675e-20e4-4bd2-abd7-34964a6f687f None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:29:42.545952 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-320b675e-20e4-4bd2-abd7-34964a6f687f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:29:42.610215 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 606/1194] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:29:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:29:42.884036 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b92e82-0dd7-43ea-ae13-d685a4bbc5cb None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:42.909313 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:42.981400 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b92e82-0dd7-43ea-ae13-d685a4bbc5cb None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:43.013119 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac67c6-7e9f-4f06-b6ac-68e7854eb269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:43.013760 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac67c6-7e9f-4f06-b6ac-68e7854eb269 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:43.014045 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac67c6-7e9f-4f06-b6ac-68e7854eb269 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:43.014321 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac67c6-7e9f-4f06-b6ac-68e7854eb269 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:43.024668 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac67c6-7e9f-4f06-b6ac-68e7854eb269 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:29:43.029421 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-e9ac67c6-7e9f-4f06-b6ac-68e7854eb269 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:29:43.029421 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:29:43.029421 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:29:43.029421 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:29:43.029421 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:29:43.029421 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:29:43.029421 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:29:43.029421 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:29:43.029421 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:29:43.029421 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:29:43.029421 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:29:43.029421 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:29:43.029421 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:29:43.029421 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:29:43.029421 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:29:43.029421 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:29:43.030634 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:29:43.030634 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:29:43.030634 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:29:43.030634 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:29:43.030634 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:29:43.030634 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:29:43.030634 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:29:43.030634 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:29:43.030634 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:29:43.030634 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:29:43.030634 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:29:43.030634 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:29:43.030634 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:29:43.030634 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:29:43.030634 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:29:43.030634 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:29:43.031493 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:29:43.031493 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:29:43.031493 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:29:43.031493 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:29:43.031493 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:29:43.031493 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:29:43.031493 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:29:43.031493 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:29:43.031493 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:29:43.031493 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:29:43.031493 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:29:43.031493 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:29:43.031493 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 589/1195] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 03:29:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:29:43.037025 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b675e-20e4-4bd2-abd7-34964a6f687f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:43.131254 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b675e-20e4-4bd2-abd7-34964a6f687f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:43.156080 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:43.164678 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a0818-4025-47d1-81e6-8fe06f72462a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:43.171037 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a0818-4025-47d1-81e6-8fe06f72462a None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:43.171037 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a0818-4025-47d1-81e6-8fe06f72462a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:43.171037 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a0818-4025-47d1-81e6-8fe06f72462a None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:43.171037 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a0818-4025-47d1-81e6-8fe06f72462a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:29:43.171037 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a0818-4025-47d1-81e6-8fe06f72462a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:43.171037 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a0818-4025-47d1-81e6-8fe06f72462a None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:43.176203 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 607/1196] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:29:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:29:43.182092 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac67c6-7e9f-4f06-b6ac-68e7854eb269 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:43.262816 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:43.278532 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac67c6-7e9f-4f06-b6ac-68e7854eb269 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:43.311768 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8af38-8e5a-4a84-b0cd-6bb9fad89fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:43.312378 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8af38-8e5a-4a84-b0cd-6bb9fad89fbb None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:43.312657 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8af38-8e5a-4a84-b0cd-6bb9fad89fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:43.312929 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8af38-8e5a-4a84-b0cd-6bb9fad89fbb None admin] PATH_INFO: `/v3/users/8ddf853457b843f69ee26bde20dba5e1` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:43.314062 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad8af38-8e5a-4a84-b0cd-6bb9fad89fbb None admin] RBAC: Authorizing `identity:get_user(user_id=8ddf853457b843f69ee26bde20dba5e1)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:43.316089 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad8af38-8e5a-4a84-b0cd-6bb9fad89fbb None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:43.317650 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 590/1197] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 03:29:43 2022] GET /identity/v3/users/8ddf853457b843f69ee26bde20dba5e1 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:29:43.323174 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a0818-4025-47d1-81e6-8fe06f72462a None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:43.418521 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a0818-4025-47d1-81e6-8fe06f72462a None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:43.450720 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce1bae-11c1-43ee-b877-5c092d1d90de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:43.451306 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce1bae-11c1-43ee-b877-5c092d1d90de None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:43.451584 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce1bae-11c1-43ee-b877-5c092d1d90de None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:43.451853 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce1bae-11c1-43ee-b877-5c092d1d90de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:43.503689 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:43.515147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce1bae-11c1-43ee-b877-5c092d1d90de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:43.516575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce1bae-11c1-43ee-b877-5c092d1d90de None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:43.610947 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 608/1198] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:29:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 03:29:43.616740 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8af38-8e5a-4a84-b0cd-6bb9fad89fbb None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:43.713457 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8af38-8e5a-4a84-b0cd-6bb9fad89fbb None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:43.745040 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607d6a1-ae63-4b12-a7e6-94caa498ae0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:43.745681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607d6a1-ae63-4b12-a7e6-94caa498ae0f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:43.745966 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607d6a1-ae63-4b12-a7e6-94caa498ae0f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:43.746241 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607d6a1-ae63-4b12-a7e6-94caa498ae0f None admin] PATH_INFO: `/v3/projects/e1eafbd97e134cd3b1f28f63811e956f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:43.747352 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607d6a1-ae63-4b12-a7e6-94caa498ae0f None admin] RBAC: Authorizing `identity:get_project(project_id=e1eafbd97e134cd3b1f28f63811e956f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:43.748781 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607d6a1-ae63-4b12-a7e6-94caa498ae0f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:43.750424 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 591/1199] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 03:29:43 2022] GET /identity/v3/projects/e1eafbd97e134cd3b1f28f63811e956f => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:29:43.756986 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce1bae-11c1-43ee-b877-5c092d1d90de None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:29:43.840259 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:43.852096 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce1bae-11c1-43ee-b877-5c092d1d90de None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:29:43.891289 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb0f3f-a2de-4530-8184-5f981eb7a0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:29:43.891888 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb0f3f-a2de-4530-8184-5f981eb7a0bc None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:29:43.892170 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb0f3f-a2de-4530-8184-5f981eb7a0bc None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:29:43.893025 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb0f3f-a2de-4530-8184-5f981eb7a0bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:29:43.893777 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb0f3f-a2de-4530-8184-5f981eb7a0bc None admin] RBAC: Adding query filter params (role.id=4ffac54101e248479bcdc0e54890020f, scope.project.id=e1eafbd97e134cd3b1f28f63811e956f, user.id=8ddf853457b843f69ee26bde20dba5e1) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:29:43.894082 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb0f3f-a2de-4530-8184-5f981eb7a0bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:29:43.895781 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb0f3f-a2de-4530-8184-5f981eb7a0bc None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:29:43.901432 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 609/1200] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:29:43 2022] GET /identity/v3/role_assignments?user.id=8ddf853457b843f69ee26bde20dba5e1&scope.project.id=e1eafbd97e134cd3b1f28f63811e956f&role.id=4ffac54101e248479bcdc0e54890020f => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:29:53.740955 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:29:53.898881 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=24 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:02.224778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56981ec9-60b7-434d-baa2-f4991ff0e14d None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:02.225402 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56981ec9-60b7-434d-baa2-f4991ff0e14d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:02.225402 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56981ec9-60b7-434d-baa2-f4991ff0e14d None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:02.226678 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 592/1201] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:31:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:31:02.232119 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5569b-5133-4684-8385-f65d5a03f88a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:02.232925 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5569b-5133-4684-8385-f65d5a03f88a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:02.232925 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5569b-5133-4684-8385-f65d5a03f88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:02.251751 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d9b5569b-5133-4684-8385-f65d5a03f88a None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:31:02.252966 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d9b5569b-5133-4684-8385-f65d5a03f88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:31:02.318895 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 610/1202] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:31:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:31:02.596185 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56981ec9-60b7-434d-baa2-f4991ff0e14d None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:02.697393 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56981ec9-60b7-434d-baa2-f4991ff0e14d None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:02.730039 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b56f3-cf40-4ed0-9944-6c116a5444f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:02.730657 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b56f3-cf40-4ed0-9944-6c116a5444f6 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:02.730933 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b56f3-cf40-4ed0-9944-6c116a5444f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:02.731202 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b56f3-cf40-4ed0-9944-6c116a5444f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:02.742011 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b56f3-cf40-4ed0-9944-6c116a5444f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:02.743472 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b56f3-cf40-4ed0-9944-6c116a5444f6 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:02.757864 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-779b56f3-cf40-4ed0-9944-6c116a5444f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:31:02.757864 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:31:02.757864 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:31:02.757864 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:31:02.757864 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:31:02.757864 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:31:02.757864 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:31:02.757864 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:31:02.757864 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:31:02.757864 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:31:02.757864 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:31:02.757864 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:31:02.757864 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:31:02.757864 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:31:02.757864 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:31:02.757864 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:31:02.760436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:31:02.760436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:31:02.760436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:31:02.760436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:31:02.760436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:31:02.760436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:31:02.760436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:31:02.760436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:31:02.760436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:31:02.760436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:31:02.760436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:31:02.760436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:31:02.760436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:31:02.760436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:31:02.760436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:31:02.760436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:31:02.760436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:31:02.761651 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:31:02.761651 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:31:02.761651 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:31:02.761651 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 593/1203] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:31:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:31:02.765077 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5569b-5133-4684-8385-f65d5a03f88a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:02.859287 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5569b-5133-4684-8385-f65d5a03f88a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:02.887082 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:02.892677 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ba307-fe29-458c-ac29-7561b3431263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:02.897008 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ba307-fe29-458c-ac29-7561b3431263 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:02.897008 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ba307-fe29-458c-ac29-7561b3431263 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:02.897008 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ba307-fe29-458c-ac29-7561b3431263 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:02.897008 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ba307-fe29-458c-ac29-7561b3431263 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:31:02.897008 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ba307-fe29-458c-ac29-7561b3431263 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:02.897008 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ba307-fe29-458c-ac29-7561b3431263 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:02.907008 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 611/1204] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:31:02.913246 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b56f3-cf40-4ed0-9944-6c116a5444f6 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:02.965741 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:03.011861 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b56f3-cf40-4ed0-9944-6c116a5444f6 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:03.043906 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6094b-ce0f-4f46-a846-d81f90826999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:03.049440 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6094b-ce0f-4f46-a846-d81f90826999 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:03.049440 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6094b-ce0f-4f46-a846-d81f90826999 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:03.049440 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6094b-ce0f-4f46-a846-d81f90826999 None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:03.049440 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d6094b-ce0f-4f46-a846-d81f90826999 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:03.049440 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d6094b-ce0f-4f46-a846-d81f90826999 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:03.156243 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 594/1205] 10.222.0.33 () {60 vars in 1132 bytes} [Fri Sep 16 03:31:02 2022] POST /identity/v3/users => generated 251 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:31:05.330910 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2b6b1-4206-4499-b036-3a4c459665ca None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:05.331459 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2b6b1-4206-4499-b036-3a4c459665ca None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:05.331459 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2b6b1-4206-4499-b036-3a4c459665ca None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:05.332859 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 612/1206] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:31:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:31:05.338470 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf205b3-f09b-4e5f-a1de-b9add133168b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:05.338873 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf205b3-f09b-4e5f-a1de-b9add133168b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:05.339294 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf205b3-f09b-4e5f-a1de-b9add133168b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:05.356933 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4bf205b3-f09b-4e5f-a1de-b9add133168b None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:31:05.358158 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4bf205b3-f09b-4e5f-a1de-b9add133168b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:31:05.423613 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 595/1207] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:31:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:31:05.693652 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2b6b1-4206-4499-b036-3a4c459665ca None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:05.792167 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2b6b1-4206-4499-b036-3a4c459665ca None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:05.825808 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324588a0-d975-4d2d-98db-acfa98242a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:05.826430 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324588a0-d975-4d2d-98db-acfa98242a0e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:05.826711 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324588a0-d975-4d2d-98db-acfa98242a0e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:05.826983 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324588a0-d975-4d2d-98db-acfa98242a0e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:05.836739 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324588a0-d975-4d2d-98db-acfa98242a0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:31:05.841483 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-324588a0-d975-4d2d-98db-acfa98242a0e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 03:31:05.841483 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:31:05.841483 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:31:05.841483 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:31:05.841483 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:31:05.841483 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:31:05.841483 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:31:05.841483 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:31:05.841483 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:31:05.841483 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:31:05.841483 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:31:05.841483 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:31:05.841483 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:31:05.841483 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:31:05.841483 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:31:05.841483 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:31:05.842556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:31:05.842556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:31:05.842556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:31:05.842556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:31:05.842556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:31:05.842556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:31:05.842556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:31:05.842556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:31:05.842556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:31:05.842556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:31:05.842556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:31:05.842556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:31:05.842556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:31:05.842556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:31:05.842556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:31:05.842556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:31:05.843400 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:31:05.843400 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:31:05.843400 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:31:05.843400 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:31:05.843400 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:31:05.843400 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:31:05.843400 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:31:05.843400 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:31:05.843400 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:31:05.843400 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:31:05.843400 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 03:31:05.843400 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:31:05.843400 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 613/1208] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 03:31:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:31:05.850064 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf205b3-f09b-4e5f-a1de-b9add133168b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:05.888647 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:05.946556 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf205b3-f09b-4e5f-a1de-b9add133168b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:05.979741 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438c723-c808-4067-af5e-d19f964ddbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:05.980363 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438c723-c808-4067-af5e-d19f964ddbb1 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:05.980625 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438c723-c808-4067-af5e-d19f964ddbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:05.980896 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438c723-c808-4067-af5e-d19f964ddbb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:05.981551 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438c723-c808-4067-af5e-d19f964ddbb1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:31:05.981882 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438c723-c808-4067-af5e-d19f964ddbb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:05.983240 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438c723-c808-4067-af5e-d19f964ddbb1 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:05.991436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 596/1209] 10.222.0.33 () {56 vars in 1103 bytes} [Fri Sep 16 03:31:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:31:05.997300 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324588a0-d975-4d2d-98db-acfa98242a0e None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:06.046885 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:06.093554 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324588a0-d975-4d2d-98db-acfa98242a0e None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:06.126785 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbd48d-e5af-4fe6-b06c-9cbd6d5c8b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:06.127405 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbd48d-e5af-4fe6-b06c-9cbd6d5c8b54 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:06.127683 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbd48d-e5af-4fe6-b06c-9cbd6d5c8b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:06.128019 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbd48d-e5af-4fe6-b06c-9cbd6d5c8b54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:06.137896 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcbd48d-e5af-4fe6-b06c-9cbd6d5c8b54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:06.139733 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcbd48d-e5af-4fe6-b06c-9cbd6d5c8b54 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:06.153552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-6dcbd48d-e5af-4fe6-b06c-9cbd6d5c8b54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:31:06.153552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:31:06.153552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:31:06.153552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:31:06.153552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:31:06.153552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:31:06.153552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:31:06.153552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:31:06.153552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:31:06.153552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:31:06.153552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:31:06.153552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:31:06.153552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:31:06.153552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:31:06.153552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:31:06.153552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:31:06.154752 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:31:06.154752 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:31:06.154752 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:31:06.154752 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:31:06.154752 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:31:06.154752 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:31:06.154752 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:31:06.154752 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:31:06.154752 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:31:06.154752 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:31:06.154752 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:31:06.154752 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:31:06.154752 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:31:06.154752 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:31:06.154752 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:31:06.154752 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:31:06.154752 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:31:06.155808 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:31:06.155808 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:31:06.155808 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:31:06.155808 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 614/1210] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:31:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:31:06.160355 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438c723-c808-4067-af5e-d19f964ddbb1 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:06.256284 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:06.259112 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438c723-c808-4067-af5e-d19f964ddbb1 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:06.291812 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2ef99-476f-43c8-8167-290018c802f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:06.292406 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2ef99-476f-43c8-8167-290018c802f1 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:06.292680 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2ef99-476f-43c8-8167-290018c802f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:06.292946 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2ef99-476f-43c8-8167-290018c802f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:06.293567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e2ef99-476f-43c8-8167-290018c802f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:31:06.293914 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e2ef99-476f-43c8-8167-290018c802f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:06.295258 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e2ef99-476f-43c8-8167-290018c802f1 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:06.306300 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 597/1211] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:31:06.312050 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbd48d-e5af-4fe6-b06c-9cbd6d5c8b54 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:06.409201 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbd48d-e5af-4fe6-b06c-9cbd6d5c8b54 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:06.410715 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:06.441975 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fccca23-7529-42d1-9366-853a5519b5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:06.442600 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccca23-7529-42d1-9366-853a5519b5ab None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:06.442884 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccca23-7529-42d1-9366-853a5519b5ab None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:06.443158 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccca23-7529-42d1-9366-853a5519b5ab None admin] PATH_INFO: `/v3/users/placement` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:06.450028 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fccca23-7529-42d1-9366-853a5519b5ab None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:06.451456 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fccca23-7529-42d1-9366-853a5519b5ab None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:06.463057 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-5fccca23-7529-42d1-9366-853a5519b5ab None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 16 03:31:06.463057 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:31:06.463057 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:31:06.463057 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:31:06.463057 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:31:06.463057 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:31:06.463057 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:31:06.463057 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:31:06.463057 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:31:06.463057 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:31:06.463057 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:31:06.463057 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:31:06.463057 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 03:31:06.463057 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 03:31:06.463057 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 03:31:06.463057 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 03:31:06.464171 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:31:06.464171 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:31:06.464171 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 03:31:06.464171 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:31:06.464171 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 03:31:06.464171 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:31:06.464171 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:31:06.464171 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:31:06.464171 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:31:06.464171 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:31:06.464171 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:31:06.464171 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:31:06.464171 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:31:06.464171 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:31:06.464171 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:31:06.464171 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:31:06.464171 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:31:06.464171 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:31:06.465191 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:31:06.465191 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:31:06.465191 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 03:31:06.465191 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 03:31:06.465191 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 03:31:06.465191 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 03:31:06.465191 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 03:31:06.465191 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 03:31:06.465191 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 16 03:31:06.465191 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:31:06.465191 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 615/1212] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:31:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:31:06.469922 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2ef99-476f-43c8-8167-290018c802f1 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:06.564976 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2ef99-476f-43c8-8167-290018c802f1 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:06.597179 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33faf13-1b9e-4fa2-8783-d4cd06c766fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:06.597849 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33faf13-1b9e-4fa2-8783-d4cd06c766fa None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:06.598123 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33faf13-1b9e-4fa2-8783-d4cd06c766fa None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:06.598390 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33faf13-1b9e-4fa2-8783-d4cd06c766fa None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:06.599656 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33faf13-1b9e-4fa2-8783-d4cd06c766fa None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:31:06.599952 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33faf13-1b9e-4fa2-8783-d4cd06c766fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:06.601360 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33faf13-1b9e-4fa2-8783-d4cd06c766fa None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:06.617397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 598/1213] 10.222.0.33 () {56 vars in 1143 bytes} [Fri Sep 16 03:31:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:31:06.623476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fccca23-7529-42d1-9366-853a5519b5ab None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:06.726482 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fccca23-7529-42d1-9366-853a5519b5ab None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:06.760009 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881daa7-e29a-48db-9d3d-35c5bbb4ab02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:06.760665 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881daa7-e29a-48db-9d3d-35c5bbb4ab02 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:06.760952 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881daa7-e29a-48db-9d3d-35c5bbb4ab02 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:06.761227 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881daa7-e29a-48db-9d3d-35c5bbb4ab02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:06.790747 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:06.827961 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6881daa7-e29a-48db-9d3d-35c5bbb4ab02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:06.829436 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6881daa7-e29a-48db-9d3d-35c5bbb4ab02 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:06.923822 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 616/1214] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:31:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 03:31:06.930355 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33faf13-1b9e-4fa2-8783-d4cd06c766fa None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:06.948365 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:07.024637 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33faf13-1b9e-4fa2-8783-d4cd06c766fa None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:07.058370 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8e613-bbe3-4ce9-972a-98687ae9745b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:07.058992 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8e613-bbe3-4ce9-972a-98687ae9745b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:07.059271 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8e613-bbe3-4ce9-972a-98687ae9745b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:07.059544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8e613-bbe3-4ce9-972a-98687ae9745b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:07.069317 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e8e613-bbe3-4ce9-972a-98687ae9745b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:07.070829 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e8e613-bbe3-4ce9-972a-98687ae9745b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:07.090455 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-e8e8e613-bbe3-4ce9-972a-98687ae9745b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:31:07.090455 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:31:07.090455 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:31:07.090455 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:31:07.090455 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:31:07.090455 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:31:07.090455 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:31:07.090455 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:31:07.090455 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:31:07.090455 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:31:07.090455 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:31:07.090455 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:31:07.090455 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:31:07.090455 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:31:07.090455 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:31:07.090455 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:31:07.091572 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:31:07.091572 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:31:07.091572 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:31:07.091572 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:31:07.091572 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:31:07.091572 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:31:07.091572 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:31:07.091572 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:31:07.091572 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:31:07.091572 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:31:07.091572 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:31:07.091572 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:31:07.091572 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:31:07.091572 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:31:07.091572 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:31:07.091572 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:31:07.091572 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:31:07.092489 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:31:07.092489 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:31:07.092489 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:31:07.092489 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 599/1215] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:31:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:31:07.092867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881daa7-e29a-48db-9d3d-35c5bbb4ab02 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:07.152486 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:07.189338 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881daa7-e29a-48db-9d3d-35c5bbb4ab02 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:07.223038 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee8164-aa4a-4e93-a0be-b42ed2f782a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:07.223664 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee8164-aa4a-4e93-a0be-b42ed2f782a8 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:07.223942 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee8164-aa4a-4e93-a0be-b42ed2f782a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:07.224210 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee8164-aa4a-4e93-a0be-b42ed2f782a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:07.224833 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee8164-aa4a-4e93-a0be-b42ed2f782a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:31:07.225129 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee8164-aa4a-4e93-a0be-b42ed2f782a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:07.226509 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee8164-aa4a-4e93-a0be-b42ed2f782a8 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:07.237528 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 617/1216] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:31:07.243654 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8e613-bbe3-4ce9-972a-98687ae9745b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:07.310709 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:07.340822 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8e613-bbe3-4ce9-972a-98687ae9745b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:07.372542 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3cbc2-ddaa-41bd-9299-397f52396d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:07.373190 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3cbc2-ddaa-41bd-9299-397f52396d1e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:07.373476 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3cbc2-ddaa-41bd-9299-397f52396d1e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:07.373771 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3cbc2-ddaa-41bd-9299-397f52396d1e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:07.380585 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed3cbc2-ddaa-41bd-9299-397f52396d1e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:07.382043 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed3cbc2-ddaa-41bd-9299-397f52396d1e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:07.392875 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-3ed3cbc2-ddaa-41bd-9299-397f52396d1e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:31:07.392875 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:31:07.392875 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:31:07.392875 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:31:07.392875 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:31:07.392875 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:31:07.392875 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:31:07.392875 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:31:07.392875 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:31:07.392875 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:31:07.392875 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:31:07.392875 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:31:07.392875 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 03:31:07.392875 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 03:31:07.392875 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 03:31:07.394193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 03:31:07.394193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:31:07.394193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:31:07.394193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:31:07.394193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:31:07.394193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:31:07.394193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:31:07.394193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:31:07.394193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:31:07.394193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:31:07.394193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:31:07.394193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:31:07.394193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:31:07.394193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:31:07.394193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:31:07.394193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:31:07.394193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:31:07.395283 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 03:31:07.395283 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 03:31:07.395283 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 03:31:07.395283 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 03:31:07.395283 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 03:31:07.395283 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 03:31:07.395283 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:31:07.395283 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:31:07.395283 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 600/1217] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:31:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:31:07.400202 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee8164-aa4a-4e93-a0be-b42ed2f782a8 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:07.497997 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee8164-aa4a-4e93-a0be-b42ed2f782a8 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:07.520545 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:07.531715 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e482a7c7-6c13-47d0-a1b8-eb9a1502b41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:07.532315 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482a7c7-6c13-47d0-a1b8-eb9a1502b41a None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:07.532591 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482a7c7-6c13-47d0-a1b8-eb9a1502b41a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:07.532861 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482a7c7-6c13-47d0-a1b8-eb9a1502b41a None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:07.533537 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e482a7c7-6c13-47d0-a1b8-eb9a1502b41a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:31:07.533872 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e482a7c7-6c13-47d0-a1b8-eb9a1502b41a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:07.535290 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e482a7c7-6c13-47d0-a1b8-eb9a1502b41a None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:07.546686 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 618/1218] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 03:31:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:31:07.553570 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3cbc2-ddaa-41bd-9299-397f52396d1e None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:07.652718 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3cbc2-ddaa-41bd-9299-397f52396d1e None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:07.681933 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:07.697445 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299d235-654a-4cf1-af04-30bfe8a0eba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:07.697445 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299d235-654a-4cf1-af04-30bfe8a0eba6 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:07.697445 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299d235-654a-4cf1-af04-30bfe8a0eba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:07.697445 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299d235-654a-4cf1-af04-30bfe8a0eba6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:07.697854 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9299d235-654a-4cf1-af04-30bfe8a0eba6 None admin] RBAC: Adding query filter params (role.id=8a338e321ece4061b4b30d6231167b4e, scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2, user.id=c39fd09bea1a40babc5f629612c6702b) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:31:07.697854 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9299d235-654a-4cf1-af04-30bfe8a0eba6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:07.697854 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9299d235-654a-4cf1-af04-30bfe8a0eba6 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:07.697854 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 601/1219] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:31:07 2022] GET /identity/v3/role_assignments?user.id=c39fd09bea1a40babc5f629612c6702b&scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2&role.id=8a338e321ece4061b4b30d6231167b4e => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:31:09.822886 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fc9ce-1d12-454a-aa49-d8d31a1734ac None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:09.823383 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fc9ce-1d12-454a-aa49-d8d31a1734ac None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:09.823457 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fc9ce-1d12-454a-aa49-d8d31a1734ac None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:09.825025 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 619/1220] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:31:09.830404 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fbb69-bec5-4cea-bcbf-3936b0fd702a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:09.831844 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fbb69-bec5-4cea-bcbf-3936b0fd702a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:09.831844 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fbb69-bec5-4cea-bcbf-3936b0fd702a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:09.849504 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-444fbb69-bec5-4cea-bcbf-3936b0fd702a None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:31:09.850721 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-444fbb69-bec5-4cea-bcbf-3936b0fd702a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:31:09.914495 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 602/1221] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:31:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:31:10.179730 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4fc9ce-1d12-454a-aa49-d8d31a1734ac None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:10.278787 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4fc9ce-1d12-454a-aa49-d8d31a1734ac None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:10.311323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331ad59-f32f-49b8-9634-7abcef23f138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:10.311945 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331ad59-f32f-49b8-9634-7abcef23f138 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:10.312226 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331ad59-f32f-49b8-9634-7abcef23f138 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:10.312498 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331ad59-f32f-49b8-9634-7abcef23f138 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:10.323015 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5331ad59-f32f-49b8-9634-7abcef23f138 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:31:10.327800 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-5331ad59-f32f-49b8-9634-7abcef23f138 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 03:31:10.327800 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:31:10.327800 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:31:10.327800 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:31:10.327800 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:31:10.327800 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:31:10.327800 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:31:10.327800 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:31:10.327800 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:31:10.327800 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:31:10.327800 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:31:10.327800 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:31:10.327800 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:31:10.327800 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:31:10.327800 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:31:10.327800 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:31:10.328918 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:31:10.328918 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:31:10.328918 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:31:10.328918 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:31:10.328918 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:31:10.328918 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:31:10.328918 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:31:10.328918 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:31:10.328918 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:31:10.328918 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:31:10.328918 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:31:10.328918 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:31:10.328918 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:31:10.328918 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:31:10.328918 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:31:10.328918 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:31:10.330013 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:31:10.330013 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:31:10.330013 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:31:10.330013 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:31:10.330013 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:31:10.330013 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:31:10.330013 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:31:10.330013 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:31:10.330013 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:31:10.330013 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:31:10.330013 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 03:31:10.330013 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:31:10.330013 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 620/1222] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 03:31:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:31:10.335055 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444fbb69-bec5-4cea-bcbf-3936b0fd702a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:10.431684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444fbb69-bec5-4cea-bcbf-3936b0fd702a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:10.454198 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:10.464375 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5212e22-0e13-4866-b952-b1553552c0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:10.464964 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5212e22-0e13-4866-b952-b1553552c0cf None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:10.465258 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5212e22-0e13-4866-b952-b1553552c0cf None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:10.465510 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5212e22-0e13-4866-b952-b1553552c0cf None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:10.466191 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5212e22-0e13-4866-b952-b1553552c0cf None admin] RBAC: Adding query filter params (name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:31:10.466489 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5212e22-0e13-4866-b952-b1553552c0cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:10.467838 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5212e22-0e13-4866-b952-b1553552c0cf None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:10.475806 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 603/1223] 10.222.0.33 () {56 vars in 1103 bytes} [Fri Sep 16 03:31:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:31:10.481673 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331ad59-f32f-49b8-9634-7abcef23f138 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:10.525080 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:10.579397 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331ad59-f32f-49b8-9634-7abcef23f138 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:10.612806 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d2241-6115-4715-9fee-30694fd5c8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:10.613428 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d2241-6115-4715-9fee-30694fd5c8ae None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:10.613743 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d2241-6115-4715-9fee-30694fd5c8ae None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:10.614020 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d2241-6115-4715-9fee-30694fd5c8ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:10.624125 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d2241-6115-4715-9fee-30694fd5c8ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:10.630188 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d2241-6115-4715-9fee-30694fd5c8ae None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:10.639643 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-675d2241-6115-4715-9fee-30694fd5c8ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:31:10.639643 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:31:10.639643 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:31:10.639643 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:31:10.639643 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:31:10.639643 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:31:10.639643 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:31:10.639643 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:31:10.639643 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:31:10.639643 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:31:10.639643 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:31:10.639643 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:31:10.639643 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:31:10.639643 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:31:10.639643 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:31:10.639643 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:31:10.640795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:31:10.640795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:31:10.640795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:31:10.640795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:31:10.640795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:31:10.640795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:31:10.640795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:31:10.640795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:31:10.640795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:31:10.640795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:31:10.640795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:31:10.640795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:31:10.640795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:31:10.640795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:31:10.640795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:31:10.640795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:31:10.640795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:31:10.642172 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:31:10.642172 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:31:10.642172 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:31:10.642172 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 621/1224] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:31:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:31:10.646730 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5212e22-0e13-4866-b952-b1553552c0cf None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:10.748559 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5212e22-0e13-4866-b952-b1553552c0cf None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:10.781735 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a0c10-3768-41de-80f5-9a4d5294f573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:10.782339 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a0c10-3768-41de-80f5-9a4d5294f573 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:10.782619 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a0c10-3768-41de-80f5-9a4d5294f573 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:10.782894 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a0c10-3768-41de-80f5-9a4d5294f573 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:10.783526 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a0c10-3768-41de-80f5-9a4d5294f573 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:31:10.783827 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a0c10-3768-41de-80f5-9a4d5294f573 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:10.785182 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a0c10-3768-41de-80f5-9a4d5294f573 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:10.797197 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 604/1225] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:31:10.802930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d2241-6115-4715-9fee-30694fd5c8ae None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:10.893135 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:10.900528 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d2241-6115-4715-9fee-30694fd5c8ae None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:10.938480 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05f1ea-265c-4e5c-95e1-e34a2b239da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:10.939106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05f1ea-265c-4e5c-95e1-e34a2b239da3 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:10.939386 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05f1ea-265c-4e5c-95e1-e34a2b239da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:10.939656 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05f1ea-265c-4e5c-95e1-e34a2b239da3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:10.946454 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f05f1ea-265c-4e5c-95e1-e34a2b239da3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:10.947884 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f05f1ea-265c-4e5c-95e1-e34a2b239da3 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:10.959513 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-4f05f1ea-265c-4e5c-95e1-e34a2b239da3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 16 03:31:10.959513 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:31:10.959513 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:31:10.959513 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:31:10.959513 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:31:10.959513 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:31:10.959513 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:31:10.959513 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:31:10.959513 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:31:10.959513 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:31:10.959513 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:31:10.959513 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:31:10.959513 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 03:31:10.959513 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 03:31:10.959513 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 03:31:10.959513 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 03:31:10.960629 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:31:10.960629 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:31:10.960629 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 03:31:10.960629 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:31:10.960629 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 03:31:10.960629 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:31:10.960629 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:31:10.960629 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:31:10.960629 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:31:10.960629 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:31:10.960629 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:31:10.960629 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:31:10.960629 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:31:10.960629 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:31:10.960629 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:31:10.960629 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:31:10.960629 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:31:10.960629 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:31:10.962021 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:31:10.962021 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:31:10.962021 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 03:31:10.962021 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 03:31:10.962021 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 03:31:10.962021 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 03:31:10.962021 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 03:31:10.962021 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 03:31:10.962021 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 16 03:31:10.962021 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:31:10.962021 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 622/1226] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:31:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:31:10.966440 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a0c10-3768-41de-80f5-9a4d5294f573 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:11.012155 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:11.062060 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a0c10-3768-41de-80f5-9a4d5294f573 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:11.093736 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1a10c-1057-4a8e-ad9b-ec026f25e94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:11.094332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1a10c-1057-4a8e-ad9b-ec026f25e94e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:11.094609 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1a10c-1057-4a8e-ad9b-ec026f25e94e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:11.094879 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1a10c-1057-4a8e-ad9b-ec026f25e94e None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:11.095583 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca1a10c-1057-4a8e-ad9b-ec026f25e94e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:31:11.095884 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca1a10c-1057-4a8e-ad9b-ec026f25e94e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:11.097297 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca1a10c-1057-4a8e-ad9b-ec026f25e94e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:11.113883 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 605/1227] 10.222.0.33 () {56 vars in 1143 bytes} [Fri Sep 16 03:31:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:31:11.119637 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05f1ea-265c-4e5c-95e1-e34a2b239da3 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:11.216953 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05f1ea-265c-4e5c-95e1-e34a2b239da3 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:11.249243 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c657b-7ee1-49e4-9eab-38d99ed6157d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:11.258703 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c657b-7ee1-49e4-9eab-38d99ed6157d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:11.258703 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c657b-7ee1-49e4-9eab-38d99ed6157d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:11.258703 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c657b-7ee1-49e4-9eab-38d99ed6157d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:11.261282 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745c657b-7ee1-49e4-9eab-38d99ed6157d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:11.262762 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745c657b-7ee1-49e4-9eab-38d99ed6157d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:11.277393 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-745c657b-7ee1-49e4-9eab-38d99ed6157d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:31:11.277393 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:31:11.277393 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:31:11.277393 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:31:11.277393 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:31:11.277393 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:31:11.277393 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:31:11.277393 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:31:11.277393 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:31:11.277393 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:31:11.277393 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:31:11.277393 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:31:11.277393 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:31:11.277393 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:31:11.277393 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:31:11.277393 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:31:11.278825 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:31:11.278825 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:31:11.278825 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:31:11.278825 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:31:11.278825 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:31:11.278825 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:31:11.278825 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:31:11.278825 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:31:11.278825 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:31:11.278825 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:31:11.278825 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:31:11.278825 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:31:11.278825 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:31:11.278825 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:31:11.278825 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:31:11.278825 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:31:11.278825 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:31:11.279802 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:31:11.279802 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:31:11.279802 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:31:11.279802 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 623/1228] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:31:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:31:11.284407 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1a10c-1057-4a8e-ad9b-ec026f25e94e None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:11.397538 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1a10c-1057-4a8e-ad9b-ec026f25e94e None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:11.399817 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:11.429739 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2511673a-3f28-44d6-a594-6b1d32814037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:11.430342 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511673a-3f28-44d6-a594-6b1d32814037 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:11.430621 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511673a-3f28-44d6-a594-6b1d32814037 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:11.430893 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511673a-3f28-44d6-a594-6b1d32814037 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:11.431527 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2511673a-3f28-44d6-a594-6b1d32814037 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:31:11.431826 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2511673a-3f28-44d6-a594-6b1d32814037 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:11.433182 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2511673a-3f28-44d6-a594-6b1d32814037 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:11.444524 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 606/1229] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:31:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:31:11.450350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c657b-7ee1-49e4-9eab-38d99ed6157d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:11.460234 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:11.546042 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c657b-7ee1-49e4-9eab-38d99ed6157d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:11.579327 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967e1b9-3089-464d-b63d-8ed038b43e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:11.579937 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967e1b9-3089-464d-b63d-8ed038b43e03 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:11.580215 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967e1b9-3089-464d-b63d-8ed038b43e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:11.580486 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967e1b9-3089-464d-b63d-8ed038b43e03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:11.586903 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967e1b9-3089-464d-b63d-8ed038b43e03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:11.588329 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967e1b9-3089-464d-b63d-8ed038b43e03 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:11.599346 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-e967e1b9-3089-464d-b63d-8ed038b43e03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:31:11.599346 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:31:11.599346 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:31:11.599346 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:31:11.599346 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:31:11.599346 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:31:11.599346 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:31:11.599346 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:31:11.599346 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:31:11.599346 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:31:11.599346 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:31:11.599346 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:31:11.599346 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 03:31:11.599346 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 03:31:11.599346 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 03:31:11.600402 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 03:31:11.600402 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:31:11.600402 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:31:11.600402 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:31:11.600402 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:31:11.600402 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:31:11.600402 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:31:11.600402 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:31:11.600402 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:31:11.600402 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:31:11.600402 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:31:11.600402 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:31:11.600402 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:31:11.600402 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:31:11.600402 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:31:11.600402 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:31:11.600402 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:31:11.601325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 03:31:11.601325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 03:31:11.601325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 03:31:11.601325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 03:31:11.601325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 03:31:11.601325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 03:31:11.601325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:31:11.601325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:31:11.601325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 624/1230] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:31:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:31:11.606738 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2511673a-3f28-44d6-a594-6b1d32814037 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:11.702482 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2511673a-3f28-44d6-a594-6b1d32814037 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:11.734092 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8958b6b-83f0-4e0d-93cd-7935ff7fc1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:11.734688 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8958b6b-83f0-4e0d-93cd-7935ff7fc1d0 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:11.734963 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8958b6b-83f0-4e0d-93cd-7935ff7fc1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:11.735227 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8958b6b-83f0-4e0d-93cd-7935ff7fc1d0 None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:11.735897 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8958b6b-83f0-4e0d-93cd-7935ff7fc1d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:31:11.736195 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8958b6b-83f0-4e0d-93cd-7935ff7fc1d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:11.737673 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8958b6b-83f0-4e0d-93cd-7935ff7fc1d0 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:11.749553 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 607/1231] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 03:31:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:31:11.756216 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967e1b9-3089-464d-b63d-8ed038b43e03 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:11.820329 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:11.852460 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967e1b9-3089-464d-b63d-8ed038b43e03 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:11.885027 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb21c8-a89e-465b-8eb0-7ba5d97022f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:11.885817 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb21c8-a89e-465b-8eb0-7ba5d97022f8 None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:11.886013 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb21c8-a89e-465b-8eb0-7ba5d97022f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:11.886498 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb21c8-a89e-465b-8eb0-7ba5d97022f8 None admin] PATH_INFO: `/v3/projects/a0e46c2a2c62402dbf6d8461204b47d2/users/c39fd09bea1a40babc5f629612c6702b/roles/8a338e321ece4061b4b30d6231167b4e` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:11.901124 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb21c8-a89e-465b-8eb0-7ba5d97022f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=a0e46c2a2c62402dbf6d8461204b47d2, user_id=c39fd09bea1a40babc5f629612c6702b, role_id=8a338e321ece4061b4b30d6231167b4e)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:11.902580 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb21c8-a89e-465b-8eb0-7ba5d97022f8 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:12.024203 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 625/1232] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 03:31:11 2022] PUT /identity/v3/projects/a0e46c2a2c62402dbf6d8461204b47d2/users/c39fd09bea1a40babc5f629612c6702b/roles/8a338e321ece4061b4b30d6231167b4e => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:31:14.153252 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196ac04-3be0-4359-8a28-9e015e4d6080 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:14.153921 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196ac04-3be0-4359-8a28-9e015e4d6080 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:14.153921 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196ac04-3be0-4359-8a28-9e015e4d6080 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:14.155199 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 608/1233] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:31:14.160266 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4758b-9564-4b1d-8c95-dc27078d3f84 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:14.160680 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4758b-9564-4b1d-8c95-dc27078d3f84 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:14.161357 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4758b-9564-4b1d-8c95-dc27078d3f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:14.179872 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c8c4758b-9564-4b1d-8c95-dc27078d3f84 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:31:14.181036 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c8c4758b-9564-4b1d-8c95-dc27078d3f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:31:14.245818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 626/1234] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:31:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:31:14.512403 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b196ac04-3be0-4359-8a28-9e015e4d6080 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:14.537790 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:14.611227 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b196ac04-3be0-4359-8a28-9e015e4d6080 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:14.643929 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86822334-1341-434b-bc70-80f9f1f03dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:14.644556 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86822334-1341-434b-bc70-80f9f1f03dd5 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:14.644833 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86822334-1341-434b-bc70-80f9f1f03dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:14.645595 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86822334-1341-434b-bc70-80f9f1f03dd5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:14.655256 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86822334-1341-434b-bc70-80f9f1f03dd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:31:14.660024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-86822334-1341-434b-bc70-80f9f1f03dd5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 03:31:14.660024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:31:14.660024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:31:14.660024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:31:14.660024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:31:14.660024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:31:14.660024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:31:14.660024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:31:14.660024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:31:14.660024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:31:14.660024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:31:14.660024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:31:14.660024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:31:14.660024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:31:14.660024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:31:14.660024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:31:14.661781 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:31:14.661781 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:31:14.661781 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:31:14.661781 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:31:14.661781 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:31:14.661781 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:31:14.661781 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:31:14.661781 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:31:14.661781 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:31:14.661781 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:31:14.661781 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:31:14.661781 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:31:14.661781 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:31:14.661781 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:31:14.661781 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:31:14.661781 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:31:14.662645 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:31:14.662645 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:31:14.662645 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:31:14.662645 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:31:14.662645 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:31:14.662645 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:31:14.662645 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:31:14.662645 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:31:14.662645 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:31:14.662645 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:31:14.662645 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 03:31:14.662645 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:31:14.662645 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 609/1235] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 03:31:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:31:14.667840 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4758b-9564-4b1d-8c95-dc27078d3f84 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:14.713581 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:14.763003 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4758b-9564-4b1d-8c95-dc27078d3f84 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:14.795993 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b373a-a675-460a-8dd0-d200e218f3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:14.796593 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b373a-a675-460a-8dd0-d200e218f3b5 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:14.796874 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b373a-a675-460a-8dd0-d200e218f3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:14.797148 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b373a-a675-460a-8dd0-d200e218f3b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:14.797831 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b373a-a675-460a-8dd0-d200e218f3b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:31:14.798130 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b373a-a675-460a-8dd0-d200e218f3b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:14.799484 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b373a-a675-460a-8dd0-d200e218f3b5 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:14.807178 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 627/1236] 10.222.0.33 () {56 vars in 1103 bytes} [Fri Sep 16 03:31:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:31:14.813232 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86822334-1341-434b-bc70-80f9f1f03dd5 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:14.895828 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:14.910901 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86822334-1341-434b-bc70-80f9f1f03dd5 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:14.945358 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94983be8-2ea1-488d-91d3-2e11e5b79e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:14.946019 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94983be8-2ea1-488d-91d3-2e11e5b79e96 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:14.946301 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94983be8-2ea1-488d-91d3-2e11e5b79e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:14.946574 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94983be8-2ea1-488d-91d3-2e11e5b79e96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:14.956261 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94983be8-2ea1-488d-91d3-2e11e5b79e96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:14.958381 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94983be8-2ea1-488d-91d3-2e11e5b79e96 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:14.972369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-94983be8-2ea1-488d-91d3-2e11e5b79e96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:31:14.972369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:31:14.972369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:31:14.972369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:31:14.972369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:31:14.972369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:31:14.972369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:31:14.972369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:31:14.972369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:31:14.972369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:31:14.972369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:31:14.972369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:31:14.972369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:31:14.972369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:31:14.972369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:31:14.972369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:31:14.973487 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:31:14.973487 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:31:14.973487 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:31:14.973487 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:31:14.973487 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:31:14.973487 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:31:14.973487 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:31:14.973487 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:31:14.973487 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:31:14.973487 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:31:14.973487 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:31:14.973487 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:31:14.973487 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:31:14.973487 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:31:14.973487 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:31:14.973487 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:31:14.973487 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:31:14.974643 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:31:14.974643 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:31:14.974643 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:31:14.974643 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 610/1237] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:31:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:31:14.979396 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b373a-a675-460a-8dd0-d200e218f3b5 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:15.077101 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b373a-a675-460a-8dd0-d200e218f3b5 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:15.086614 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:15.110718 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40a6f6-3693-4dcd-9536-58443f558f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:15.111325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40a6f6-3693-4dcd-9536-58443f558f4d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:15.111610 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40a6f6-3693-4dcd-9536-58443f558f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:15.111900 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40a6f6-3693-4dcd-9536-58443f558f4d None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:15.112533 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e40a6f6-3693-4dcd-9536-58443f558f4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:31:15.112838 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e40a6f6-3693-4dcd-9536-58443f558f4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:15.114258 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e40a6f6-3693-4dcd-9536-58443f558f4d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:15.125467 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 628/1238] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:31:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:31:15.131958 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94983be8-2ea1-488d-91d3-2e11e5b79e96 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:15.229137 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94983be8-2ea1-488d-91d3-2e11e5b79e96 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:15.261758 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2ecc0-4713-4776-92a2-b6b731b7f198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:15.262375 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2ecc0-4713-4776-92a2-b6b731b7f198 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:15.262653 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2ecc0-4713-4776-92a2-b6b731b7f198 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:15.262923 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2ecc0-4713-4776-92a2-b6b731b7f198 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:15.265503 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:15.271168 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c2ecc0-4713-4776-92a2-b6b731b7f198 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:15.272595 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c2ecc0-4713-4776-92a2-b6b731b7f198 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:15.283296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-94c2ecc0-4713-4776-92a2-b6b731b7f198 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 16 03:31:15.283296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:31:15.283296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:31:15.283296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:31:15.283296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:31:15.283296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:31:15.283296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:31:15.283296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:31:15.283296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:31:15.283296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:31:15.283296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:31:15.283296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:31:15.283296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 03:31:15.283296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 03:31:15.283296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 03:31:15.283296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 03:31:15.284356 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:31:15.284356 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:31:15.284356 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 03:31:15.284356 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:31:15.284356 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 03:31:15.284356 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:31:15.284356 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:31:15.284356 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:31:15.284356 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:31:15.284356 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:31:15.284356 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:31:15.284356 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:31:15.284356 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:31:15.284356 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:31:15.284356 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:31:15.284356 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:31:15.284356 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:31:15.284356 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:31:15.285477 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:31:15.285477 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:31:15.285477 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 03:31:15.285477 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 03:31:15.285477 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 03:31:15.285477 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 03:31:15.285477 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 03:31:15.285477 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 03:31:15.285477 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 16 03:31:15.285477 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:31:15.285477 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 611/1239] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:31:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:31:15.290312 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40a6f6-3693-4dcd-9536-58443f558f4d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:15.387770 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40a6f6-3693-4dcd-9536-58443f558f4d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:15.420522 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a90223-c5cf-4cb9-8d1d-7a8e20a547da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:15.421120 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a90223-c5cf-4cb9-8d1d-7a8e20a547da None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:15.421404 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a90223-c5cf-4cb9-8d1d-7a8e20a547da None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:15.421707 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a90223-c5cf-4cb9-8d1d-7a8e20a547da None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:15.422419 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a90223-c5cf-4cb9-8d1d-7a8e20a547da None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:31:15.422722 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a90223-c5cf-4cb9-8d1d-7a8e20a547da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:15.424131 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a90223-c5cf-4cb9-8d1d-7a8e20a547da None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:15.441841 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 629/1240] 10.222.0.33 () {56 vars in 1143 bytes} [Fri Sep 16 03:31:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:31:15.448178 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2ecc0-4713-4776-92a2-b6b731b7f198 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:15.543042 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2ecc0-4713-4776-92a2-b6b731b7f198 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:15.575817 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aae65b-9c78-44db-a858-3ce504356c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:15.576405 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aae65b-9c78-44db-a858-3ce504356c06 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:15.576683 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aae65b-9c78-44db-a858-3ce504356c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:15.576950 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aae65b-9c78-44db-a858-3ce504356c06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:15.635013 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:15.641342 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aae65b-9c78-44db-a858-3ce504356c06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:15.642785 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aae65b-9c78-44db-a858-3ce504356c06 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:15.736238 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 612/1241] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:31:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 03:31:15.742761 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a90223-c5cf-4cb9-8d1d-7a8e20a547da None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:15.769892 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:15.837883 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a90223-c5cf-4cb9-8d1d-7a8e20a547da None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:15.871619 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1a767-ed02-473a-bc9e-9eeab2acbfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:15.872249 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1a767-ed02-473a-bc9e-9eeab2acbfd1 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:15.872527 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1a767-ed02-473a-bc9e-9eeab2acbfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:15.872795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1a767-ed02-473a-bc9e-9eeab2acbfd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:15.882697 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb1a767-ed02-473a-bc9e-9eeab2acbfd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:15.884120 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb1a767-ed02-473a-bc9e-9eeab2acbfd1 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:15.898452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-5fb1a767-ed02-473a-bc9e-9eeab2acbfd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:31:15.898452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:31:15.898452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:31:15.898452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:31:15.898452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:31:15.898452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:31:15.898452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:31:15.898452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:31:15.898452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:31:15.898452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:31:15.898452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:31:15.898452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:31:15.898452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:31:15.898452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:31:15.898452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:31:15.898452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:31:15.899546 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:31:15.899546 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:31:15.899546 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:31:15.899546 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:31:15.899546 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:31:15.899546 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:31:15.899546 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:31:15.899546 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:31:15.899546 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:31:15.899546 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:31:15.899546 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:31:15.899546 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:31:15.899546 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:31:15.899546 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:31:15.899546 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:31:15.899546 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:31:15.899546 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:31:15.900472 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:31:15.900472 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:31:15.900472 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:31:15.900472 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 630/1242] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:31:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:31:15.905269 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aae65b-9c78-44db-a858-3ce504356c06 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:15.996099 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:16.001657 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aae65b-9c78-44db-a858-3ce504356c06 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:16.034791 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf5d7b-1649-4b4b-9c1a-141003620ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:16.035394 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf5d7b-1649-4b4b-9c1a-141003620ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:16.035739 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf5d7b-1649-4b4b-9c1a-141003620ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:16.036525 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf5d7b-1649-4b4b-9c1a-141003620ec2 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:16.037162 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf5d7b-1649-4b4b-9c1a-141003620ec2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:31:16.037464 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf5d7b-1649-4b4b-9c1a-141003620ec2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:16.038860 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf5d7b-1649-4b4b-9c1a-141003620ec2 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:16.049666 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 613/1243] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:31:16.055371 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1a767-ed02-473a-bc9e-9eeab2acbfd1 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:16.131479 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:16.152448 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1a767-ed02-473a-bc9e-9eeab2acbfd1 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:16.183925 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0f845-9042-4160-9f27-9cf940f365d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:16.190241 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0f845-9042-4160-9f27-9cf940f365d1 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:16.190241 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0f845-9042-4160-9f27-9cf940f365d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:16.190241 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0f845-9042-4160-9f27-9cf940f365d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:16.191435 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db0f845-9042-4160-9f27-9cf940f365d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:16.192903 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db0f845-9042-4160-9f27-9cf940f365d1 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:16.203923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-3db0f845-9042-4160-9f27-9cf940f365d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:31:16.203923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:31:16.203923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:31:16.203923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:31:16.203923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:31:16.203923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:31:16.203923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:31:16.203923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:31:16.203923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:31:16.203923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:31:16.203923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:31:16.203923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:31:16.203923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 03:31:16.203923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 03:31:16.203923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 03:31:16.204968 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 03:31:16.204968 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:31:16.204968 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:31:16.204968 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:31:16.204968 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:31:16.204968 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:31:16.204968 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:31:16.204968 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:31:16.204968 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:31:16.204968 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:31:16.204968 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:31:16.204968 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:31:16.204968 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:31:16.204968 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:31:16.204968 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:31:16.204968 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:31:16.204968 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:31:16.205965 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 03:31:16.205965 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 03:31:16.205965 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 03:31:16.205965 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 03:31:16.205965 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 03:31:16.205965 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 03:31:16.205965 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:31:16.205965 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:31:16.205965 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 631/1244] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:31:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:31:16.211424 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf5d7b-1649-4b4b-9c1a-141003620ec2 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:16.307879 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf5d7b-1649-4b4b-9c1a-141003620ec2 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:16.340309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63298bf0-59a3-4952-a242-80a94497569c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:16.340908 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63298bf0-59a3-4952-a242-80a94497569c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:16.341188 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63298bf0-59a3-4952-a242-80a94497569c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:16.341460 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63298bf0-59a3-4952-a242-80a94497569c None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:16.342171 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63298bf0-59a3-4952-a242-80a94497569c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:31:16.342474 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63298bf0-59a3-4952-a242-80a94497569c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:16.343889 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63298bf0-59a3-4952-a242-80a94497569c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:16.356717 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 614/1245] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 03:31:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:31:16.363092 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0f845-9042-4160-9f27-9cf940f365d1 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:16.461585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0f845-9042-4160-9f27-9cf940f365d1 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:16.493398 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0686b-6588-4de3-a158-fc2b57333d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:16.494018 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0686b-6588-4de3-a158-fc2b57333d2b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:16.494296 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0686b-6588-4de3-a158-fc2b57333d2b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:16.494561 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0686b-6588-4de3-a158-fc2b57333d2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:16.495264 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b0686b-6588-4de3-a158-fc2b57333d2b None admin] RBAC: Adding query filter params (role.id=8a338e321ece4061b4b30d6231167b4e, scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2, user.id=c39fd09bea1a40babc5f629612c6702b) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:31:16.495566 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b0686b-6588-4de3-a158-fc2b57333d2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:16.496975 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b0686b-6588-4de3-a158-fc2b57333d2b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:16.502504 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 632/1246] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:31:16 2022] GET /identity/v3/role_assignments?user.id=c39fd09bea1a40babc5f629612c6702b&scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2&role.id=8a338e321ece4061b4b30d6231167b4e => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:31:18.707032 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0cc62b-0296-491b-aabb-c5be992df049 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:18.707536 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0cc62b-0296-491b-aabb-c5be992df049 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:18.708160 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0cc62b-0296-491b-aabb-c5be992df049 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:18.709547 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 615/1247] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:31:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:31:18.714851 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4197bf-3131-4b37-9700-682c1bb9c5bd None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:18.721103 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4197bf-3131-4b37-9700-682c1bb9c5bd None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:18.721103 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4197bf-3131-4b37-9700-682c1bb9c5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:18.721744 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:18.733698 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ec4197bf-3131-4b37-9700-682c1bb9c5bd None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:31:18.734897 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ec4197bf-3131-4b37-9700-682c1bb9c5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:31:18.798855 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 633/1248] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:31:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:31:19.065743 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0cc62b-0296-491b-aabb-c5be992df049 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:19.083808 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:19.163185 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0cc62b-0296-491b-aabb-c5be992df049 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:19.195695 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212ae51-a35c-4ae1-b15f-497065c6bc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:19.196309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212ae51-a35c-4ae1-b15f-497065c6bc1c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:19.196583 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212ae51-a35c-4ae1-b15f-497065c6bc1c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:19.196858 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212ae51-a35c-4ae1-b15f-497065c6bc1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:19.206557 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f212ae51-a35c-4ae1-b15f-497065c6bc1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:31:19.211462 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-f212ae51-a35c-4ae1-b15f-497065c6bc1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:31:19.211462 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:31:19.211462 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:31:19.211462 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:31:19.211462 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:31:19.211462 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:31:19.211462 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:31:19.211462 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:31:19.211462 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:31:19.211462 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:31:19.211462 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:31:19.211462 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:31:19.211462 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:31:19.211462 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:31:19.211462 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:31:19.211462 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:31:19.212744 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:31:19.212744 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:31:19.212744 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:31:19.212744 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:31:19.212744 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:31:19.212744 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:31:19.212744 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:31:19.212744 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:31:19.212744 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:31:19.212744 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:31:19.212744 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:31:19.212744 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:31:19.212744 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:31:19.212744 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:31:19.212744 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:31:19.212744 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:31:19.213706 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:31:19.213706 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:31:19.213706 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:31:19.213706 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:31:19.213706 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:31:19.213706 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:31:19.213706 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:31:19.213706 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:31:19.213706 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:31:19.213706 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:31:19.213706 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:31:19.213706 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:31:19.213706 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 616/1249] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 03:31:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:31:19.218668 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4197bf-3131-4b37-9700-682c1bb9c5bd None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:19.315240 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4197bf-3131-4b37-9700-682c1bb9c5bd None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:19.344853 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:19.349619 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669d1f0-63f2-4e03-aa87-f728ebe7fde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:19.354457 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669d1f0-63f2-4e03-aa87-f728ebe7fde1 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:19.354457 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669d1f0-63f2-4e03-aa87-f728ebe7fde1 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:19.354457 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669d1f0-63f2-4e03-aa87-f728ebe7fde1 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:19.354457 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8669d1f0-63f2-4e03-aa87-f728ebe7fde1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:31:19.354457 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8669d1f0-63f2-4e03-aa87-f728ebe7fde1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:19.354457 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8669d1f0-63f2-4e03-aa87-f728ebe7fde1 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:19.361069 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 634/1250] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:31:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:31:19.367621 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212ae51-a35c-4ae1-b15f-497065c6bc1c None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:19.444277 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:19.466529 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212ae51-a35c-4ae1-b15f-497065c6bc1c None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:19.499076 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343e7de-be24-418e-a901-d034e01801e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:19.499699 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343e7de-be24-418e-a901-d034e01801e7 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:19.499979 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343e7de-be24-418e-a901-d034e01801e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:19.500256 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343e7de-be24-418e-a901-d034e01801e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:19.510420 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8343e7de-be24-418e-a901-d034e01801e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:19.511853 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8343e7de-be24-418e-a901-d034e01801e7 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:19.525454 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-8343e7de-be24-418e-a901-d034e01801e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:31:19.525454 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:31:19.525454 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:31:19.525454 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:31:19.525454 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:31:19.525454 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:31:19.525454 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:31:19.525454 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:31:19.525454 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:31:19.525454 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:31:19.525454 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:31:19.525454 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:31:19.525454 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:31:19.525454 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:31:19.525454 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:31:19.525454 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:31:19.530888 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:31:19.530888 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:31:19.530888 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:31:19.530888 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:31:19.530888 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:31:19.530888 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:31:19.530888 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:31:19.530888 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:31:19.530888 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:31:19.530888 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:31:19.530888 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:31:19.530888 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:31:19.530888 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:31:19.530888 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:31:19.530888 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:31:19.530888 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:31:19.530888 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:31:19.532552 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:31:19.532552 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:31:19.532552 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:31:19.532552 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 617/1251] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:31:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 03:31:19.534145 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669d1f0-63f2-4e03-aa87-f728ebe7fde1 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:19.631842 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669d1f0-63f2-4e03-aa87-f728ebe7fde1 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:19.663820 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b62683-2893-4cc6-99c2-1382b1998427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:19.664417 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b62683-2893-4cc6-99c2-1382b1998427 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:19.664694 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b62683-2893-4cc6-99c2-1382b1998427 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:19.664964 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b62683-2893-4cc6-99c2-1382b1998427 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:19.665587 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b62683-2893-4cc6-99c2-1382b1998427 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:31:19.665919 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b62683-2893-4cc6-99c2-1382b1998427 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:19.667260 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b62683-2893-4cc6-99c2-1382b1998427 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:19.679101 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 635/1252] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:31:19.684954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343e7de-be24-418e-a901-d034e01801e7 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:19.783011 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343e7de-be24-418e-a901-d034e01801e7 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:19.808495 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:19.815816 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c485284-3c48-4dbb-9db0-6437a4b9ae1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:19.816440 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c485284-3c48-4dbb-9db0-6437a4b9ae1c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:19.816719 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c485284-3c48-4dbb-9db0-6437a4b9ae1c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:19.816991 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c485284-3c48-4dbb-9db0-6437a4b9ae1c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:19.824111 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c485284-3c48-4dbb-9db0-6437a4b9ae1c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:19.825563 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c485284-3c48-4dbb-9db0-6437a4b9ae1c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:19.837033 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-1c485284-3c48-4dbb-9db0-6437a4b9ae1c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 16 03:31:19.837033 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:31:19.837033 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:31:19.837033 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:31:19.837033 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:31:19.837033 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:31:19.837033 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:31:19.837033 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:31:19.837033 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:31:19.837033 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:31:19.837033 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:31:19.837033 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:31:19.837033 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 03:31:19.837033 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 03:31:19.837033 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 03:31:19.837033 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 03:31:19.838215 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:31:19.838215 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:31:19.838215 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 03:31:19.838215 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:31:19.838215 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 03:31:19.838215 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:31:19.838215 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:31:19.838215 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:31:19.838215 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:31:19.838215 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:31:19.838215 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:31:19.838215 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:31:19.838215 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:31:19.838215 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:31:19.838215 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:31:19.838215 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:31:19.838215 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:31:19.838215 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:31:19.839581 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:31:19.839581 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:31:19.839581 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 03:31:19.839581 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 03:31:19.839581 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 03:31:19.839581 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 03:31:19.839581 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 03:31:19.839581 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 03:31:19.839581 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 16 03:31:19.839581 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:31:19.839581 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 618/1253] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:31:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:31:19.844028 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b62683-2893-4cc6-99c2-1382b1998427 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:19.899034 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:19.941151 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b62683-2893-4cc6-99c2-1382b1998427 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:19.974866 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ec52d-4c39-4616-8979-bc16386b16eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:19.975464 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ec52d-4c39-4616-8979-bc16386b16eb None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:19.975742 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ec52d-4c39-4616-8979-bc16386b16eb None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:19.976010 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ec52d-4c39-4616-8979-bc16386b16eb None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:19.976745 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ec52d-4c39-4616-8979-bc16386b16eb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:31:19.977074 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ec52d-4c39-4616-8979-bc16386b16eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:19.978538 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ec52d-4c39-4616-8979-bc16386b16eb None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:20.000441 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 636/1254] 10.222.0.33 () {56 vars in 1143 bytes} [Fri Sep 16 03:31:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:31:20.006500 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c485284-3c48-4dbb-9db0-6437a4b9ae1c None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:20.106787 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c485284-3c48-4dbb-9db0-6437a4b9ae1c None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:20.139351 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe858c-5d52-4102-a527-85210745af8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:20.139951 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe858c-5d52-4102-a527-85210745af8f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:20.140232 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe858c-5d52-4102-a527-85210745af8f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:20.140506 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe858c-5d52-4102-a527-85210745af8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:20.194076 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:20.205300 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe858c-5d52-4102-a527-85210745af8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:20.206800 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe858c-5d52-4102-a527-85210745af8f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:20.299179 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 619/1255] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:31:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 03:31:20.305940 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ec52d-4c39-4616-8979-bc16386b16eb None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:20.404149 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ec52d-4c39-4616-8979-bc16386b16eb None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:20.416889 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:20.436658 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ea804-32d7-46e1-b617-6209b89c8c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:20.437346 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ea804-32d7-46e1-b617-6209b89c8c9c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:20.437626 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ea804-32d7-46e1-b617-6209b89c8c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:20.437925 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ea804-32d7-46e1-b617-6209b89c8c9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:20.448205 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ea804-32d7-46e1-b617-6209b89c8c9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:20.449612 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ea804-32d7-46e1-b617-6209b89c8c9c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:20.464212 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-d04ea804-32d7-46e1-b617-6209b89c8c9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:31:20.464212 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:31:20.464212 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:31:20.464212 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:31:20.464212 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:31:20.464212 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:31:20.464212 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:31:20.464212 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:31:20.464212 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:31:20.464212 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:31:20.464212 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:31:20.464212 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:31:20.464212 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:31:20.464212 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:31:20.464212 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:31:20.464212 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:31:20.466487 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:31:20.466487 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:31:20.466487 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:31:20.466487 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:31:20.466487 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:31:20.466487 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:31:20.466487 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:31:20.466487 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:31:20.466487 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:31:20.466487 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:31:20.466487 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:31:20.466487 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:31:20.466487 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:31:20.466487 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:31:20.466487 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:31:20.466487 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:31:20.466487 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:31:20.467572 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:31:20.467572 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:31:20.467572 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:31:20.467572 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 637/1256] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:31:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:31:20.470991 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe858c-5d52-4102-a527-85210745af8f None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:20.554943 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:20.566243 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe858c-5d52-4102-a527-85210745af8f None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:20.599323 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b17442-f613-4146-8379-7de56ccde0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:20.599956 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b17442-f613-4146-8379-7de56ccde0c0 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:20.600231 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b17442-f613-4146-8379-7de56ccde0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:20.600499 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b17442-f613-4146-8379-7de56ccde0c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:20.601123 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b17442-f613-4146-8379-7de56ccde0c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:31:20.601418 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b17442-f613-4146-8379-7de56ccde0c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:20.602804 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b17442-f613-4146-8379-7de56ccde0c0 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:20.613326 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 620/1257] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:31:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:31:20.619130 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ea804-32d7-46e1-b617-6209b89c8c9c None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:20.718936 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ea804-32d7-46e1-b617-6209b89c8c9c None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:20.751272 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a3248-794f-4b9e-a0f2-d7edf4e2d71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:20.751887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a3248-794f-4b9e-a0f2-d7edf4e2d71b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:20.752163 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a3248-794f-4b9e-a0f2-d7edf4e2d71b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:20.752432 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a3248-794f-4b9e-a0f2-d7edf4e2d71b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:20.758824 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a3248-794f-4b9e-a0f2-d7edf4e2d71b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:20.760294 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a3248-794f-4b9e-a0f2-d7edf4e2d71b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:20.772753 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-e96a3248-794f-4b9e-a0f2-d7edf4e2d71b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:31:20.772753 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:31:20.772753 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:31:20.772753 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:31:20.772753 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:31:20.772753 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:31:20.772753 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:31:20.772753 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:31:20.772753 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:31:20.772753 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:31:20.772753 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:31:20.772753 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:31:20.772753 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 03:31:20.772753 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 03:31:20.772753 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 03:31:20.773906 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 03:31:20.773906 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:31:20.773906 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:31:20.773906 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:31:20.773906 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:31:20.773906 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:31:20.773906 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:31:20.773906 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:31:20.773906 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:31:20.773906 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:31:20.773906 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:31:20.773906 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:31:20.773906 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:31:20.773906 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:31:20.773906 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:31:20.773906 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:31:20.773906 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:31:20.774975 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 03:31:20.774975 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 03:31:20.774975 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 03:31:20.774975 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 03:31:20.774975 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 03:31:20.774975 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 03:31:20.774975 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:31:20.774975 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:31:20.774975 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 638/1258] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:31:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:31:20.779860 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b17442-f613-4146-8379-7de56ccde0c0 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:20.876330 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b17442-f613-4146-8379-7de56ccde0c0 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:20.910141 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71ace7-24de-43b5-8aa4-5139070a70f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:20.910767 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71ace7-24de-43b5-8aa4-5139070a70f6 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:20.911047 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71ace7-24de-43b5-8aa4-5139070a70f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:20.911319 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71ace7-24de-43b5-8aa4-5139070a70f6 None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:20.912004 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c71ace7-24de-43b5-8aa4-5139070a70f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:31:20.912309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c71ace7-24de-43b5-8aa4-5139070a70f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:20.913743 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c71ace7-24de-43b5-8aa4-5139070a70f6 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:20.925513 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 621/1259] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 03:31:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:31:20.931773 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a3248-794f-4b9e-a0f2-d7edf4e2d71b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:20.958204 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:21.031796 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a3248-794f-4b9e-a0f2-d7edf4e2d71b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:21.063996 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271861e3-e705-4f78-85b2-bef06507fa44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:21.064590 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271861e3-e705-4f78-85b2-bef06507fa44 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:21.064867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271861e3-e705-4f78-85b2-bef06507fa44 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:21.065137 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271861e3-e705-4f78-85b2-bef06507fa44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:21.065870 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271861e3-e705-4f78-85b2-bef06507fa44 None admin] RBAC: Adding query filter params (role.id=4ffac54101e248479bcdc0e54890020f, scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2, user.id=c39fd09bea1a40babc5f629612c6702b) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:31:21.066173 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271861e3-e705-4f78-85b2-bef06507fa44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:21.068109 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271861e3-e705-4f78-85b2-bef06507fa44 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:21.073287 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 639/1260] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:31:20 2022] GET /identity/v3/role_assignments?user.id=c39fd09bea1a40babc5f629612c6702b&scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2&role.id=4ffac54101e248479bcdc0e54890020f => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:31:23.174649 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9b0ec-ac9e-42de-ba85-c81e27ec4e37 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:23.175203 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9b0ec-ac9e-42de-ba85-c81e27ec4e37 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:23.175203 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9b0ec-ac9e-42de-ba85-c81e27ec4e37 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:23.176575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 622/1261] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:31:23.181582 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2963d-d8b3-422b-b765-7d007850db01 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:23.182029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2963d-d8b3-422b-b765-7d007850db01 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:23.182167 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2963d-d8b3-422b-b765-7d007850db01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:23.200335 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e3c2963d-d8b3-422b-b765-7d007850db01 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:31:23.201517 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e3c2963d-d8b3-422b-b765-7d007850db01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:31:23.265309 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 640/1262] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:31:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 03:31:23.531573 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9b0ec-ac9e-42de-ba85-c81e27ec4e37 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:23.542191 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:23.627460 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9b0ec-ac9e-42de-ba85-c81e27ec4e37 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:23.659980 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c14a05-2712-462c-8a0f-4ddfa8fcf70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:23.660630 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c14a05-2712-462c-8a0f-4ddfa8fcf70e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:23.660906 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c14a05-2712-462c-8a0f-4ddfa8fcf70e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:23.661174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c14a05-2712-462c-8a0f-4ddfa8fcf70e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:23.671026 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c14a05-2712-462c-8a0f-4ddfa8fcf70e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:31:23.675750 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-58c14a05-2712-462c-8a0f-4ddfa8fcf70e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:31:23.675750 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:31:23.675750 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:31:23.675750 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:31:23.675750 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:31:23.675750 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:31:23.675750 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:31:23.675750 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:31:23.675750 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:31:23.675750 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:31:23.675750 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:31:23.675750 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:31:23.675750 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:31:23.675750 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:31:23.675750 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:31:23.675750 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:31:23.677410 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:31:23.677410 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:31:23.677410 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:31:23.677410 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:31:23.677410 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:31:23.677410 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:31:23.677410 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:31:23.677410 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:31:23.677410 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:31:23.677410 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:31:23.677410 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:31:23.677410 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:31:23.677410 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:31:23.677410 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:31:23.677410 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:31:23.677410 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:31:23.678354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:31:23.678354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:31:23.678354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:31:23.678354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:31:23.678354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:31:23.678354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:31:23.678354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:31:23.678354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:31:23.678354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:31:23.678354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:31:23.678354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:31:23.678354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:31:23.678354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 623/1263] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 03:31:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:31:23.683358 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2963d-d8b3-422b-b765-7d007850db01 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:23.702119 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:23.778781 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2963d-d8b3-422b-b765-7d007850db01 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:23.812212 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbd358-905b-4dcc-9569-a9b07f51154e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:23.812778 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbd358-905b-4dcc-9569-a9b07f51154e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:23.813285 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbd358-905b-4dcc-9569-a9b07f51154e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:23.813611 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbd358-905b-4dcc-9569-a9b07f51154e None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:23.814935 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cbd358-905b-4dcc-9569-a9b07f51154e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:31:23.815244 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cbd358-905b-4dcc-9569-a9b07f51154e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:23.817236 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cbd358-905b-4dcc-9569-a9b07f51154e None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:23.825247 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 641/1264] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:31:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:31:23.831185 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c14a05-2712-462c-8a0f-4ddfa8fcf70e None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:23.896921 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:23.929473 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c14a05-2712-462c-8a0f-4ddfa8fcf70e None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:23.961263 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da5352-0a29-424e-8fe0-3040d0476ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:23.961899 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da5352-0a29-424e-8fe0-3040d0476ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:23.962182 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da5352-0a29-424e-8fe0-3040d0476ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:23.962456 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da5352-0a29-424e-8fe0-3040d0476ca0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:23.971876 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da5352-0a29-424e-8fe0-3040d0476ca0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:23.982056 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da5352-0a29-424e-8fe0-3040d0476ca0 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:23.987789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-c5da5352-0a29-424e-8fe0-3040d0476ca0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:31:23.987789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:31:23.987789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:31:23.987789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:31:23.987789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:31:23.987789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:31:23.987789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:31:23.987789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:31:23.987789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:31:23.987789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:31:23.987789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:31:23.987789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:31:23.987789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:31:23.987789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:31:23.987789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:31:23.987789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:31:23.989567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:31:23.989567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:31:23.989567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:31:23.989567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:31:23.989567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:31:23.989567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:31:23.989567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:31:23.989567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:31:23.989567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:31:23.989567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:31:23.989567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:31:23.989567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:31:23.989567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:31:23.989567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:31:23.989567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:31:23.989567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:31:23.989567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:31:23.990531 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:31:23.990531 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:31:23.990531 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:31:23.990531 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 624/1265] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:31:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:31:23.995225 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbd358-905b-4dcc-9569-a9b07f51154e None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:24.076169 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:24.095094 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbd358-905b-4dcc-9569-a9b07f51154e None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:24.128170 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4611d23-6324-4ebd-8a0f-632cb9c5fd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:24.128775 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4611d23-6324-4ebd-8a0f-632cb9c5fd8d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:24.129085 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4611d23-6324-4ebd-8a0f-632cb9c5fd8d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:24.129361 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4611d23-6324-4ebd-8a0f-632cb9c5fd8d None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:24.130024 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4611d23-6324-4ebd-8a0f-632cb9c5fd8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:31:24.130326 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4611d23-6324-4ebd-8a0f-632cb9c5fd8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:24.131727 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4611d23-6324-4ebd-8a0f-632cb9c5fd8d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:24.142554 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 642/1266] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:31:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:31:24.148561 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da5352-0a29-424e-8fe0-3040d0476ca0 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:24.246140 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da5352-0a29-424e-8fe0-3040d0476ca0 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:24.264931 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:24.278965 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73446273-070a-4390-9914-4879cefebde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:24.280766 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73446273-070a-4390-9914-4879cefebde9 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:24.280766 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73446273-070a-4390-9914-4879cefebde9 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:24.280766 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73446273-070a-4390-9914-4879cefebde9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:24.288011 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73446273-070a-4390-9914-4879cefebde9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:24.289442 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73446273-070a-4390-9914-4879cefebde9 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:24.300208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-73446273-070a-4390-9914-4879cefebde9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 16 03:31:24.300208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:31:24.300208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:31:24.300208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:31:24.300208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:31:24.300208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:31:24.300208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:31:24.300208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:31:24.300208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:31:24.300208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:31:24.300208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:31:24.300208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:31:24.300208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 03:31:24.300208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 03:31:24.300208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 03:31:24.300208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 03:31:24.301253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:31:24.301253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:31:24.301253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 03:31:24.301253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:31:24.301253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 03:31:24.301253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:31:24.301253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:31:24.301253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:31:24.301253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:31:24.301253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:31:24.301253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:31:24.301253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:31:24.301253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:31:24.301253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:31:24.301253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:31:24.301253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:31:24.301253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:31:24.301253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:31:24.302523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:31:24.302523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:31:24.302523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 03:31:24.302523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 03:31:24.302523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 03:31:24.302523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 03:31:24.302523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 03:31:24.302523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 03:31:24.302523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 16 03:31:24.302523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:31:24.302523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 625/1267] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:31:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:31:24.307368 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4611d23-6324-4ebd-8a0f-632cb9c5fd8d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:24.408194 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4611d23-6324-4ebd-8a0f-632cb9c5fd8d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:24.442381 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f54c0-c6f6-4428-9930-265aa73a3f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:24.442989 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f54c0-c6f6-4428-9930-265aa73a3f73 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:24.443287 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f54c0-c6f6-4428-9930-265aa73a3f73 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:24.443546 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f54c0-c6f6-4428-9930-265aa73a3f73 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:24.444268 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f54c0-c6f6-4428-9930-265aa73a3f73 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:31:24.444572 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f54c0-c6f6-4428-9930-265aa73a3f73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:24.446053 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f54c0-c6f6-4428-9930-265aa73a3f73 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:24.456057 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:24.464583 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 643/1268] 10.222.0.33 () {56 vars in 1143 bytes} [Fri Sep 16 03:31:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:31:24.471303 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73446273-070a-4390-9914-4879cefebde9 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:24.568840 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73446273-070a-4390-9914-4879cefebde9 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:24.602180 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e73c92-d6f0-480a-84f6-2bcba511ee87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:24.602796 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e73c92-d6f0-480a-84f6-2bcba511ee87 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:24.603074 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e73c92-d6f0-480a-84f6-2bcba511ee87 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:24.603346 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e73c92-d6f0-480a-84f6-2bcba511ee87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:24.613744 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e73c92-d6f0-480a-84f6-2bcba511ee87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:24.617741 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e73c92-d6f0-480a-84f6-2bcba511ee87 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:24.629606 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-59e73c92-d6f0-480a-84f6-2bcba511ee87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:31:24.629606 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:31:24.629606 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:31:24.629606 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:31:24.629606 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:31:24.629606 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:31:24.629606 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:31:24.629606 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:31:24.629606 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:31:24.629606 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:31:24.629606 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:31:24.629606 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:31:24.629606 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:31:24.629606 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:31:24.629606 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:31:24.629606 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:31:24.630701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:31:24.630701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:31:24.630701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:31:24.630701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:31:24.630701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:31:24.630701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:31:24.630701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:31:24.630701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:31:24.630701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:31:24.630701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:31:24.630701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:31:24.630701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:31:24.630701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:31:24.630701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:31:24.630701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:31:24.630701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:31:24.630701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:31:24.631940 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:31:24.631940 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:31:24.631940 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:31:24.631940 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 626/1269] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:31:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:31:24.636457 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f54c0-c6f6-4428-9930-265aa73a3f73 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:24.735309 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f54c0-c6f6-4428-9930-265aa73a3f73 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:24.770434 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6aa92-5406-4a75-a8cb-86b428d15d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:24.771037 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6aa92-5406-4a75-a8cb-86b428d15d66 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:24.771316 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6aa92-5406-4a75-a8cb-86b428d15d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:24.771589 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6aa92-5406-4a75-a8cb-86b428d15d66 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:24.772222 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed6aa92-5406-4a75-a8cb-86b428d15d66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:31:24.772522 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed6aa92-5406-4a75-a8cb-86b428d15d66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:24.773902 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed6aa92-5406-4a75-a8cb-86b428d15d66 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:24.784732 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 644/1270] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:31:24.790598 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e73c92-d6f0-480a-84f6-2bcba511ee87 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:24.821686 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:24.890636 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e73c92-d6f0-480a-84f6-2bcba511ee87 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:24.924706 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848e1fb-d041-43fc-af04-8fc8324804b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:24.925324 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848e1fb-d041-43fc-af04-8fc8324804b4 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:24.925600 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848e1fb-d041-43fc-af04-8fc8324804b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:24.925926 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848e1fb-d041-43fc-af04-8fc8324804b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:24.932370 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8848e1fb-d041-43fc-af04-8fc8324804b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:24.933839 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8848e1fb-d041-43fc-af04-8fc8324804b4 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:24.945193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-8848e1fb-d041-43fc-af04-8fc8324804b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:31:24.945193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:31:24.945193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:31:24.945193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:31:24.945193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:31:24.945193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:31:24.945193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:31:24.945193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:31:24.945193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:31:24.945193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:31:24.945193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:31:24.945193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:31:24.945193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 03:31:24.945193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 03:31:24.945193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 03:31:24.947615 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 03:31:24.947615 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:31:24.947615 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:31:24.947615 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:31:24.947615 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:31:24.947615 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:31:24.947615 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:31:24.947615 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:31:24.947615 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:31:24.947615 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:31:24.947615 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:31:24.947615 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:31:24.947615 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:31:24.947615 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:31:24.947615 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:31:24.947615 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:31:24.947615 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:31:24.948750 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 03:31:24.948750 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 03:31:24.948750 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 03:31:24.948750 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 03:31:24.948750 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 03:31:24.948750 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 03:31:24.948750 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:31:24.948750 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:31:24.948750 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 627/1271] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:31:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:31:24.952178 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6aa92-5406-4a75-a8cb-86b428d15d66 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:25.008869 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:25.048630 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6aa92-5406-4a75-a8cb-86b428d15d66 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:25.080641 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d063e077-1490-475e-ab5c-26b9e45573cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:25.081187 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063e077-1490-475e-ab5c-26b9e45573cc None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:25.081496 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063e077-1490-475e-ab5c-26b9e45573cc None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:25.081799 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063e077-1490-475e-ab5c-26b9e45573cc None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:25.082988 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d063e077-1490-475e-ab5c-26b9e45573cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:31:25.083294 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d063e077-1490-475e-ab5c-26b9e45573cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:25.084694 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d063e077-1490-475e-ab5c-26b9e45573cc None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:25.096186 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 645/1272] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 03:31:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:31:25.102866 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848e1fb-d041-43fc-af04-8fc8324804b4 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:25.193309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:25.201730 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848e1fb-d041-43fc-af04-8fc8324804b4 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:25.234433 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b123b1-3507-49d0-b788-aaa51d666e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:25.235002 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b123b1-3507-49d0-b788-aaa51d666e48 None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:25.235282 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b123b1-3507-49d0-b788-aaa51d666e48 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:25.235557 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b123b1-3507-49d0-b788-aaa51d666e48 None admin] PATH_INFO: `/v3/projects/a0e46c2a2c62402dbf6d8461204b47d2/users/c39fd09bea1a40babc5f629612c6702b/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:25.237422 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b123b1-3507-49d0-b788-aaa51d666e48 None admin] RBAC: Authorizing `identity:create_grant(project_id=a0e46c2a2c62402dbf6d8461204b47d2, user_id=c39fd09bea1a40babc5f629612c6702b, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:25.238916 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b123b1-3507-49d0-b788-aaa51d666e48 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:25.360368 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 628/1273] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 03:31:25 2022] PUT /identity/v3/projects/a0e46c2a2c62402dbf6d8461204b47d2/users/c39fd09bea1a40babc5f629612c6702b/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:31:27.467574 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507662ae-cbe7-4671-83c8-03af5903873f None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:27.468187 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507662ae-cbe7-4671-83c8-03af5903873f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:27.468187 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507662ae-cbe7-4671-83c8-03af5903873f None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:27.469475 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 646/1274] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:31:27.474879 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f473703-1833-416d-8064-7fac386bb6c8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:27.480176 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f473703-1833-416d-8064-7fac386bb6c8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:27.480176 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f473703-1833-416d-8064-7fac386bb6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:27.493511 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7f473703-1833-416d-8064-7fac386bb6c8 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:31:27.494708 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7f473703-1833-416d-8064-7fac386bb6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:31:27.558536 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 629/1275] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:31:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:31:27.824960 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507662ae-cbe7-4671-83c8-03af5903873f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:27.923261 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507662ae-cbe7-4671-83c8-03af5903873f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:27.940605 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:27.956718 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4594b1-cb6d-495f-9874-fd03ee289f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:27.957341 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4594b1-cb6d-495f-9874-fd03ee289f03 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:27.957625 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4594b1-cb6d-495f-9874-fd03ee289f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:27.957932 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4594b1-cb6d-495f-9874-fd03ee289f03 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:27.967758 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4594b1-cb6d-495f-9874-fd03ee289f03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 03:31:27.973127 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-9b4594b1-cb6d-495f-9874-fd03ee289f03 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:31:27.973127 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:31:27.973127 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:31:27.973127 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:31:27.973127 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:31:27.973127 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:31:27.973127 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:31:27.973127 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:31:27.973127 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:31:27.973127 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:31:27.973127 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:31:27.973127 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:31:27.973127 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 03:31:27.973127 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 03:31:27.973127 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 03:31:27.973127 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 03:31:27.974100 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 03:31:27.974100 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 03:31:27.974100 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 03:31:27.974100 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 03:31:27.974100 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:31:27.974100 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:31:27.974100 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:31:27.974100 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:31:27.974100 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:31:27.974100 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:31:27.974100 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:31:27.974100 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:31:27.974100 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:31:27.974100 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:31:27.974100 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:31:27.974100 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:31:27.978507 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:31:27.978507 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:31:27.978507 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:31:27.978507 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:31:27.978507 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 03:31:27.978507 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 03:31:27.978507 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 03:31:27.978507 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 03:31:27.978507 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 03:31:27.978507 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 03:31:27.978507 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 03:31:27.978507 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:31:27.978507 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 647/1276] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 03:31:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:31:27.980627 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f473703-1833-416d-8064-7fac386bb6c8 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:28.057554 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:28.074541 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f473703-1833-416d-8064-7fac386bb6c8 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:28.106760 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf9920-0fab-4a0c-95db-521842961a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:28.107301 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf9920-0fab-4a0c-95db-521842961a7b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:28.107576 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf9920-0fab-4a0c-95db-521842961a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:28.107847 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf9920-0fab-4a0c-95db-521842961a7b None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:28.108581 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf9920-0fab-4a0c-95db-521842961a7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:31:28.108875 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf9920-0fab-4a0c-95db-521842961a7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:28.110269 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf9920-0fab-4a0c-95db-521842961a7b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:28.118833 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 630/1277] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 03:31:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:31:28.124757 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4594b1-cb6d-495f-9874-fd03ee289f03 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:28.222237 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4594b1-cb6d-495f-9874-fd03ee289f03 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:28.254646 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e9de6-13b5-449c-9541-8be92ddf8f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:28.255263 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e9de6-13b5-449c-9541-8be92ddf8f0c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:28.255539 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e9de6-13b5-449c-9541-8be92ddf8f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:28.255809 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e9de6-13b5-449c-9541-8be92ddf8f0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:28.265334 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e9de6-13b5-449c-9541-8be92ddf8f0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:28.266786 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e9de6-13b5-449c-9541-8be92ddf8f0c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:28.281476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-b06e9de6-13b5-449c-9541-8be92ddf8f0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:31:28.281476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:31:28.281476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:31:28.281476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:31:28.281476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:31:28.281476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:31:28.281476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:31:28.281476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:31:28.281476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:31:28.281476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:31:28.281476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:31:28.281476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:31:28.281476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:31:28.281476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:31:28.281476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:31:28.281476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:31:28.282632 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:31:28.282632 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:31:28.282632 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:31:28.282632 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:31:28.282632 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:31:28.282632 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:31:28.282632 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:31:28.282632 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:31:28.282632 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:31:28.282632 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:31:28.282632 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:31:28.282632 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:31:28.282632 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:31:28.282632 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:31:28.282632 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:31:28.282632 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:31:28.282632 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:31:28.283724 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:31:28.283724 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:31:28.283724 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:31:28.285862 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 648/1278] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:31:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:31:28.288857 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf9920-0fab-4a0c-95db-521842961a7b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:28.386634 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf9920-0fab-4a0c-95db-521842961a7b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:28.418576 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76689ab-9586-4a7e-b0f9-e589e84cbd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:28.419170 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76689ab-9586-4a7e-b0f9-e589e84cbd41 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:28.419445 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76689ab-9586-4a7e-b0f9-e589e84cbd41 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:28.419714 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76689ab-9586-4a7e-b0f9-e589e84cbd41 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:28.420337 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76689ab-9586-4a7e-b0f9-e589e84cbd41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:31:28.420634 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76689ab-9586-4a7e-b0f9-e589e84cbd41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:28.422015 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76689ab-9586-4a7e-b0f9-e589e84cbd41 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:28.433162 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 631/1279] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:31:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:31:28.438813 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e9de6-13b5-449c-9541-8be92ddf8f0c None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:28.469755 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:28.536683 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e9de6-13b5-449c-9541-8be92ddf8f0c None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:28.568176 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361004a1-e4cf-4308-8bd6-eb3dba8a163c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:28.568786 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361004a1-e4cf-4308-8bd6-eb3dba8a163c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:28.569063 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361004a1-e4cf-4308-8bd6-eb3dba8a163c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:28.569331 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361004a1-e4cf-4308-8bd6-eb3dba8a163c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:28.576346 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361004a1-e4cf-4308-8bd6-eb3dba8a163c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:28.577783 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361004a1-e4cf-4308-8bd6-eb3dba8a163c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:28.589521 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-361004a1-e4cf-4308-8bd6-eb3dba8a163c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 16 03:31:28.589521 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:31:28.589521 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:31:28.589521 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:31:28.589521 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:31:28.589521 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:31:28.589521 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:31:28.589521 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:31:28.589521 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:31:28.589521 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:31:28.589521 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:31:28.589521 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:31:28.589521 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 03:31:28.589521 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 03:31:28.589521 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 03:31:28.589521 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 03:31:28.601147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:31:28.601147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:31:28.601147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 03:31:28.601147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:31:28.601147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 03:31:28.601147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 03:31:28.601147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:31:28.601147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:31:28.601147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:31:28.601147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:31:28.601147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:31:28.601147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:31:28.601147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:31:28.601147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:31:28.601147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:31:28.601147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:31:28.601147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:31:28.601147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:31:28.602147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:31:28.602147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:31:28.602147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 03:31:28.602147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 03:31:28.602147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 03:31:28.602147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 03:31:28.602147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 03:31:28.602147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 03:31:28.602147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 16 03:31:28.602147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:31:28.602147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 649/1280] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:31:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:31:28.602766 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76689ab-9586-4a7e-b0f9-e589e84cbd41 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:28.602766 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:28.692243 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76689ab-9586-4a7e-b0f9-e589e84cbd41 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:28.724784 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ced23-e5f9-4987-913a-4c62c6aaa7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:28.725387 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ced23-e5f9-4987-913a-4c62c6aaa7cc None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:28.725690 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ced23-e5f9-4987-913a-4c62c6aaa7cc None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:28.725962 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ced23-e5f9-4987-913a-4c62c6aaa7cc None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:28.732610 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ced23-e5f9-4987-913a-4c62c6aaa7cc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:31:28.732610 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ced23-e5f9-4987-913a-4c62c6aaa7cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:28.732610 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ced23-e5f9-4987-913a-4c62c6aaa7cc None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:28.745276 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 632/1281] 10.222.0.33 () {56 vars in 1143 bytes} [Fri Sep 16 03:31:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:31:28.751336 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361004a1-e4cf-4308-8bd6-eb3dba8a163c None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:28.841713 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:28.851511 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361004a1-e4cf-4308-8bd6-eb3dba8a163c None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:28.885114 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac459dab-52fc-4d92-a695-43c0805c6774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:28.885741 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac459dab-52fc-4d92-a695-43c0805c6774 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:28.886024 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac459dab-52fc-4d92-a695-43c0805c6774 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:28.886294 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac459dab-52fc-4d92-a695-43c0805c6774 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:28.951722 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac459dab-52fc-4d92-a695-43c0805c6774 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:28.953115 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac459dab-52fc-4d92-a695-43c0805c6774 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:29.039369 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:29.049071 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 650/1282] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 03:31:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 03:31:29.054948 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ced23-e5f9-4987-913a-4c62c6aaa7cc None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:29.114850 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:29.152816 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ced23-e5f9-4987-913a-4c62c6aaa7cc None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:29.185251 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc23d0-ae7c-4655-8ab0-ef4bdb5b1664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:29.185903 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc23d0-ae7c-4655-8ab0-ef4bdb5b1664 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:29.186184 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc23d0-ae7c-4655-8ab0-ef4bdb5b1664 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:29.186456 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc23d0-ae7c-4655-8ab0-ef4bdb5b1664 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:29.196545 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becc23d0-ae7c-4655-8ab0-ef4bdb5b1664 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:29.198016 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becc23d0-ae7c-4655-8ab0-ef4bdb5b1664 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:29.212749 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-becc23d0-ae7c-4655-8ab0-ef4bdb5b1664 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:31:29.212749 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:31:29.212749 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:31:29.212749 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:31:29.212749 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:31:29.212749 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:31:29.212749 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:31:29.212749 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:31:29.212749 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:31:29.212749 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:31:29.212749 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:31:29.212749 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:31:29.212749 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 03:31:29.212749 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 03:31:29.212749 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 03:31:29.212749 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 03:31:29.213927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:31:29.213927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:31:29.213927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:31:29.213927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:31:29.213927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:31:29.213927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:31:29.213927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:31:29.213927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:31:29.213927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:31:29.213927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:31:29.213927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:31:29.213927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:31:29.213927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:31:29.213927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:31:29.213927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:31:29.213927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:31:29.213927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 03:31:29.215034 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 03:31:29.215034 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 03:31:29.215034 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:31:29.215034 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 633/1283] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:31:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:31:29.219626 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac459dab-52fc-4d92-a695-43c0805c6774 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:29.320082 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac459dab-52fc-4d92-a695-43c0805c6774 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:29.352741 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254083d5-7014-4175-9cd5-79e55d29ae64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:29.353375 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254083d5-7014-4175-9cd5-79e55d29ae64 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:29.353675 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254083d5-7014-4175-9cd5-79e55d29ae64 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:29.353950 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254083d5-7014-4175-9cd5-79e55d29ae64 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:29.354580 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254083d5-7014-4175-9cd5-79e55d29ae64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:31:29.354907 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254083d5-7014-4175-9cd5-79e55d29ae64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:29.356260 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254083d5-7014-4175-9cd5-79e55d29ae64 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:29.366947 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 651/1284] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 03:31:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:31:29.372670 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc23d0-ae7c-4655-8ab0-ef4bdb5b1664 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:29.469923 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc23d0-ae7c-4655-8ab0-ef4bdb5b1664 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:29.483704 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:29.503551 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62c63a-a7af-4bad-a02d-ed3ee9d70847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:29.504208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62c63a-a7af-4bad-a02d-ed3ee9d70847 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:29.504486 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62c63a-a7af-4bad-a02d-ed3ee9d70847 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:29.504766 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62c63a-a7af-4bad-a02d-ed3ee9d70847 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:29.511271 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b62c63a-a7af-4bad-a02d-ed3ee9d70847 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:29.512708 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b62c63a-a7af-4bad-a02d-ed3ee9d70847 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:29.524457 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-6b62c63a-a7af-4bad-a02d-ed3ee9d70847 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:31:29.524457 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:31:29.524457 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:31:29.524457 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:31:29.524457 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:31:29.524457 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:31:29.524457 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:31:29.524457 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:31:29.524457 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:31:29.524457 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:31:29.524457 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:31:29.524457 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:31:29.524457 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 03:31:29.524457 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 03:31:29.524457 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 03:31:29.525375 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 03:31:29.525375 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:31:29.525375 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:31:29.525375 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:31:29.525375 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:31:29.525375 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:31:29.525375 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:31:29.525375 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:31:29.525375 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Sep 16 03:31:29.525375 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:31:29.525375 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:31:29.525375 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:31:29.525375 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:31:29.525375 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:31:29.525375 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:31:29.525375 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:31:29.525375 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:31:29.526515 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 03:31:29.526515 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 03:31:29.526515 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 03:31:29.526515 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 03:31:29.526515 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 03:31:29.526515 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 03:31:29.526515 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 03:31:29.526515 dv-cinder-857993-1-smb devstack@keystone.service[81776]: ERROR keystone.server.flask.application Sep 16 03:31:29.526515 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 634/1285] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 03:31:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:31:29.531518 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254083d5-7014-4175-9cd5-79e55d29ae64 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:29.585107 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:29.634317 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254083d5-7014-4175-9cd5-79e55d29ae64 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:29.667916 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097a8c5-a954-4ca2-947c-ad2cbe51de3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:29.668517 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097a8c5-a954-4ca2-947c-ad2cbe51de3c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:29.668799 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097a8c5-a954-4ca2-947c-ad2cbe51de3c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:29.669074 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097a8c5-a954-4ca2-947c-ad2cbe51de3c None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:29.669791 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097a8c5-a954-4ca2-947c-ad2cbe51de3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:31:29.670096 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097a8c5-a954-4ca2-947c-ad2cbe51de3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:29.671522 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097a8c5-a954-4ca2-947c-ad2cbe51de3c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:29.683667 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 652/1286] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 03:31:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:31:29.689850 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62c63a-a7af-4bad-a02d-ed3ee9d70847 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:29.787159 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62c63a-a7af-4bad-a02d-ed3ee9d70847 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:29.818818 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79482a22-8501-4aae-9194-6ecbfd342dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:29.819438 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79482a22-8501-4aae-9194-6ecbfd342dcf None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:29.819715 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79482a22-8501-4aae-9194-6ecbfd342dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:29.819991 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79482a22-8501-4aae-9194-6ecbfd342dcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:29.820700 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79482a22-8501-4aae-9194-6ecbfd342dcf None admin] RBAC: Adding query filter params (role.id=4ffac54101e248479bcdc0e54890020f, scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2, user.id=c39fd09bea1a40babc5f629612c6702b) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:31:29.821004 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79482a22-8501-4aae-9194-6ecbfd342dcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:29.822448 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79482a22-8501-4aae-9194-6ecbfd342dcf None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:29.827942 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 635/1287] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 03:31:29 2022] GET /identity/v3/role_assignments?user.id=c39fd09bea1a40babc5f629612c6702b&scope.project.id=a0e46c2a2c62402dbf6d8461204b47d2&role.id=4ffac54101e248479bcdc0e54890020f => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:31:31.990618 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fadc079-2b02-419c-8e77-7b278a1cfda2 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:31.991161 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fadc079-2b02-419c-8e77-7b278a1cfda2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:31.991161 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fadc079-2b02-419c-8e77-7b278a1cfda2 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:31.992483 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 653/1288] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:31:31.997717 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240744e-4251-4c5a-aee2-e425ba8c3c84 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:31.998115 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240744e-4251-4c5a-aee2-e425ba8c3c84 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:31.998852 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240744e-4251-4c5a-aee2-e425ba8c3c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:32.015942 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7240744e-4251-4c5a-aee2-e425ba8c3c84 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:31:32.017090 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7240744e-4251-4c5a-aee2-e425ba8c3c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:31:32.046221 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:32.081057 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 636/1289] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:31:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:31:32.354527 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fadc079-2b02-419c-8e77-7b278a1cfda2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:32.454126 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fadc079-2b02-419c-8e77-7b278a1cfda2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:32.465084 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:32.487005 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c26aa-eda1-4d9f-bfb0-284c83df066e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:32.487623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c26aa-eda1-4d9f-bfb0-284c83df066e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:32.487902 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c26aa-eda1-4d9f-bfb0-284c83df066e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:32.488173 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c26aa-eda1-4d9f-bfb0-284c83df066e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:32.488746 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6c26aa-eda1-4d9f-bfb0-284c83df066e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:32.490136 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6c26aa-eda1-4d9f-bfb0-284c83df066e None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:32.498692 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-dd6c26aa-eda1-4d9f-bfb0-284c83df066e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 03:31:32.498692 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:31:32.498692 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 03:31:32.498692 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 03:31:32.498692 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 03:31:32.498692 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 03:31:32.498692 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 03:31:32.498692 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:31:32.498692 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 03:31:32.498692 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:31:32.498692 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 03:31:32.498692 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:31:32.498692 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:31:32.498692 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:31:32.498692 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:31:32.498692 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:31:32.498692 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:31:32.499858 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:31:32.499858 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:31:32.499858 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:31:32.499858 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:31:32.499858 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:31:32.499858 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:31:32.499858 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 03:31:32.499858 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 03:31:32.499858 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 03:31:32.499858 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 03:31:32.499858 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:31:32.499858 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:31:32.499858 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:31:32.499858 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:31:32.499858 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:31:32.499858 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:31:32.500887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:31:32.500887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:31:32.500887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:31:32.500887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:31:32.500887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:31:32.500887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:31:32.500887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:31:32.500887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:31:32.500887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:31:32.500887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:31:32.500887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 03:31:32.500887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:31:32.500887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 03:31:32.500887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:31:32.500887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 654/1290] 10.222.0.33 () {56 vars in 1117 bytes} [Fri Sep 16 03:31:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:31:32.506517 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240744e-4251-4c5a-aee2-e425ba8c3c84 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:32.605831 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240744e-4251-4c5a-aee2-e425ba8c3c84 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:32.638573 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822cd13-f2c7-4862-a6cb-97ce1c602b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:32.639180 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822cd13-f2c7-4862-a6cb-97ce1c602b1f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:32.639448 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822cd13-f2c7-4862-a6cb-97ce1c602b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:32.639719 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822cd13-f2c7-4862-a6cb-97ce1c602b1f None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:32.640338 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822cd13-f2c7-4862-a6cb-97ce1c602b1f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:31:32.640635 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822cd13-f2c7-4862-a6cb-97ce1c602b1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:32.642041 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822cd13-f2c7-4862-a6cb-97ce1c602b1f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:32.647044 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 637/1291] 10.222.0.33 () {56 vars in 1116 bytes} [Fri Sep 16 03:31:32 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:31:32.652940 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c26aa-eda1-4d9f-bfb0-284c83df066e None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:32.750019 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c26aa-eda1-4d9f-bfb0-284c83df066e None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:32.784689 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393c94f-a27a-405c-b8bc-944adc0344d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:32.785848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393c94f-a27a-405c-b8bc-944adc0344d9 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:32.786131 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393c94f-a27a-405c-b8bc-944adc0344d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:32.786524 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393c94f-a27a-405c-b8bc-944adc0344d9 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:32.787151 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393c94f-a27a-405c-b8bc-944adc0344d9 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:31:32.787490 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393c94f-a27a-405c-b8bc-944adc0344d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:32.788845 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393c94f-a27a-405c-b8bc-944adc0344d9 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:32.793146 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 655/1292] 10.222.0.33 () {56 vars in 1116 bytes} [Fri Sep 16 03:31:32 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:31:34.921450 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e6022-3613-4c54-bf46-7e1cc8c5e7e4 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:34.921996 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e6022-3613-4c54-bf46-7e1cc8c5e7e4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:34.922087 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e6022-3613-4c54-bf46-7e1cc8c5e7e4 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:34.923380 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 638/1293] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:31:34.929214 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df8205-92de-43c8-a220-79d9e6359213 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:34.929741 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df8205-92de-43c8-a220-79d9e6359213 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:34.929844 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df8205-92de-43c8-a220-79d9e6359213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:34.948370 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-31df8205-92de-43c8-a220-79d9e6359213 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:31:34.949551 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-31df8205-92de-43c8-a220-79d9e6359213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:31:34.978022 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:35.015452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 656/1294] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:31:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:31:35.282878 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e6022-3613-4c54-bf46-7e1cc8c5e7e4 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:35.314101 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:35.381003 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e6022-3613-4c54-bf46-7e1cc8c5e7e4 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:35.413602 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514ef09-7570-4cde-8270-580d5d3a474b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:35.414219 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514ef09-7570-4cde-8270-580d5d3a474b None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:35.414498 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514ef09-7570-4cde-8270-580d5d3a474b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:35.414766 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514ef09-7570-4cde-8270-580d5d3a474b None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:35.415400 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514ef09-7570-4cde-8270-580d5d3a474b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:35.416754 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514ef09-7570-4cde-8270-580d5d3a474b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:35.548822 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 639/1295] 10.222.0.33 () {60 vars in 1141 bytes} [Fri Sep 16 03:31:35 2022] POST /identity/v3/services => generated 246 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:31:37.681129 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0df228-ec69-4dd5-9f80-c6d6abdfa957 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:37.681749 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0df228-ec69-4dd5-9f80-c6d6abdfa957 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:37.681749 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0df228-ec69-4dd5-9f80-c6d6abdfa957 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:37.683040 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 657/1296] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:31:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:31:37.688183 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848a3e5-f40c-4b0a-a448-05d1c8337eef None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:37.688560 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848a3e5-f40c-4b0a-a448-05d1c8337eef None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:37.688842 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848a3e5-f40c-4b0a-a448-05d1c8337eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:37.707322 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1848a3e5-f40c-4b0a-a448-05d1c8337eef None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:31:37.710229 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1848a3e5-f40c-4b0a-a448-05d1c8337eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:31:37.781295 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 640/1297] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:31:37 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:31:38.046835 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0df228-ec69-4dd5-9f80-c6d6abdfa957 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:38.145190 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0df228-ec69-4dd5-9f80-c6d6abdfa957 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:38.177318 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a4847-dcec-4ac4-96c5-d31460a81dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:38.177958 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a4847-dcec-4ac4-96c5-d31460a81dea None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:38.178239 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a4847-dcec-4ac4-96c5-d31460a81dea None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:38.178513 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a4847-dcec-4ac4-96c5-d31460a81dea None admin] PATH_INFO: `/v3/services/placement` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:38.179088 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a4847-dcec-4ac4-96c5-d31460a81dea None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:38.180433 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a4847-dcec-4ac4-96c5-d31460a81dea None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:38.188930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-728a4847-dcec-4ac4-96c5-d31460a81dea None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 03:31:38.188930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:31:38.188930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 03:31:38.188930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 03:31:38.188930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 03:31:38.188930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 03:31:38.188930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 03:31:38.188930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:31:38.188930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 03:31:38.188930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:31:38.188930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 03:31:38.188930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:31:38.188930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:31:38.188930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:31:38.188930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:31:38.188930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:31:38.188930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:31:38.190569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:31:38.190569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:31:38.190569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:31:38.190569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:31:38.190569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:31:38.190569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:31:38.190569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 03:31:38.190569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 03:31:38.190569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 03:31:38.190569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 03:31:38.190569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:31:38.190569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:31:38.190569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:31:38.190569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:31:38.190569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:31:38.190569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:31:38.192896 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:31:38.192896 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:31:38.192896 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:31:38.192896 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:31:38.192896 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:31:38.192896 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:31:38.192896 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:31:38.192896 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:31:38.192896 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:31:38.192896 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:31:38.192896 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 03:31:38.192896 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:31:38.192896 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 03:31:38.192896 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:31:38.193913 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 658/1298] 10.222.0.33 () {56 vars in 1117 bytes} [Fri Sep 16 03:31:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:31:38.196483 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1848a3e5-f40c-4b0a-a448-05d1c8337eef None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:38.214755 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:38.291512 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1848a3e5-f40c-4b0a-a448-05d1c8337eef None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:38.324732 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61652fc-a893-4454-b8c5-fbf3038fb93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:38.325259 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61652fc-a893-4454-b8c5-fbf3038fb93e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:38.325535 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61652fc-a893-4454-b8c5-fbf3038fb93e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:38.325836 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61652fc-a893-4454-b8c5-fbf3038fb93e None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:38.326453 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61652fc-a893-4454-b8c5-fbf3038fb93e None admin] RBAC: Adding query filter params (name=placement) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:31:38.326749 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61652fc-a893-4454-b8c5-fbf3038fb93e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:38.328106 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61652fc-a893-4454-b8c5-fbf3038fb93e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:38.333646 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 641/1299] 10.222.0.33 () {56 vars in 1116 bytes} [Fri Sep 16 03:31:38 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:31:38.339791 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a4847-dcec-4ac4-96c5-d31460a81dea None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:38.369950 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:38.434677 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a4847-dcec-4ac4-96c5-d31460a81dea None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:38.467972 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0e7cd-682d-4782-abcf-220d2056c69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:38.468557 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0e7cd-682d-4782-abcf-220d2056c69a None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:38.468834 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0e7cd-682d-4782-abcf-220d2056c69a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:38.469101 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0e7cd-682d-4782-abcf-220d2056c69a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:38.469827 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0e7cd-682d-4782-abcf-220d2056c69a None admin] RBAC: Adding query filter params (interface=public, service_id=30049cb16f684f8e951ca4d2f945be3a, region_id=RegionOne) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:31:38.470128 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0e7cd-682d-4782-abcf-220d2056c69a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:38.471480 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0e7cd-682d-4782-abcf-220d2056c69a None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:38.476186 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 659/1300] 10.222.0.33 () {56 vars in 1251 bytes} [Fri Sep 16 03:31:38 2022] GET /identity/v3/endpoints?service_id=30049cb16f684f8e951ca4d2f945be3a&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:31:38.481873 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61652fc-a893-4454-b8c5-fbf3038fb93e None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:38.560936 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:38.579088 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61652fc-a893-4454-b8c5-fbf3038fb93e None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:38.611314 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca25bd-23bb-4de3-b08c-558fa1eb81a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:38.611911 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca25bd-23bb-4de3-b08c-558fa1eb81a9 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:38.612191 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca25bd-23bb-4de3-b08c-558fa1eb81a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:38.612465 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca25bd-23bb-4de3-b08c-558fa1eb81a9 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:38.613620 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca25bd-23bb-4de3-b08c-558fa1eb81a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:38.615009 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca25bd-23bb-4de3-b08c-558fa1eb81a9 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:38.622038 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 642/1301] 10.222.0.33 () {56 vars in 1087 bytes} [Fri Sep 16 03:31:38 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:31:40.744304 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11ebeb-7c55-4e99-a52d-8bd38332b407 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:40.744787 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11ebeb-7c55-4e99-a52d-8bd38332b407 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:40.744898 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11ebeb-7c55-4e99-a52d-8bd38332b407 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:40.746227 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 660/1302] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:31:40.751400 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876620ef-b3b7-4541-af29-4dd20e2004a6 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:40.751813 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876620ef-b3b7-4541-af29-4dd20e2004a6 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:40.751942 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876620ef-b3b7-4541-af29-4dd20e2004a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:40.770487 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-876620ef-b3b7-4541-af29-4dd20e2004a6 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:31:40.771648 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-876620ef-b3b7-4541-af29-4dd20e2004a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:31:40.835136 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 643/1303] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:31:40 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 03:31:41.106980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11ebeb-7c55-4e99-a52d-8bd38332b407 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:41.198979 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:41.207377 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11ebeb-7c55-4e99-a52d-8bd38332b407 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:41.240453 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9afb095-fa90-4cbd-8b30-c97b1878294a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:41.241117 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afb095-fa90-4cbd-8b30-c97b1878294a None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:41.241397 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afb095-fa90-4cbd-8b30-c97b1878294a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:41.241695 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afb095-fa90-4cbd-8b30-c97b1878294a None admin] PATH_INFO: `/v3/services/placement` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:41.242275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9afb095-fa90-4cbd-8b30-c97b1878294a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:41.243626 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9afb095-fa90-4cbd-8b30-c97b1878294a None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:41.253930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-f9afb095-fa90-4cbd-8b30-c97b1878294a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 03:31:41.253930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:31:41.253930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 03:31:41.253930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 03:31:41.253930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 03:31:41.253930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 03:31:41.253930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 03:31:41.253930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:31:41.253930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 03:31:41.253930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:31:41.253930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 03:31:41.253930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:31:41.253930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 03:31:41.253930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 03:31:41.253930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 03:31:41.253930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 03:31:41.253930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 03:31:41.256104 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 03:31:41.256104 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 03:31:41.256104 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 03:31:41.256104 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 03:31:41.256104 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 03:31:41.256104 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 03:31:41.256104 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 03:31:41.256104 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 03:31:41.256104 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 03:31:41.256104 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 03:31:41.256104 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 03:31:41.256104 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 03:31:41.256104 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 03:31:41.256104 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 03:31:41.256104 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 03:31:41.256104 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 03:31:41.256971 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 03:31:41.256971 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Sep 16 03:31:41.256971 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 03:31:41.256971 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Sep 16 03:31:41.256971 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 03:31:41.256971 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 03:31:41.256971 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 03:31:41.256971 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Sep 16 03:31:41.256971 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 03:31:41.256971 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Sep 16 03:31:41.256971 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 03:31:41.256971 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 03:31:41.256971 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 03:31:41.256971 dv-cinder-857993-1-smb devstack@keystone.service[81775]: ERROR keystone.server.flask.application Sep 16 03:31:41.256971 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 661/1304] 10.222.0.33 () {56 vars in 1117 bytes} [Fri Sep 16 03:31:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 03:31:41.261378 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876620ef-b3b7-4541-af29-4dd20e2004a6 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:41.342176 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:41.364103 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876620ef-b3b7-4541-af29-4dd20e2004a6 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:41.397918 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ca9b3-cf53-486f-aedf-3b928ddb389b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:41.398541 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ca9b3-cf53-486f-aedf-3b928ddb389b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:41.398823 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ca9b3-cf53-486f-aedf-3b928ddb389b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:41.399096 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ca9b3-cf53-486f-aedf-3b928ddb389b None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:41.399715 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ca9b3-cf53-486f-aedf-3b928ddb389b None admin] RBAC: Adding query filter params (name=placement) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:31:41.400018 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ca9b3-cf53-486f-aedf-3b928ddb389b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:41.401379 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ca9b3-cf53-486f-aedf-3b928ddb389b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:41.406440 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 644/1305] 10.222.0.33 () {56 vars in 1116 bytes} [Fri Sep 16 03:31:41 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:31:41.412405 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9afb095-fa90-4cbd-8b30-c97b1878294a None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:31:41.510126 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9afb095-fa90-4cbd-8b30-c97b1878294a None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:31:41.542828 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19924230-36bc-4830-b719-2db415109cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:31:41.543428 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19924230-36bc-4830-b719-2db415109cb1 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:31:41.543709 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19924230-36bc-4830-b719-2db415109cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:31:41.543981 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19924230-36bc-4830-b719-2db415109cb1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:31:41.544646 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19924230-36bc-4830-b719-2db415109cb1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:31:41.546044 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19924230-36bc-4830-b719-2db415109cb1 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:31:41.640432 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 662/1306] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:31:41 2022] POST /identity/v3/endpoints => generated 331 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:31:51.446263 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=30 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:31:51.635764 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:39:30.963853 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c8be7-424b-42ea-953c-f19daed4fcb1 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:39:30.964245 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c8be7-424b-42ea-953c-f19daed4fcb1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:39:30.964570 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c8be7-424b-42ea-953c-f19daed4fcb1 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:39:30.967393 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 645/1307] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:39:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:39:30.972803 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885a1d2-03a9-4f50-89b2-46f2b9b9f507 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:39:30.973250 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885a1d2-03a9-4f50-89b2-46f2b9b9f507 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:39:30.973401 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885a1d2-03a9-4f50-89b2-46f2b9b9f507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:39:31.126818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f885a1d2-03a9-4f50-89b2-46f2b9b9f507 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:39:31.133046 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f885a1d2-03a9-4f50-89b2-46f2b9b9f507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:39:31.270341 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 663/1308] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:39:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:39:31.565311 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a885fc-bbeb-4968-be7f-bb68168f5628 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:39:31.565615 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a885fc-bbeb-4968-be7f-bb68168f5628 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:39:31.566062 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a885fc-bbeb-4968-be7f-bb68168f5628 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:39:31.567696 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 646/1309] 10.222.0.33 () {54 vars in 965 bytes} [Fri Sep 16 03:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:39:31.574479 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f07b32-4327-42f2-9c19-31ad15c36743 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:39:31.574803 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f07b32-4327-42f2-9c19-31ad15c36743 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:39:31.575050 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f07b32-4327-42f2-9c19-31ad15c36743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:39:31.669554 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b8f07b32-4327-42f2-9c19-31ad15c36743 None None] MFA Rules not processed for user `ae04099495a24a04801563cf18dc5626`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:39:31.670809 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b8f07b32-4327-42f2-9c19-31ad15c36743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:39:31.696313 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:39:31.753839 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 664/1310] 10.222.0.33 () {58 vars in 1062 bytes} [Fri Sep 16 03:39:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:39:31.762889 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a885fc-bbeb-4968-be7f-bb68168f5628 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:39:31.764794 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-90a885fc-bbeb-4968-be7f-bb68168f5628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:39:31.881114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a885fc-bbeb-4968-be7f-bb68168f5628 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:39:31.959051 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c710820-8a21-4efb-9e1c-955576ce8a18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:39:31.959860 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c710820-8a21-4efb-9e1c-955576ce8a18 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:39:31.960250 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c710820-8a21-4efb-9e1c-955576ce8a18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:39:31.960631 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c710820-8a21-4efb-9e1c-955576ce8a18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:39:31.962438 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0c710820-8a21-4efb-9e1c-955576ce8a18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:39:32.018714 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:39:32.077094 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c710820-8a21-4efb-9e1c-955576ce8a18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:39:32.078825 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c710820-8a21-4efb-9e1c-955576ce8a18 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:39:32.098872 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 647/1311] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:39:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:39:34.553500 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e12585-1ded-405c-9057-141b20824bf8 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:39:34.554052 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e12585-1ded-405c-9057-141b20824bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:39:34.554052 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e12585-1ded-405c-9057-141b20824bf8 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:39:34.555367 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 665/1312] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:39:34.560625 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf39f1-8490-456e-b8a2-5e3a13d26512 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:39:34.561044 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf39f1-8490-456e-b8a2-5e3a13d26512 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:39:34.561172 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf39f1-8490-456e-b8a2-5e3a13d26512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:39:34.629264 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-9daf39f1-8490-456e-b8a2-5e3a13d26512 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:39:34.630509 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9daf39f1-8490-456e-b8a2-5e3a13d26512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:39:34.723728 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 648/1313] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:39:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:39:35.013862 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354c2ee-2607-4f22-89f3-48911d03c4db None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:39:35.014151 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354c2ee-2607-4f22-89f3-48911d03c4db None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:39:35.014427 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354c2ee-2607-4f22-89f3-48911d03c4db None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:39:35.015767 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 666/1314] 10.222.0.33 () {54 vars in 965 bytes} [Fri Sep 16 03:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:39:35.022208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1d22b-efe7-4cf4-94f2-c69d1ed58b35 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:39:35.022492 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1d22b-efe7-4cf4-94f2-c69d1ed58b35 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:39:35.022764 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1d22b-efe7-4cf4-94f2-c69d1ed58b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:39:35.035063 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:39:35.099599 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-74b1d22b-efe7-4cf4-94f2-c69d1ed58b35 None None] MFA Rules not processed for user `ae04099495a24a04801563cf18dc5626`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:39:35.100801 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-74b1d22b-efe7-4cf4-94f2-c69d1ed58b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:39:35.176627 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 649/1315] 10.222.0.33 () {58 vars in 1062 bytes} [Fri Sep 16 03:39:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:39:35.185825 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354c2ee-2607-4f22-89f3-48911d03c4db None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:39:35.187363 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e354c2ee-2607-4f22-89f3-48911d03c4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:39:35.292057 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354c2ee-2607-4f22-89f3-48911d03c4db None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:39:35.365059 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:39:35.367466 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8758b-7ace-4083-8948-a05400baee0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:39:35.368076 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8758b-7ace-4083-8948-a05400baee0f service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:39:35.368357 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8758b-7ace-4083-8948-a05400baee0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:39:35.368627 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8758b-7ace-4083-8948-a05400baee0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:39:35.370252 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-89e8758b-7ace-4083-8948-a05400baee0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:39:35.477550 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8758b-7ace-4083-8948-a05400baee0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:39:35.479024 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8758b-7ace-4083-8948-a05400baee0f service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:39:35.497211 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 667/1316] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:39:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:39:38.408253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c14dd-e069-4cd4-a000-1ac029acd4da None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:39:38.408801 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c14dd-e069-4cd4-a000-1ac029acd4da None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:39:38.408801 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c14dd-e069-4cd4-a000-1ac029acd4da None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:39:38.410162 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 650/1317] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:39:38.415995 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcae069-996a-47ce-b4c4-e85cb4140d2e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:39:38.416404 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcae069-996a-47ce-b4c4-e85cb4140d2e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:39:38.416554 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcae069-996a-47ce-b4c4-e85cb4140d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:39:38.481436 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-afcae069-996a-47ce-b4c4-e85cb4140d2e None None] MFA Rules not processed for user `8b1624609cc944cd86ca9c71ee9d61d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:39:38.482669 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-afcae069-996a-47ce-b4c4-e85cb4140d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:39:38.533004 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:39:38.577984 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 668/1318] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:39:38 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:39:38.865683 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c14dd-e069-4cd4-a000-1ac029acd4da None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:39:38.867230 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-471c14dd-e069-4cd4-a000-1ac029acd4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:39:38.970644 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c14dd-e069-4cd4-a000-1ac029acd4da None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:39:38.973417 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:39:39.041725 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ebad01-3890-4e6d-9d71-549376aa9d87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:39:39.042561 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ebad01-3890-4e6d-9d71-549376aa9d87 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:39:39.042840 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ebad01-3890-4e6d-9d71-549376aa9d87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:39:39.043106 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ebad01-3890-4e6d-9d71-549376aa9d87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:39:39.044691 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f7ebad01-3890-4e6d-9d71-549376aa9d87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:39:39.150165 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ebad01-3890-4e6d-9d71-549376aa9d87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:39:39.151515 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ebad01-3890-4e6d-9d71-549376aa9d87 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:39:39.169208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 651/1319] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:39:38 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:39:42.132843 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6ecbf-c30c-4593-9389-a79df91f8e57 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:39:42.133378 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6ecbf-c30c-4593-9389-a79df91f8e57 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:39:42.133378 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6ecbf-c30c-4593-9389-a79df91f8e57 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:39:42.134763 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 669/1320] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:39:42.140132 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badaa155-51b0-40c5-a5f0-29a157e10571 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:39:42.140570 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badaa155-51b0-40c5-a5f0-29a157e10571 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:39:42.140664 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badaa155-51b0-40c5-a5f0-29a157e10571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:39:42.181562 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:39:42.205796 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-badaa155-51b0-40c5-a5f0-29a157e10571 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:39:42.207505 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-badaa155-51b0-40c5-a5f0-29a157e10571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:39:42.303435 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 652/1321] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:39:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:39:42.586677 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb6ecbf-c30c-4593-9389-a79df91f8e57 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:39:42.588231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7eb6ecbf-c30c-4593-9389-a79df91f8e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:39:42.689378 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb6ecbf-c30c-4593-9389-a79df91f8e57 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:39:42.763256 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64308c61-cddd-4f90-9d04-6af21e6fcd56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:39:42.763860 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64308c61-cddd-4f90-9d04-6af21e6fcd56 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:39:42.764143 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64308c61-cddd-4f90-9d04-6af21e6fcd56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:39:42.764416 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64308c61-cddd-4f90-9d04-6af21e6fcd56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:39:42.766073 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-64308c61-cddd-4f90-9d04-6af21e6fcd56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:39:42.773264 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:39:42.872389 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64308c61-cddd-4f90-9d04-6af21e6fcd56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:39:42.873776 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64308c61-cddd-4f90-9d04-6af21e6fcd56 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:39:42.891846 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 670/1322] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:39:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:39:46.021898 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772d563-c36b-403b-b87b-adeb3a97c21a None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:39:46.022495 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772d563-c36b-403b-b87b-adeb3a97c21a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:39:46.022495 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772d563-c36b-403b-b87b-adeb3a97c21a None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:39:46.023798 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 653/1323] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:39:46.029489 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d54558-cf13-4d95-93a5-8403fe2d35da None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:39:46.029920 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d54558-cf13-4d95-93a5-8403fe2d35da None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:39:46.030149 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d54558-cf13-4d95-93a5-8403fe2d35da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:39:46.101747 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c9d54558-cf13-4d95-93a5-8403fe2d35da None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:39:46.102984 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c9d54558-cf13-4d95-93a5-8403fe2d35da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:39:46.161216 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:39:46.202604 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 671/1324] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:39:46.485036 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772d563-c36b-403b-b87b-adeb3a97c21a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:39:46.486698 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1772d563-c36b-403b-b87b-adeb3a97c21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:39:46.590621 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772d563-c36b-403b-b87b-adeb3a97c21a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:39:46.603579 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:39:46.664195 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb3900-7366-4448-bf48-dd0c797aee39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:39:46.664804 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb3900-7366-4448-bf48-dd0c797aee39 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:39:46.665086 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb3900-7366-4448-bf48-dd0c797aee39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:39:46.665364 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb3900-7366-4448-bf48-dd0c797aee39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:39:46.666990 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3deb3900-7366-4448-bf48-dd0c797aee39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:39:46.776557 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb3900-7366-4448-bf48-dd0c797aee39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:39:46.778046 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb3900-7366-4448-bf48-dd0c797aee39 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:39:46.796146 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 654/1325] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:39:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:39:49.021087 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1406a-22b0-4e73-94f7-9da94e14b1de None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:39:49.021605 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1406a-22b0-4e73-94f7-9da94e14b1de None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:39:49.021718 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1406a-22b0-4e73-94f7-9da94e14b1de None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:39:49.023264 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 672/1326] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:39:49.037740 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d489628-2c74-4b14-8a16-12e79988cd96 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:39:49.037740 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d489628-2c74-4b14-8a16-12e79988cd96 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:39:49.037740 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d489628-2c74-4b14-8a16-12e79988cd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:39:49.082522 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:39:49.100757 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3d489628-2c74-4b14-8a16-12e79988cd96 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:39:49.101990 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3d489628-2c74-4b14-8a16-12e79988cd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:39:49.199147 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 655/1327] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:39:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:39:49.478380 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1406a-22b0-4e73-94f7-9da94e14b1de None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:39:49.479992 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-54c1406a-22b0-4e73-94f7-9da94e14b1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:39:49.586215 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1406a-22b0-4e73-94f7-9da94e14b1de None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:39:49.662224 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d624b-a271-4b78-b44d-54f95989459e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:39:49.662839 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d624b-a271-4b78-b44d-54f95989459e service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:39:49.663119 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d624b-a271-4b78-b44d-54f95989459e service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:39:49.663389 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d624b-a271-4b78-b44d-54f95989459e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:39:49.664979 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-762d624b-a271-4b78-b44d-54f95989459e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:39:49.682287 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:39:49.774929 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d624b-a271-4b78-b44d-54f95989459e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:39:49.776361 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d624b-a271-4b78-b44d-54f95989459e service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:39:49.794450 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 673/1328] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:39:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:39:52.010780 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3b890-b0c0-4ad5-9ae8-412c6d02f50b None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:39:52.011316 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3b890-b0c0-4ad5-9ae8-412c6d02f50b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:39:52.011316 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3b890-b0c0-4ad5-9ae8-412c6d02f50b None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:39:52.012666 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 656/1329] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:39:52.018264 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634d533-5ccd-438a-b19b-dc258b6a80f4 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:39:52.018664 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634d533-5ccd-438a-b19b-dc258b6a80f4 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:39:52.018824 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634d533-5ccd-438a-b19b-dc258b6a80f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:39:52.085749 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d634d533-5ccd-438a-b19b-dc258b6a80f4 None None] MFA Rules not processed for user `8b1624609cc944cd86ca9c71ee9d61d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:39:52.086911 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d634d533-5ccd-438a-b19b-dc258b6a80f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:39:52.152735 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:39:52.185313 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 674/1330] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:39:52 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:39:52.472932 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3b890-b0c0-4ad5-9ae8-412c6d02f50b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:39:52.474605 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c1a3b890-b0c0-4ad5-9ae8-412c6d02f50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:39:52.589368 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3b890-b0c0-4ad5-9ae8-412c6d02f50b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:39:52.611010 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:39:52.669320 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8de0ca-bf13-4c60-b8c0-c37be919d938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:39:52.670072 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8de0ca-bf13-4c60-b8c0-c37be919d938 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:39:52.670346 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8de0ca-bf13-4c60-b8c0-c37be919d938 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:39:52.670613 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8de0ca-bf13-4c60-b8c0-c37be919d938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:39:52.672199 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1b8de0ca-bf13-4c60-b8c0-c37be919d938 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:39:52.787861 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8de0ca-bf13-4c60-b8c0-c37be919d938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:39:52.789274 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8de0ca-bf13-4c60-b8c0-c37be919d938 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:39:52.807602 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 657/1331] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:39:52 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:39:55.499833 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46e503-f7db-4b10-a9d2-1285025c5cfd None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:39:55.500401 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46e503-f7db-4b10-a9d2-1285025c5cfd None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:39:55.500401 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46e503-f7db-4b10-a9d2-1285025c5cfd None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:39:55.501903 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 675/1332] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:39:55.507506 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9abb9-9bd8-4a08-b14a-37d45edb5fcb None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:39:55.507953 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9abb9-9bd8-4a08-b14a-37d45edb5fcb None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:39:55.508058 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9abb9-9bd8-4a08-b14a-37d45edb5fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:39:55.569846 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:39:55.572432 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7ab9abb9-9bd8-4a08-b14a-37d45edb5fcb None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:39:55.573608 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7ab9abb9-9bd8-4a08-b14a-37d45edb5fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:39:55.667137 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 658/1333] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:39:55.944618 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46e503-f7db-4b10-a9d2-1285025c5cfd None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:39:55.946216 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3e46e503-f7db-4b10-a9d2-1285025c5cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:39:56.048064 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46e503-f7db-4b10-a9d2-1285025c5cfd None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:39:56.121021 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ffb23-9540-4b52-be74-85c2292d025f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:39:56.121614 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ffb23-9540-4b52-be74-85c2292d025f service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:39:56.121922 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ffb23-9540-4b52-be74-85c2292d025f service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:39:56.122191 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ffb23-9540-4b52-be74-85c2292d025f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:39:56.123765 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d11ffb23-9540-4b52-be74-85c2292d025f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:39:56.150509 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:39:56.231414 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ffb23-9540-4b52-be74-85c2292d025f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:39:56.232851 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ffb23-9540-4b52-be74-85c2292d025f service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:39:56.250907 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 676/1334] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:39:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:39:58.455232 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae8968-7462-47c2-b56b-9a85816c4b72 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:39:58.455754 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae8968-7462-47c2-b56b-9a85816c4b72 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:39:58.455754 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae8968-7462-47c2-b56b-9a85816c4b72 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:39:58.457110 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 659/1335] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:39:58.462481 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ac2b3-98c8-4eff-80d7-47cd7715a160 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:39:58.462950 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ac2b3-98c8-4eff-80d7-47cd7715a160 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:39:58.463044 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ac2b3-98c8-4eff-80d7-47cd7715a160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:39:58.529389 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-963ac2b3-98c8-4eff-80d7-47cd7715a160 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:39:58.530553 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-963ac2b3-98c8-4eff-80d7-47cd7715a160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:39:58.604001 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:39:58.626575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 677/1336] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:39:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:39:58.912523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae8968-7462-47c2-b56b-9a85816c4b72 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:39:58.914115 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-26ae8968-7462-47c2-b56b-9a85816c4b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:39:59.014629 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae8968-7462-47c2-b56b-9a85816c4b72 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:39:59.044205 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:39:59.088270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58068b5-915b-4e19-af75-ca5ce83c8c52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:39:59.088870 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58068b5-915b-4e19-af75-ca5ce83c8c52 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:39:59.089146 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58068b5-915b-4e19-af75-ca5ce83c8c52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:39:59.089417 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58068b5-915b-4e19-af75-ca5ce83c8c52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:39:59.091040 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b58068b5-915b-4e19-af75-ca5ce83c8c52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:39:59.195688 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58068b5-915b-4e19-af75-ca5ce83c8c52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:39:59.197046 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58068b5-915b-4e19-af75-ca5ce83c8c52 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:39:59.214942 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 660/1337] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:39:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:40:02.031540 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ea567-8dd7-4e2e-85f1-5c728fe433b3 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:02.032133 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ea567-8dd7-4e2e-85f1-5c728fe433b3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:02.032133 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ea567-8dd7-4e2e-85f1-5c728fe433b3 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:02.033493 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 678/1338] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 03:40:02.039285 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9a8bc-8ce4-4080-a721-f9194acd71fa None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:02.039725 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9a8bc-8ce4-4080-a721-f9194acd71fa None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:02.039827 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9a8bc-8ce4-4080-a721-f9194acd71fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:02.104024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ebb9a8bc-8ce4-4080-a721-f9194acd71fa None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:40:02.105225 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ebb9a8bc-8ce4-4080-a721-f9194acd71fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:02.113401 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:02.199208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 661/1339] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:40:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:40:02.483018 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ea567-8dd7-4e2e-85f1-5c728fe433b3 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:40:02.484601 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a60ea567-8dd7-4e2e-85f1-5c728fe433b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:02.587324 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ea567-8dd7-4e2e-85f1-5c728fe433b3 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:40:02.663760 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660aecae-d76e-42ff-b4b4-aa8b08964290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:40:02.664372 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660aecae-d76e-42ff-b4b4-aa8b08964290 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:02.667791 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660aecae-d76e-42ff-b4b4-aa8b08964290 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:02.667791 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660aecae-d76e-42ff-b4b4-aa8b08964290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:02.667791 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-660aecae-d76e-42ff-b4b4-aa8b08964290 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:02.703513 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:02.776589 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660aecae-d76e-42ff-b4b4-aa8b08964290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:40:02.778043 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660aecae-d76e-42ff-b4b4-aa8b08964290 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:40:02.797183 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 679/1340] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:40:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:40:07.134693 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4df72-9efc-4cc0-b94c-782b4940e355 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:07.135236 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4df72-9efc-4cc0-b94c-782b4940e355 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:07.135236 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4df72-9efc-4cc0-b94c-782b4940e355 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:07.136738 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 662/1341] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:40:07.142273 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7755d1-679f-4ee7-b178-b32af330eafc None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:07.142649 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7755d1-679f-4ee7-b178-b32af330eafc None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:07.142824 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7755d1-679f-4ee7-b178-b32af330eafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:07.215887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ef7755d1-679f-4ee7-b178-b32af330eafc None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:40:07.217111 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ef7755d1-679f-4ee7-b178-b32af330eafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:07.308789 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:07.320139 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 680/1342] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:40:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:40:07.603659 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b4df72-9efc-4cc0-b94c-782b4940e355 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:40:07.605203 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-13b4df72-9efc-4cc0-b94c-782b4940e355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:07.711955 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b4df72-9efc-4cc0-b94c-782b4940e355 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:40:07.751718 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:07.789548 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76865aa5-3567-43fe-b295-ddbd64389c31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:40:07.790190 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76865aa5-3567-43fe-b295-ddbd64389c31 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:07.790466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76865aa5-3567-43fe-b295-ddbd64389c31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:07.790735 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76865aa5-3567-43fe-b295-ddbd64389c31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:07.792338 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-76865aa5-3567-43fe-b295-ddbd64389c31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:07.902187 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76865aa5-3567-43fe-b295-ddbd64389c31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:40:07.903804 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76865aa5-3567-43fe-b295-ddbd64389c31 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:40:07.922686 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 663/1343] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:40:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:40:11.129546 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf94fb-c693-41a4-9fd5-9923cff85c86 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:11.130158 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf94fb-c693-41a4-9fd5-9923cff85c86 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:11.130158 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf94fb-c693-41a4-9fd5-9923cff85c86 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:11.131495 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 681/1344] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:40:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:40:11.137542 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd713338-14f3-4ae1-926c-a986db3448e7 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:11.140768 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd713338-14f3-4ae1-926c-a986db3448e7 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:11.140768 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd713338-14f3-4ae1-926c-a986db3448e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:11.205546 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-cd713338-14f3-4ae1-926c-a986db3448e7 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:40:11.206789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cd713338-14f3-4ae1-926c-a986db3448e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:11.224716 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:11.301805 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 664/1345] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:40:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:40:11.581059 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf94fb-c693-41a4-9fd5-9923cff85c86 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:40:11.582642 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cbdf94fb-c693-41a4-9fd5-9923cff85c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:11.692409 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf94fb-c693-41a4-9fd5-9923cff85c86 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:40:11.783842 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc99792-595e-4019-9956-3ed94eeb0973 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:40:11.785030 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc99792-595e-4019-9956-3ed94eeb0973 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:11.785305 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc99792-595e-4019-9956-3ed94eeb0973 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:11.785573 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc99792-595e-4019-9956-3ed94eeb0973 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:11.787598 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ccc99792-595e-4019-9956-3ed94eeb0973 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:11.852456 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:11.936789 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc99792-595e-4019-9956-3ed94eeb0973 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:40:11.938193 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc99792-595e-4019-9956-3ed94eeb0973 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:40:11.960428 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 682/1346] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:40:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:40:16.292522 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87098c2-0596-4207-9270-8828f99de712 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:16.292984 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87098c2-0596-4207-9270-8828f99de712 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:16.293297 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87098c2-0596-4207-9270-8828f99de712 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:16.294535 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 665/1347] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:40:16.299992 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a222350-db9f-408c-95cb-62e1c3bbaf6e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:16.300472 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a222350-db9f-408c-95cb-62e1c3bbaf6e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:16.300568 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a222350-db9f-408c-95cb-62e1c3bbaf6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:16.376230 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9a222350-db9f-408c-95cb-62e1c3bbaf6e None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:40:16.377457 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9a222350-db9f-408c-95cb-62e1c3bbaf6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:16.481807 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:16.489672 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 683/1348] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:40:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:40:16.766456 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87098c2-0596-4207-9270-8828f99de712 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:40:16.767999 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a87098c2-0596-4207-9270-8828f99de712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:16.869278 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87098c2-0596-4207-9270-8828f99de712 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:40:16.916623 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:16.941837 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9dd6dd-f891-4bd2-b4f8-71622ceffeb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:40:16.942440 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9dd6dd-f891-4bd2-b4f8-71622ceffeb1 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:16.942719 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9dd6dd-f891-4bd2-b4f8-71622ceffeb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:16.942991 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9dd6dd-f891-4bd2-b4f8-71622ceffeb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:16.944580 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6e9dd6dd-f891-4bd2-b4f8-71622ceffeb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:17.050855 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9dd6dd-f891-4bd2-b4f8-71622ceffeb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:40:17.052289 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9dd6dd-f891-4bd2-b4f8-71622ceffeb1 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:40:17.070263 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 666/1349] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:40:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:40:21.967880 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59437f-7f2b-41aa-9d05-28ee01f327de None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:21.968862 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59437f-7f2b-41aa-9d05-28ee01f327de None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:21.969350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59437f-7f2b-41aa-9d05-28ee01f327de None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:21.973159 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 684/1350] 10.222.0.33 () {54 vars in 921 bytes} [Fri Sep 16 03:40:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:40:21.978637 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de149d98-f48c-4532-8a52-f346a787b0bb None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:21.980209 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de149d98-f48c-4532-8a52-f346a787b0bb None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:21.980209 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de149d98-f48c-4532-8a52-f346a787b0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:22.086891 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-de149d98-f48c-4532-8a52-f346a787b0bb None None] MFA Rules not processed for user `c39fd09bea1a40babc5f629612c6702b`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:40:22.088086 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-de149d98-f48c-4532-8a52-f346a787b0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:22.116779 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:22.256519 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 667/1351] 10.222.0.33 () {58 vars in 1018 bytes} [Fri Sep 16 03:40:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:40:26.446040 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83233f-9c4d-4ad6-9c7e-26884c8c13fa None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:26.446982 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83233f-9c4d-4ad6-9c7e-26884c8c13fa None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:26.447341 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83233f-9c4d-4ad6-9c7e-26884c8c13fa None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:26.448941 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 685/1352] 10.222.0.33 () {54 vars in 921 bytes} [Fri Sep 16 03:40:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:40:26.454169 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e3fbe-5427-4467-b643-d25f11296991 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:26.454577 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e3fbe-5427-4467-b643-d25f11296991 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:26.454893 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e3fbe-5427-4467-b643-d25f11296991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:26.537472 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-644e3fbe-5427-4467-b643-d25f11296991 None None] MFA Rules not processed for user `c39fd09bea1a40babc5f629612c6702b`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:40:26.538715 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-644e3fbe-5427-4467-b643-d25f11296991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:26.614604 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:26.661107 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 668/1353] 10.222.0.33 () {58 vars in 1018 bytes} [Fri Sep 16 03:40:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:40:27.927742 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e95ea3-e256-44e3-a640-d1f6c5ab22ed None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:27.928246 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e95ea3-e256-44e3-a640-d1f6c5ab22ed None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:27.928246 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e95ea3-e256-44e3-a640-d1f6c5ab22ed None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:27.929548 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 686/1354] 10.222.0.33 () {54 vars in 921 bytes} [Fri Sep 16 03:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:40:27.934732 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b176c-a57c-4b10-a45f-535d43cb0162 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:27.935150 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b176c-a57c-4b10-a45f-535d43cb0162 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:27.935390 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b176c-a57c-4b10-a45f-535d43cb0162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:28.013736 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ed2b176c-a57c-4b10-a45f-535d43cb0162 None None] MFA Rules not processed for user `c39fd09bea1a40babc5f629612c6702b`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:40:28.014929 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ed2b176c-a57c-4b10-a45f-535d43cb0162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:28.120867 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 669/1355] 10.222.0.33 () {58 vars in 1018 bytes} [Fri Sep 16 03:40:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:40:31.681489 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887a323-d236-44ee-99b4-e2e7ada094c3 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:31.682058 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887a323-d236-44ee-99b4-e2e7ada094c3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:31.682207 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887a323-d236-44ee-99b4-e2e7ada094c3 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:31.683851 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 687/1356] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:40:31.690399 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0dea0-dd1b-4c6f-98be-d1e38b21d194 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:31.690910 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0dea0-dd1b-4c6f-98be-d1e38b21d194 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:31.690910 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0dea0-dd1b-4c6f-98be-d1e38b21d194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:31.730332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:31.763908 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-fdc0dea0-dd1b-4c6f-98be-d1e38b21d194 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:40:31.765123 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fdc0dea0-dd1b-4c6f-98be-d1e38b21d194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:31.867280 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 670/1357] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:40:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:40:32.169238 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75028c37-edd1-45e1-9b27-718bed572668 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:32.169527 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75028c37-edd1-45e1-9b27-718bed572668 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:32.169829 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75028c37-edd1-45e1-9b27-718bed572668 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:32.171131 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 688/1358] 10.222.0.33 () {54 vars in 962 bytes} [Fri Sep 16 03:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:40:32.181907 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f433f-1863-4408-9ac6-c8ee2efba305 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:32.182311 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f433f-1863-4408-9ac6-c8ee2efba305 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:32.182710 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f433f-1863-4408-9ac6-c8ee2efba305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:32.269114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e34f433f-1863-4408-9ac6-c8ee2efba305 None None] MFA Rules not processed for user `c09d1a4ac8b64921a6b05fcd567bb770`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:40:32.270448 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e34f433f-1863-4408-9ac6-c8ee2efba305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:32.324871 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:32.394652 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 671/1359] 10.222.0.33 () {58 vars in 1059 bytes} [Fri Sep 16 03:40:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:40:32.402609 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75028c37-edd1-45e1-9b27-718bed572668 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:40:32.404424 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-75028c37-edd1-45e1-9b27-718bed572668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:32.566654 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75028c37-edd1-45e1-9b27-718bed572668 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:40:32.663126 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:32.701506 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877205a1-d7ef-4174-b1c5-a4a776194ea7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:40:32.702308 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877205a1-d7ef-4174-b1c5-a4a776194ea7 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:32.702699 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877205a1-d7ef-4174-b1c5-a4a776194ea7 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:32.703050 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877205a1-d7ef-4174-b1c5-a4a776194ea7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:32.704982 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-877205a1-d7ef-4174-b1c5-a4a776194ea7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:32.805214 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877205a1-d7ef-4174-b1c5-a4a776194ea7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:40:32.806931 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877205a1-d7ef-4174-b1c5-a4a776194ea7 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:40:32.828442 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 689/1360] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:40:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:40:35.194065 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37876a-996f-42c1-86fb-ac829f2c679d None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:35.194619 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37876a-996f-42c1-86fb-ac829f2c679d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:35.194619 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37876a-996f-42c1-86fb-ac829f2c679d None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:35.195893 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 672/1361] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:40:35.201808 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87d77d-5d1b-4643-a8fd-14902c6070db None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:35.202209 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87d77d-5d1b-4643-a8fd-14902c6070db None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:35.202431 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87d77d-5d1b-4643-a8fd-14902c6070db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:35.277223 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2a87d77d-5d1b-4643-a8fd-14902c6070db None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:40:35.278521 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2a87d77d-5d1b-4643-a8fd-14902c6070db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:35.320664 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:35.383513 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 690/1362] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:40:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:40:35.678729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37876a-996f-42c1-86fb-ac829f2c679d None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:40:35.680266 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ba37876a-996f-42c1-86fb-ac829f2c679d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:35.858518 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37876a-996f-42c1-86fb-ac829f2c679d None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:40:35.869947 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:35.987159 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996a0b1-06fc-4e7b-82b6-832ad9d768bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:40:35.987738 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996a0b1-06fc-4e7b-82b6-832ad9d768bf service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:35.988545 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996a0b1-06fc-4e7b-82b6-832ad9d768bf service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:35.988545 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996a0b1-06fc-4e7b-82b6-832ad9d768bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:35.989884 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b996a0b1-06fc-4e7b-82b6-832ad9d768bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:36.084308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996a0b1-06fc-4e7b-82b6-832ad9d768bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:40:36.085979 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996a0b1-06fc-4e7b-82b6-832ad9d768bf service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:40:36.104561 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 673/1363] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:40:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:40:38.719223 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2449a6-7f2e-4407-951a-2c9790c0fa5a None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:38.720310 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2449a6-7f2e-4407-951a-2c9790c0fa5a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:38.720917 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2449a6-7f2e-4407-951a-2c9790c0fa5a None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:38.722744 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 691/1364] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:40:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:40:38.728182 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de7c7a-0fb2-4276-90e4-de79f5a2c9df None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:38.728982 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de7c7a-0fb2-4276-90e4-de79f5a2c9df None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:38.729458 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de7c7a-0fb2-4276-90e4-de79f5a2c9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:38.748574 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:38.814481 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-48de7c7a-0fb2-4276-90e4-de79f5a2c9df None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:40:38.815957 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-48de7c7a-0fb2-4276-90e4-de79f5a2c9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:38.927855 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 674/1365] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:40:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:40:39.227113 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae0ba1-4d13-47d4-bded-2ac5d5305f81 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:39.227674 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae0ba1-4d13-47d4-bded-2ac5d5305f81 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:39.228161 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae0ba1-4d13-47d4-bded-2ac5d5305f81 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:39.229764 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 692/1366] 10.222.0.33 () {54 vars in 962 bytes} [Fri Sep 16 03:40:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:40:39.235191 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee248b4-4ea1-4454-817e-da22bd4420e5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:39.240019 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee248b4-4ea1-4454-817e-da22bd4420e5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:39.240019 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee248b4-4ea1-4454-817e-da22bd4420e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:39.316457 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3ee248b4-4ea1-4454-817e-da22bd4420e5 None None] MFA Rules not processed for user `c09d1a4ac8b64921a6b05fcd567bb770`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:40:39.317695 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3ee248b4-4ea1-4454-817e-da22bd4420e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:39.355438 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:39.442229 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 675/1367] 10.222.0.33 () {58 vars in 1059 bytes} [Fri Sep 16 03:40:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:40:39.450883 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae0ba1-4d13-47d4-bded-2ac5d5305f81 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:40:39.452421 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bcae0ba1-4d13-47d4-bded-2ac5d5305f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:39.610967 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae0ba1-4d13-47d4-bded-2ac5d5305f81 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:40:39.633619 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:39.745901 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278dd063-5170-4c5c-9ba7-e60c0c238dd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:40:39.746770 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278dd063-5170-4c5c-9ba7-e60c0c238dd4 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:39.746968 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278dd063-5170-4c5c-9ba7-e60c0c238dd4 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:39.747248 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278dd063-5170-4c5c-9ba7-e60c0c238dd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:39.748864 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-278dd063-5170-4c5c-9ba7-e60c0c238dd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:39.815867 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7064fc-e6f3-4e7c-9556-9e1ce83d1ba3 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:39.816413 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7064fc-e6f3-4e7c-9556-9e1ce83d1ba3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:39.816413 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7064fc-e6f3-4e7c-9556-9e1ce83d1ba3 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:39.818146 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 676/1368] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:40:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 03:40:39.822888 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4434cd1-e9a6-443d-a9a6-d11957311cf2 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:39.823169 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4434cd1-e9a6-443d-a9a6-d11957311cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:39.823429 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4434cd1-e9a6-443d-a9a6-d11957311cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:39.848431 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278dd063-5170-4c5c-9ba7-e60c0c238dd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:40:39.850495 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278dd063-5170-4c5c-9ba7-e60c0c238dd4 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:40:39.871645 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 693/1369] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:40:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:40:39.893905 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c4434cd1-e9a6-443d-a9a6-d11957311cf2 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:40:39.895139 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c4434cd1-e9a6-443d-a9a6-d11957311cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:39.994196 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:40.002791 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 677/1370] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:40:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:40:40.333105 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a363b6e-525b-41ef-bba9-cd4e956cfc0d None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:40.333395 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a363b6e-525b-41ef-bba9-cd4e956cfc0d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:40.333701 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a363b6e-525b-41ef-bba9-cd4e956cfc0d None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:40.335397 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 694/1371] 10.222.0.33 () {54 vars in 964 bytes} [Fri Sep 16 03:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:40:40.340232 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d568b-bfa1-49fc-9891-bf406897d639 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:40.340637 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d568b-bfa1-49fc-9891-bf406897d639 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:40.341032 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d568b-bfa1-49fc-9891-bf406897d639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:40.422016 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d33d568b-bfa1-49fc-9891-bf406897d639 None None] MFA Rules not processed for user `d193a353763e43d0b5e8b49702f09faa`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:40:40.423332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d33d568b-bfa1-49fc-9891-bf406897d639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:40.513126 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 678/1372] 10.222.0.33 () {58 vars in 1061 bytes} [Fri Sep 16 03:40:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:40:40.521610 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a363b6e-525b-41ef-bba9-cd4e956cfc0d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:40:40.523336 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3a363b6e-525b-41ef-bba9-cd4e956cfc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:40.554239 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:40.633461 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a363b6e-525b-41ef-bba9-cd4e956cfc0d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:40:40.719211 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b987b7a8-48ee-4c7f-94ce-5b067b498d18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:40:40.719931 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987b7a8-48ee-4c7f-94ce-5b067b498d18 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:40.720254 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987b7a8-48ee-4c7f-94ce-5b067b498d18 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:40.720871 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987b7a8-48ee-4c7f-94ce-5b067b498d18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:40.722509 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b987b7a8-48ee-4c7f-94ce-5b067b498d18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:40.806045 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:40.846979 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b987b7a8-48ee-4c7f-94ce-5b067b498d18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:40:40.848457 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b987b7a8-48ee-4c7f-94ce-5b067b498d18 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:40:40.882130 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 695/1373] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:40:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:40:42.302103 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd26ea0-8ab6-4a8c-8762-e8fdcdd5a09c None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:42.302532 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd26ea0-8ab6-4a8c-8762-e8fdcdd5a09c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:42.302757 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd26ea0-8ab6-4a8c-8762-e8fdcdd5a09c None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:42.304002 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 679/1374] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:40:42.309550 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b5131-f0e9-45d0-801b-e6c882ba2b30 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:42.310031 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b5131-f0e9-45d0-801b-e6c882ba2b30 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:42.310151 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b5131-f0e9-45d0-801b-e6c882ba2b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:42.380082 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1a8b5131-f0e9-45d0-801b-e6c882ba2b30 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:40:42.381346 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1a8b5131-f0e9-45d0-801b-e6c882ba2b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:42.479966 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 696/1375] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:40:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:40:42.771349 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd26ea0-8ab6-4a8c-8762-e8fdcdd5a09c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:40:42.772878 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6bd26ea0-8ab6-4a8c-8762-e8fdcdd5a09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:42.860623 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:42.928308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd26ea0-8ab6-4a8c-8762-e8fdcdd5a09c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:40:43.046890 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03d8b2-df55-41cb-9dbb-785402b91c1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:40:43.047497 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03d8b2-df55-41cb-9dbb-785402b91c1d service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:43.047777 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03d8b2-df55-41cb-9dbb-785402b91c1d service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:43.048041 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03d8b2-df55-41cb-9dbb-785402b91c1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:43.050266 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ca03d8b2-df55-41cb-9dbb-785402b91c1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:43.099846 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:43.141916 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca03d8b2-df55-41cb-9dbb-785402b91c1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:40:43.143453 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca03d8b2-df55-41cb-9dbb-785402b91c1d service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:40:43.162450 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 680/1376] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:40:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:40:45.563741 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bbd95b-d34e-4308-88c4-83c08997bc22 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:45.564297 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bbd95b-d34e-4308-88c4-83c08997bc22 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:45.564297 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bbd95b-d34e-4308-88c4-83c08997bc22 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:45.565844 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 697/1377] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:40:45.571005 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550bf9dc-8ab3-478c-8f6a-7590acefc089 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:45.571428 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550bf9dc-8ab3-478c-8f6a-7590acefc089 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:45.571582 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550bf9dc-8ab3-478c-8f6a-7590acefc089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:45.643985 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-550bf9dc-8ab3-478c-8f6a-7590acefc089 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:40:45.645548 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-550bf9dc-8ab3-478c-8f6a-7590acefc089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:45.753054 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 681/1378] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:40:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:40:46.045243 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bbd95b-d34e-4308-88c4-83c08997bc22 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:40:46.046795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-52bbd95b-d34e-4308-88c4-83c08997bc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:46.087410 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:46.207457 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bbd95b-d34e-4308-88c4-83c08997bc22 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:40:46.328383 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:46.334753 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262fc3f3-150b-42aa-98a8-9c68409273ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:40:46.335485 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fc3f3-150b-42aa-98a8-9c68409273ec service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:46.335864 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fc3f3-150b-42aa-98a8-9c68409273ec service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:46.336230 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fc3f3-150b-42aa-98a8-9c68409273ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:46.338117 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-262fc3f3-150b-42aa-98a8-9c68409273ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:46.442321 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262fc3f3-150b-42aa-98a8-9c68409273ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:40:46.444274 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262fc3f3-150b-42aa-98a8-9c68409273ec service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:40:46.464994 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 698/1379] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:40:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:40:48.884757 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb130b-7c93-4f14-8f53-f7da66468240 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:48.885276 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb130b-7c93-4f14-8f53-f7da66468240 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:48.885276 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb130b-7c93-4f14-8f53-f7da66468240 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:48.886601 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 682/1380] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:40:48.892034 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea37746-1d98-457c-9f79-0ae42e0b4cc1 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:48.892500 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea37746-1d98-457c-9f79-0ae42e0b4cc1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:48.893213 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea37746-1d98-457c-9f79-0ae42e0b4cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:48.960366 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-aea37746-1d98-457c-9f79-0ae42e0b4cc1 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:40:48.961589 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-aea37746-1d98-457c-9f79-0ae42e0b4cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:49.028303 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:49.060241 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 699/1381] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:40:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:40:49.359606 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb130b-7c93-4f14-8f53-f7da66468240 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:40:49.361622 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-dfcb130b-7c93-4f14-8f53-f7da66468240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:49.390291 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:49.506569 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb130b-7c93-4f14-8f53-f7da66468240 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:40:49.602147 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:49.618491 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af55628-bbc4-4f22-bded-6394a96a69db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:40:49.619094 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af55628-bbc4-4f22-bded-6394a96a69db service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:49.619368 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af55628-bbc4-4f22-bded-6394a96a69db service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:49.619637 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af55628-bbc4-4f22-bded-6394a96a69db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:49.621235 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4af55628-bbc4-4f22-bded-6394a96a69db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:49.714215 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af55628-bbc4-4f22-bded-6394a96a69db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:40:49.715839 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af55628-bbc4-4f22-bded-6394a96a69db service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:40:49.733897 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 683/1382] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:40:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:40:52.133695 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a819ab-69db-4895-87e8-a483ad56c150 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:52.134297 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a819ab-69db-4895-87e8-a483ad56c150 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:52.134297 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a819ab-69db-4895-87e8-a483ad56c150 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:52.135662 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 700/1383] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 03:40:52.140997 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951eb7e-7a01-40d4-b5ed-16e875b5dd41 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:52.141500 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951eb7e-7a01-40d4-b5ed-16e875b5dd41 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:52.141617 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951eb7e-7a01-40d4-b5ed-16e875b5dd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:52.218982 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4951eb7e-7a01-40d4-b5ed-16e875b5dd41 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:40:52.221209 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4951eb7e-7a01-40d4-b5ed-16e875b5dd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:52.285508 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:52.329382 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 684/1384] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:40:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:40:52.622010 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a819ab-69db-4895-87e8-a483ad56c150 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:40:52.623574 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b8a819ab-69db-4895-87e8-a483ad56c150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:52.794428 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a819ab-69db-4895-87e8-a483ad56c150 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:40:52.858736 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:52.930888 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b36348-7d49-40b4-90c8-fdbea093a2eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:40:52.931493 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b36348-7d49-40b4-90c8-fdbea093a2eb service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:52.931770 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b36348-7d49-40b4-90c8-fdbea093a2eb service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:52.932039 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b36348-7d49-40b4-90c8-fdbea093a2eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:52.933661 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-12b36348-7d49-40b4-90c8-fdbea093a2eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:53.025991 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b36348-7d49-40b4-90c8-fdbea093a2eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:40:53.027850 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b36348-7d49-40b4-90c8-fdbea093a2eb service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:40:53.048131 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 701/1385] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:40:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:40:55.300378 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b175354-ec9a-43dd-ac49-0d9944fcfae5 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:55.300882 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b175354-ec9a-43dd-ac49-0d9944fcfae5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:55.300882 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b175354-ec9a-43dd-ac49-0d9944fcfae5 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:55.302343 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 685/1386] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:40:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:40:55.307585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb974d-651d-4261-b549-539fe6722e8d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:55.308129 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb974d-651d-4261-b549-539fe6722e8d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:55.308129 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb974d-651d-4261-b549-539fe6722e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:55.373487 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-07eb974d-651d-4261-b549-539fe6722e8d None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:40:55.374719 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-07eb974d-651d-4261-b549-539fe6722e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:55.383655 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:55.476373 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 702/1387] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:40:55.767338 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b175354-ec9a-43dd-ac49-0d9944fcfae5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:40:55.768932 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4b175354-ec9a-43dd-ac49-0d9944fcfae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:55.919013 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b175354-ec9a-43dd-ac49-0d9944fcfae5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:40:55.977058 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:56.048172 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b31a4e-074b-42c9-ae24-155be5e9fde1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:40:56.048776 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b31a4e-074b-42c9-ae24-155be5e9fde1 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:56.049052 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b31a4e-074b-42c9-ae24-155be5e9fde1 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:56.049321 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b31a4e-074b-42c9-ae24-155be5e9fde1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:56.050977 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-36b31a4e-074b-42c9-ae24-155be5e9fde1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:56.138751 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b31a4e-074b-42c9-ae24-155be5e9fde1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:40:56.140390 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b31a4e-074b-42c9-ae24-155be5e9fde1 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:40:56.159860 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 686/1388] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:40:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:40:58.353932 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba3537-68ff-4909-94d4-a51a437d7356 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:58.354519 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba3537-68ff-4909-94d4-a51a437d7356 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:58.354519 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba3537-68ff-4909-94d4-a51a437d7356 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:58.355800 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 703/1389] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:40:58.361509 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7936a-d801-4327-9d3e-db79d7c5c7b1 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:58.361980 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7936a-d801-4327-9d3e-db79d7c5c7b1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:58.362085 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7936a-d801-4327-9d3e-db79d7c5c7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:58.432084 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:58.435248 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b5d7936a-d801-4327-9d3e-db79d7c5c7b1 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:40:58.436456 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b5d7936a-d801-4327-9d3e-db79d7c5c7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:58.522209 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71047a8e-4edd-4ba8-9d0a-5057cb8a57b5 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:58.522490 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71047a8e-4edd-4ba8-9d0a-5057cb8a57b5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:58.522764 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71047a8e-4edd-4ba8-9d0a-5057cb8a57b5 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:58.524113 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 704/1390] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 03:40:58.529466 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f561242-4339-4d44-8ce9-a1eb6c01787d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:58.529782 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f561242-4339-4d44-8ce9-a1eb6c01787d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:58.530232 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f561242-4339-4d44-8ce9-a1eb6c01787d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:58.532584 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 687/1391] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:40:58.597307 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9f561242-4339-4d44-8ce9-a1eb6c01787d None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:40:58.598451 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9f561242-4339-4d44-8ce9-a1eb6c01787d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:58.686141 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:58.700485 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 705/1392] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:40:58.842969 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41515e6-44c4-4b39-bdd5-0c84e492d7e1 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:58.843289 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41515e6-44c4-4b39-bdd5-0c84e492d7e1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:58.843565 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41515e6-44c4-4b39-bdd5-0c84e492d7e1 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:58.844894 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 688/1393] 10.222.0.33 () {54 vars in 962 bytes} [Fri Sep 16 03:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:40:58.850621 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93237d-6f8c-4e47-90b2-83a8776da470 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:58.850921 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93237d-6f8c-4e47-90b2-83a8776da470 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:58.851262 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93237d-6f8c-4e47-90b2-83a8776da470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:58.928368 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-af93237d-6f8c-4e47-90b2-83a8776da470 None None] MFA Rules not processed for user `aafb065e06c3481bbed8d98e893766ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:40:58.929562 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-af93237d-6f8c-4e47-90b2-83a8776da470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:58.991072 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41515e6-44c4-4b39-bdd5-0c84e492d7e1 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:40:58.992568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f41515e6-44c4-4b39-bdd5-0c84e492d7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:59.005717 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 706/1394] 10.222.0.33 () {58 vars in 1059 bytes} [Fri Sep 16 03:40:58 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:40:59.015952 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93237d-6f8c-4e47-90b2-83a8776da470 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:40:59.023359 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93237d-6f8c-4e47-90b2-83a8776da470 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:40:59.099429 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea152fa-3117-4103-a56e-a6e7354c6b68 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aafb065e06c3481bbed8d98e893766ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:40:59.100073 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea152fa-3117-4103-a56e-a6e7354c6b68 service glance] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:59.100354 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea152fa-3117-4103-a56e-a6e7354c6b68 service glance] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:59.100678 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea152fa-3117-4103-a56e-a6e7354c6b68 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:59.102313 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6ea152fa-3117-4103-a56e-a6e7354c6b68 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:59.105626 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:59.123148 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:59.141223 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41515e6-44c4-4b39-bdd5-0c84e492d7e1 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:40:59.213475 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea152fa-3117-4103-a56e-a6e7354c6b68 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:40:59.215082 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea152fa-3117-4103-a56e-a6e7354c6b68 service glance] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:40:59.234739 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 707/1395] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:40:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 03:40:59.254607 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d49993-2772-4229-bb85-a1f167c5af24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:40:59.255214 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d49993-2772-4229-bb85-a1f167c5af24 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:40:59.255491 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d49993-2772-4229-bb85-a1f167c5af24 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:40:59.255755 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d49993-2772-4229-bb85-a1f167c5af24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:40:59.257328 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-22d49993-2772-4229-bb85-a1f167c5af24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:40:59.346223 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d49993-2772-4229-bb85-a1f167c5af24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:40:59.347838 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d49993-2772-4229-bb85-a1f167c5af24 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:40:59.351717 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:40:59.365865 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 689/1396] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:40:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 03:41:00.184973 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af810f2d-2b86-4275-a8b3-81c4a0bf0148 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:00.185459 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af810f2d-2b86-4275-a8b3-81c4a0bf0148 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:00.185591 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af810f2d-2b86-4275-a8b3-81c4a0bf0148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:00.252700 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-af810f2d-2b86-4275-a8b3-81c4a0bf0148 None None] MFA Rules not processed for user `b0812002d7b14bcb81a42eb380231feb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:41:00.253932 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-af810f2d-2b86-4275-a8b3-81c4a0bf0148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:00.310813 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:00.342301 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 708/1397] 10.222.0.33 () {58 vars in 1009 bytes} [Fri Sep 16 03:41:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:41:00.389509 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ca710-10ec-4a7d-9854-061f72d06d72 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:00.390026 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ca710-10ec-4a7d-9854-061f72d06d72 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:00.390125 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ca710-10ec-4a7d-9854-061f72d06d72 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:00.391472 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 690/1398] 10.222.0.33 () {54 vars in 943 bytes} [Fri Sep 16 03:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:41:00.397859 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211ebe3-7749-4d05-9f8f-f6067888af9e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:00.398215 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211ebe3-7749-4d05-9f8f-f6067888af9e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:00.398551 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211ebe3-7749-4d05-9f8f-f6067888af9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:00.476712 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a211ebe3-7749-4d05-9f8f-f6067888af9e None None] MFA Rules not processed for user `9f784d98d5f440c681f53ae70f6d1cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:41:00.477952 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a211ebe3-7749-4d05-9f8f-f6067888af9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:00.584071 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 709/1399] 10.222.0.33 () {58 vars in 1040 bytes} [Fri Sep 16 03:41:00 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:41:00.593521 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ca710-10ec-4a7d-9854-061f72d06d72 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:41:00.595099 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-801ca710-10ec-4a7d-9854-061f72d06d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:00.731281 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ca710-10ec-4a7d-9854-061f72d06d72 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:41:00.805365 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:00.834328 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17399220-d283-4468-bf08-acb895f19912 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f784d98d5f440c681f53ae70f6d1cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:41:00.834880 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17399220-d283-4468-bf08-acb895f19912 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:00.835161 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17399220-d283-4468-bf08-acb895f19912 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:00.835437 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17399220-d283-4468-bf08-acb895f19912 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:00.837109 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-17399220-d283-4468-bf08-acb895f19912 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:00.921612 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17399220-d283-4468-bf08-acb895f19912 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:41:00.923285 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17399220-d283-4468-bf08-acb895f19912 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:41:00.931918 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 691/1400] 10.222.0.33 () {60 vars in 1384 bytes} [Fri Sep 16 03:41:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 03:41:01.696052 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f413241-ab19-4206-b097-171d1a7de44f None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:01.696569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f413241-ab19-4206-b097-171d1a7de44f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:01.696671 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f413241-ab19-4206-b097-171d1a7de44f None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:01.701831 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 710/1401] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:41:01.704659 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2654441-fffe-4d7a-8704-5d5be36f4282 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:01.705071 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2654441-fffe-4d7a-8704-5d5be36f4282 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:01.705221 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2654441-fffe-4d7a-8704-5d5be36f4282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:01.781901 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e2654441-fffe-4d7a-8704-5d5be36f4282 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:41:01.783677 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e2654441-fffe-4d7a-8704-5d5be36f4282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:01.848545 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:01.892365 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 692/1402] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:41:02.188144 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f413241-ab19-4206-b097-171d1a7de44f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:41:02.190447 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4f413241-ab19-4206-b097-171d1a7de44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:02.234889 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:02.359305 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f413241-ab19-4206-b097-171d1a7de44f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:41:02.517893 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:02.527393 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff81b59-0c2f-4bf9-9a75-5f6f4eb08953 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:41:02.528431 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff81b59-0c2f-4bf9-9a75-5f6f4eb08953 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:02.529281 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff81b59-0c2f-4bf9-9a75-5f6f4eb08953 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:02.529652 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff81b59-0c2f-4bf9-9a75-5f6f4eb08953 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:02.531641 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1ff81b59-0c2f-4bf9-9a75-5f6f4eb08953 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:02.663502 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff81b59-0c2f-4bf9-9a75-5f6f4eb08953 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:41:02.665292 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff81b59-0c2f-4bf9-9a75-5f6f4eb08953 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:41:02.687087 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 711/1403] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:41:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:41:06.056677 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0680a-62c0-4434-aad9-c10d7f4b009c None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:06.057188 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0680a-62c0-4434-aad9-c10d7f4b009c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:06.057188 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0680a-62c0-4434-aad9-c10d7f4b009c None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:06.058916 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 693/1404] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:41:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:41:06.064807 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e971e2-f05f-4061-92ff-5cf8434f0e50 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:06.065254 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e971e2-f05f-4061-92ff-5cf8434f0e50 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:06.065398 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e971e2-f05f-4061-92ff-5cf8434f0e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:06.137390 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-39e971e2-f05f-4061-92ff-5cf8434f0e50 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:41:06.139014 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-39e971e2-f05f-4061-92ff-5cf8434f0e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:06.216144 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:06.257704 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 712/1405] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:41:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:41:06.541812 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0680a-62c0-4434-aad9-c10d7f4b009c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:41:06.543408 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-54c0680a-62c0-4434-aad9-c10d7f4b009c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:06.710047 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0680a-62c0-4434-aad9-c10d7f4b009c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:41:06.762317 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:06.836098 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c03c12-4b52-4a61-8d10-e344af701f91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:41:06.836936 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c03c12-4b52-4a61-8d10-e344af701f91 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:06.837217 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c03c12-4b52-4a61-8d10-e344af701f91 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:06.837496 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c03c12-4b52-4a61-8d10-e344af701f91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:06.840710 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f3c03c12-4b52-4a61-8d10-e344af701f91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:06.938219 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c03c12-4b52-4a61-8d10-e344af701f91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:41:06.939839 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c03c12-4b52-4a61-8d10-e344af701f91 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:41:06.961883 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 694/1406] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:41:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:41:09.433703 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97059ba9-421c-4175-b6a6-cd794377456a None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:09.433703 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97059ba9-421c-4175-b6a6-cd794377456a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:09.433703 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97059ba9-421c-4175-b6a6-cd794377456a None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:09.435509 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 713/1407] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:41:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:41:09.439474 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed254e7e-a726-4208-918c-8cb86ee721d6 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:09.439910 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed254e7e-a726-4208-918c-8cb86ee721d6 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:09.440014 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed254e7e-a726-4208-918c-8cb86ee721d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:09.512609 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ed254e7e-a726-4208-918c-8cb86ee721d6 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:41:09.514171 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ed254e7e-a726-4208-918c-8cb86ee721d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:09.516374 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:09.618259 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 695/1408] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:41:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:41:09.914129 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97059ba9-421c-4175-b6a6-cd794377456a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:41:09.915866 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-97059ba9-421c-4175-b6a6-cd794377456a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:10.080727 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97059ba9-421c-4175-b6a6-cd794377456a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:41:10.135117 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:10.203776 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646af07-7f11-4812-b805-98347b9a3171 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:41:10.205013 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646af07-7f11-4812-b805-98347b9a3171 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:10.205534 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646af07-7f11-4812-b805-98347b9a3171 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:10.205945 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646af07-7f11-4812-b805-98347b9a3171 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:10.208414 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e646af07-7f11-4812-b805-98347b9a3171 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:10.316761 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646af07-7f11-4812-b805-98347b9a3171 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:41:10.318423 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646af07-7f11-4812-b805-98347b9a3171 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:41:10.338354 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 714/1409] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:41:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:41:19.616378 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=42 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:20.335989 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=75 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:25.066882 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa64c7-60f0-46ec-bddb-3e8a36fc5eab None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:25.067416 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa64c7-60f0-46ec-bddb-3e8a36fc5eab None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:25.067416 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa64c7-60f0-46ec-bddb-3e8a36fc5eab None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:25.068690 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 696/1410] 10.222.0.33 () {54 vars in 918 bytes} [Fri Sep 16 03:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:41:25.073860 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656f407-5fa8-4cbf-85c7-263f61f4cdcf None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:25.074260 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656f407-5fa8-4cbf-85c7-263f61f4cdcf None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:25.074406 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656f407-5fa8-4cbf-85c7-263f61f4cdcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:25.148923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-5656f407-5fa8-4cbf-85c7-263f61f4cdcf None None] MFA Rules not processed for user `c39fd09bea1a40babc5f629612c6702b`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:41:25.150154 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5656f407-5fa8-4cbf-85c7-263f61f4cdcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:25.255362 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 715/1411] 10.222.0.33 () {58 vars in 1015 bytes} [Fri Sep 16 03:41:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:41:25.269350 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffd20a-857d-4f0c-88d2-eeedbad0704e None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:25.269650 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffd20a-857d-4f0c-88d2-eeedbad0704e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:25.269943 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffd20a-857d-4f0c-88d2-eeedbad0704e None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:25.271260 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 697/1412] 10.222.0.33 () {54 vars in 918 bytes} [Fri Sep 16 03:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:41:25.275862 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bef105-3d5c-432d-9da4-1cf8ba7a9b1d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:25.276153 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bef105-3d5c-432d-9da4-1cf8ba7a9b1d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:25.276433 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bef105-3d5c-432d-9da4-1cf8ba7a9b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:25.349761 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:25.352318 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-27bef105-3d5c-432d-9da4-1cf8ba7a9b1d None None] MFA Rules not processed for user `c09d1a4ac8b64921a6b05fcd567bb770`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:41:25.353703 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-27bef105-3d5c-432d-9da4-1cf8ba7a9b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:25.468605 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 716/1413] 10.222.0.33 () {58 vars in 1015 bytes} [Fri Sep 16 03:41:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:41:28.040465 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0443b-1169-4653-a59e-bec28bcfba75 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:28.040990 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0443b-1169-4653-a59e-bec28bcfba75 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:28.040990 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0443b-1169-4653-a59e-bec28bcfba75 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:28.042340 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 698/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 03:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:41:28.048307 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f56ef-d382-43df-b816-927a9a06bbde None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:28.048728 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f56ef-d382-43df-b816-927a9a06bbde None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:28.048864 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f56ef-d382-43df-b816-927a9a06bbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:28.115395 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2f1f56ef-d382-43df-b816-927a9a06bbde None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:41:28.116615 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2f1f56ef-d382-43df-b816-927a9a06bbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:28.171238 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:28.212840 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 717/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 03:41:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:41:28.502999 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0443b-1169-4653-a59e-bec28bcfba75 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:41:28.504532 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bdb0443b-1169-4653-a59e-bec28bcfba75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:28.648482 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0443b-1169-4653-a59e-bec28bcfba75 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:41:28.720852 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:28.760968 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e05c6-5370-4098-b674-8a20dd9b39ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:41:28.761562 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e05c6-5370-4098-b674-8a20dd9b39ce service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:28.761872 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e05c6-5370-4098-b674-8a20dd9b39ce service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:28.762190 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e05c6-5370-4098-b674-8a20dd9b39ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:28.763920 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c63e05c6-5370-4098-b674-8a20dd9b39ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:28.852252 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e05c6-5370-4098-b674-8a20dd9b39ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:41:28.853894 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e05c6-5370-4098-b674-8a20dd9b39ce service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:41:28.871393 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 699/1416] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:41:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:41:30.005934 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee44c1-a3f6-41d9-bdb0-4135b2b833f8 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:30.006495 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee44c1-a3f6-41d9-bdb0-4135b2b833f8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:30.006495 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee44c1-a3f6-41d9-bdb0-4135b2b833f8 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:30.007784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 718/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 03:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:41:30.014358 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a53933-4638-4354-abfd-4255f15628f3 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:30.014847 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a53933-4638-4354-abfd-4255f15628f3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:30.014948 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a53933-4638-4354-abfd-4255f15628f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:30.089832 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-39a53933-4638-4354-abfd-4255f15628f3 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:41:30.091043 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-39a53933-4638-4354-abfd-4255f15628f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:30.117750 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:30.187113 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 700/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 03:41:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:41:30.335672 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee44c1-a3f6-41d9-bdb0-4135b2b833f8 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:41:30.337249 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-45ee44c1-a3f6-41d9-bdb0-4135b2b833f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:30.485185 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee44c1-a3f6-41d9-bdb0-4135b2b833f8 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:41:30.525372 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:30.597994 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa616d-30a6-42fb-823f-8c6127d0008c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:41:30.598525 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa616d-30a6-42fb-823f-8c6127d0008c service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:30.598803 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa616d-30a6-42fb-823f-8c6127d0008c service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:30.599076 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa616d-30a6-42fb-823f-8c6127d0008c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:30.600669 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-adfa616d-30a6-42fb-823f-8c6127d0008c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:30.688693 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa616d-30a6-42fb-823f-8c6127d0008c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:41:30.690343 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa616d-30a6-42fb-823f-8c6127d0008c service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:41:30.709306 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 719/1419] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:41:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:41:31.830452 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cf041-bd28-47b8-8d56-de2c0a071e0b None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:31.831024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cf041-bd28-47b8-8d56-de2c0a071e0b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:31.831024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cf041-bd28-47b8-8d56-de2c0a071e0b None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:31.832329 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 701/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 03:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:41:31.838408 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c886a9-f2ff-4d73-9270-54dbcec64faf None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:31.838846 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c886a9-f2ff-4d73-9270-54dbcec64faf None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:31.838989 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c886a9-f2ff-4d73-9270-54dbcec64faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:31.893542 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:31.915290 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-50c886a9-f2ff-4d73-9270-54dbcec64faf None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:41:31.916505 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-50c886a9-f2ff-4d73-9270-54dbcec64faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:32.010875 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 720/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 03:41:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:41:32.163147 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67cf041-bd28-47b8-8d56-de2c0a071e0b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:41:32.164785 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b67cf041-bd28-47b8-8d56-de2c0a071e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:32.308899 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67cf041-bd28-47b8-8d56-de2c0a071e0b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:41:32.320603 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:32.419571 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4c3ae-9a32-4faa-a5b4-f4015351b1f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:41:32.420169 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4c3ae-9a32-4faa-a5b4-f4015351b1f0 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:32.420446 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4c3ae-9a32-4faa-a5b4-f4015351b1f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:32.420716 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4c3ae-9a32-4faa-a5b4-f4015351b1f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:32.422340 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-03a4c3ae-9a32-4faa-a5b4-f4015351b1f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:32.507995 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a4c3ae-9a32-4faa-a5b4-f4015351b1f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:41:32.509566 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a4c3ae-9a32-4faa-a5b4-f4015351b1f0 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:41:32.527560 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 702/1422] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:41:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:41:33.641926 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b095b11-a4dc-4d99-be52-40fa20c34796 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:33.642498 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b095b11-a4dc-4d99-be52-40fa20c34796 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:33.642498 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b095b11-a4dc-4d99-be52-40fa20c34796 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:33.643806 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 721/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 03:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:41:33.650318 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b2334-06ee-40a4-88ce-ce4b60f8df85 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:33.654816 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b2334-06ee-40a4-88ce-ce4b60f8df85 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:33.654816 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b2334-06ee-40a4-88ce-ce4b60f8df85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:33.670418 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:33.727399 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-814b2334-06ee-40a4-88ce-ce4b60f8df85 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:41:33.728624 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-814b2334-06ee-40a4-88ce-ce4b60f8df85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:33.824102 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 703/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 03:41:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:41:33.972222 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b095b11-a4dc-4d99-be52-40fa20c34796 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:41:33.973783 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3b095b11-a4dc-4d99-be52-40fa20c34796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:34.081471 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:34.116838 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b095b11-a4dc-4d99-be52-40fa20c34796 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:41:34.226344 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd334e-9938-4ff6-9d8b-4baa2773f1dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:41:34.226867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd334e-9938-4ff6-9d8b-4baa2773f1dd service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:34.227145 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd334e-9938-4ff6-9d8b-4baa2773f1dd service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:34.227411 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd334e-9938-4ff6-9d8b-4baa2773f1dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:34.228989 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-93fd334e-9938-4ff6-9d8b-4baa2773f1dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:34.304163 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:34.316800 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd334e-9938-4ff6-9d8b-4baa2773f1dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:41:34.320265 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd334e-9938-4ff6-9d8b-4baa2773f1dd service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:41:34.336355 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 722/1425] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:41:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:41:35.441801 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc75810-99ea-4dd9-87fb-cbc3c47b0839 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:35.442330 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc75810-99ea-4dd9-87fb-cbc3c47b0839 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:35.442330 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc75810-99ea-4dd9-87fb-cbc3c47b0839 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:35.443601 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 704/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 03:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:41:35.449730 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a8359-ed65-4fbf-9576-a2febff4b173 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:35.450134 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a8359-ed65-4fbf-9576-a2febff4b173 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:35.450295 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a8359-ed65-4fbf-9576-a2febff4b173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:35.639530 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-fc9a8359-ed65-4fbf-9576-a2febff4b173 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:41:35.640721 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fc9a8359-ed65-4fbf-9576-a2febff4b173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:35.740524 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 723/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 03:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:41:35.889236 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc75810-99ea-4dd9-87fb-cbc3c47b0839 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:41:35.890867 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-dbc75810-99ea-4dd9-87fb-cbc3c47b0839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:35.971947 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:36.031383 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc75810-99ea-4dd9-87fb-cbc3c47b0839 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:41:36.140309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f3e30-21df-4817-bdb3-0345beb9a331 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:41:36.140910 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f3e30-21df-4817-bdb3-0345beb9a331 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:36.141185 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f3e30-21df-4817-bdb3-0345beb9a331 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:36.141454 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f3e30-21df-4817-bdb3-0345beb9a331 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:36.143139 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-196f3e30-21df-4817-bdb3-0345beb9a331 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:36.190536 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:36.230028 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f3e30-21df-4817-bdb3-0345beb9a331 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:41:36.231534 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f3e30-21df-4817-bdb3-0345beb9a331 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:41:36.249281 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 705/1428] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:41:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:41:37.356822 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188aada-00aa-4250-b6ea-a5022e432097 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:37.357392 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188aada-00aa-4250-b6ea-a5022e432097 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:37.357392 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188aada-00aa-4250-b6ea-a5022e432097 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:37.358746 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 724/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 03:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:41:37.365532 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5bc5c-e759-44b7-8f25-3394276ec2ff None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:37.365979 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5bc5c-e759-44b7-8f25-3394276ec2ff None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:37.366092 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5bc5c-e759-44b7-8f25-3394276ec2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:37.440600 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-88c5bc5c-e759-44b7-8f25-3394276ec2ff None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:41:37.441840 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-88c5bc5c-e759-44b7-8f25-3394276ec2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:37.534765 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 706/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 03:41:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:41:37.686443 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188aada-00aa-4250-b6ea-a5022e432097 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:41:37.687893 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c188aada-00aa-4250-b6ea-a5022e432097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:37.737922 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:37.833826 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188aada-00aa-4250-b6ea-a5022e432097 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:41:37.945771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cabc003-5c7c-462a-ad92-230f454c7c42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:41:37.946291 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabc003-5c7c-462a-ad92-230f454c7c42 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:37.946566 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabc003-5c7c-462a-ad92-230f454c7c42 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:37.946832 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabc003-5c7c-462a-ad92-230f454c7c42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:37.948454 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5cabc003-5c7c-462a-ad92-230f454c7c42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:37.955843 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:38.036954 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cabc003-5c7c-462a-ad92-230f454c7c42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:41:38.038569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cabc003-5c7c-462a-ad92-230f454c7c42 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:41:38.056547 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 725/1431] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:41:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:41:39.174076 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140992f-3f16-4b3d-9ffd-90ff5d7dd44a None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:39.174617 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140992f-3f16-4b3d-9ffd-90ff5d7dd44a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:39.174617 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140992f-3f16-4b3d-9ffd-90ff5d7dd44a None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:39.175986 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 707/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 03:41:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:41:39.182319 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f001d-0af8-429a-a208-e6fa483729d4 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:39.182733 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f001d-0af8-429a-a208-e6fa483729d4 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:39.182871 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f001d-0af8-429a-a208-e6fa483729d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:39.257124 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-5e2f001d-0af8-429a-a208-e6fa483729d4 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:41:39.258362 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5e2f001d-0af8-429a-a208-e6fa483729d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:39.324406 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:39.352382 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 726/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 03:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:41:39.502663 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140992f-3f16-4b3d-9ffd-90ff5d7dd44a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:41:39.504230 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c140992f-3f16-4b3d-9ffd-90ff5d7dd44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:39.521808 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:39.646721 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140992f-3f16-4b3d-9ffd-90ff5d7dd44a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:41:39.733469 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:39.758253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56cb38-6700-47a1-adb8-b0e3a69ffc54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:41:39.758798 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56cb38-6700-47a1-adb8-b0e3a69ffc54 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:39.759077 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56cb38-6700-47a1-adb8-b0e3a69ffc54 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:39.759348 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56cb38-6700-47a1-adb8-b0e3a69ffc54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:39.760946 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0c56cb38-6700-47a1-adb8-b0e3a69ffc54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:39.849138 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56cb38-6700-47a1-adb8-b0e3a69ffc54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:41:39.850752 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56cb38-6700-47a1-adb8-b0e3a69ffc54 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:41:39.868079 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 708/1434] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:41:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:41:41.003220 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68b643-7983-4a2b-992e-8e5ed90f9f08 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:41.003760 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68b643-7983-4a2b-992e-8e5ed90f9f08 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:41.003760 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68b643-7983-4a2b-992e-8e5ed90f9f08 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:41.005008 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 727/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 03:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:41:41.011173 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59949e3-f9e4-48b6-9e1f-542e94ed8cd0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:41.011606 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59949e3-f9e4-48b6-9e1f-542e94ed8cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:41.011752 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59949e3-f9e4-48b6-9e1f-542e94ed8cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:41.086564 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b59949e3-f9e4-48b6-9e1f-542e94ed8cd0 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:41:41.087802 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b59949e3-f9e4-48b6-9e1f-542e94ed8cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:41.128448 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:41.183501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 709/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 03:41:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:41:41.336446 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f68b643-7983-4a2b-992e-8e5ed90f9f08 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:41:41.337931 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0f68b643-7983-4a2b-992e-8e5ed90f9f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:41.485740 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f68b643-7983-4a2b-992e-8e5ed90f9f08 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:41:41.538380 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:41.596380 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643afdc-306e-48e1-a71c-e79d30d7d6e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:41:41.596906 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643afdc-306e-48e1-a71c-e79d30d7d6e9 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:41.597182 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643afdc-306e-48e1-a71c-e79d30d7d6e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:41.597453 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643afdc-306e-48e1-a71c-e79d30d7d6e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:41.599121 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3643afdc-306e-48e1-a71c-e79d30d7d6e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:41.691865 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3643afdc-306e-48e1-a71c-e79d30d7d6e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:41:41.693534 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3643afdc-306e-48e1-a71c-e79d30d7d6e9 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:41:41.713248 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 728/1437] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:41:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:41:42.827994 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969defd-449c-4b2a-8eb6-ecdb39aa0ef4 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:42.828560 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969defd-449c-4b2a-8eb6-ecdb39aa0ef4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:42.828560 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969defd-449c-4b2a-8eb6-ecdb39aa0ef4 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:42.830619 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 710/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 03:41:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:41:42.836964 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1406ed-8111-4cf2-a1bf-ac0ad869cad7 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:42.837435 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1406ed-8111-4cf2-a1bf-ac0ad869cad7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:42.837545 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1406ed-8111-4cf2-a1bf-ac0ad869cad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:42.912819 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-eb1406ed-8111-4cf2-a1bf-ac0ad869cad7 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:41:42.914003 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-eb1406ed-8111-4cf2-a1bf-ac0ad869cad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:42.915989 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:43.012613 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 729/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 03:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:41:43.164742 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969defd-449c-4b2a-8eb6-ecdb39aa0ef4 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:41:43.166237 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3969defd-449c-4b2a-8eb6-ecdb39aa0ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:43.308725 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969defd-449c-4b2a-8eb6-ecdb39aa0ef4 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:41:43.335467 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:43.422029 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f1560-2950-462d-a0cb-0e6b5ca001cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:41:43.423079 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f1560-2950-462d-a0cb-0e6b5ca001cc service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:43.423357 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f1560-2950-462d-a0cb-0e6b5ca001cc service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:43.423625 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f1560-2950-462d-a0cb-0e6b5ca001cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:43.425224 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b02f1560-2950-462d-a0cb-0e6b5ca001cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:43.513003 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f1560-2950-462d-a0cb-0e6b5ca001cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:41:43.514637 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f1560-2950-462d-a0cb-0e6b5ca001cc service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:41:43.532262 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 711/1440] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:41:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:41:45.583087 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921c9d3-9aa5-4956-9fe2-7394eb83790c None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:45.583648 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921c9d3-9aa5-4956-9fe2-7394eb83790c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:45.583648 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921c9d3-9aa5-4956-9fe2-7394eb83790c None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:45.584950 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 730/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 03:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:41:45.590360 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28612c1-81f2-440f-85fa-29ea3f01874a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:45.590740 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28612c1-81f2-440f-85fa-29ea3f01874a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:45.590921 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28612c1-81f2-440f-85fa-29ea3f01874a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:45.631333 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:45.656434 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b28612c1-81f2-440f-85fa-29ea3f01874a None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:41:45.657655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b28612c1-81f2-440f-85fa-29ea3f01874a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:45.754117 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 712/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 03:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:41:46.044878 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921c9d3-9aa5-4956-9fe2-7394eb83790c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:41:46.046460 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7921c9d3-9aa5-4956-9fe2-7394eb83790c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:46.151422 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921c9d3-9aa5-4956-9fe2-7394eb83790c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:41:46.183893 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:46.224325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3a7a9-d776-4cfb-b654-374c388382a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:41:46.224925 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3a7a9-d776-4cfb-b654-374c388382a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:46.225237 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3a7a9-d776-4cfb-b654-374c388382a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:46.225501 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3a7a9-d776-4cfb-b654-374c388382a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:46.227115 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-62d3a7a9-d776-4cfb-b654-374c388382a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:46.333236 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3a7a9-d776-4cfb-b654-374c388382a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:41:46.334704 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3a7a9-d776-4cfb-b654-374c388382a0 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:41:46.352831 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 731/1443] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:41:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:41:48.649737 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db2b1a-4cf7-4197-8831-471551726b43 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:48.650274 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db2b1a-4cf7-4197-8831-471551726b43 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:48.650274 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db2b1a-4cf7-4197-8831-471551726b43 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:48.651527 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 713/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 03:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:41:48.657352 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9cc50-6dda-46a2-80ad-24084cfbf956 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:48.657820 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9cc50-6dda-46a2-80ad-24084cfbf956 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:48.657937 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9cc50-6dda-46a2-80ad-24084cfbf956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:48.724987 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9fb9cc50-6dda-46a2-80ad-24084cfbf956 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:41:48.726229 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9fb9cc50-6dda-46a2-80ad-24084cfbf956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:48.739906 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:48.824188 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 732/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 03:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:41:49.106415 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db2b1a-4cf7-4197-8831-471551726b43 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:41:49.107988 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-58db2b1a-4cf7-4197-8831-471551726b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:49.209906 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db2b1a-4cf7-4197-8831-471551726b43 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:41:49.222863 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:49.282723 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5603faf-b154-4e37-92e7-4aa077681fcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:41:49.283318 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5603faf-b154-4e37-92e7-4aa077681fcd service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:49.283593 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5603faf-b154-4e37-92e7-4aa077681fcd service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:49.283860 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5603faf-b154-4e37-92e7-4aa077681fcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:49.285441 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e5603faf-b154-4e37-92e7-4aa077681fcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:49.390262 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5603faf-b154-4e37-92e7-4aa077681fcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:41:49.392201 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5603faf-b154-4e37-92e7-4aa077681fcd service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:41:49.410544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 714/1446] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:41:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:41:51.963776 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31f672-2105-479d-aed4-a6813bc0f51f None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:51.964335 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31f672-2105-479d-aed4-a6813bc0f51f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:51.964335 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31f672-2105-479d-aed4-a6813bc0f51f None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:51.965573 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 733/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 03:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:41:51.971014 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3463a6-bbf1-4b3f-b5d7-838aba56b114 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:51.971473 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3463a6-bbf1-4b3f-b5d7-838aba56b114 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:51.971577 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3463a6-bbf1-4b3f-b5d7-838aba56b114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:52.018422 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:52.035976 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4e3463a6-bbf1-4b3f-b5d7-838aba56b114 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:41:52.037186 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4e3463a6-bbf1-4b3f-b5d7-838aba56b114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:52.130401 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 715/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 03:41:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:41:52.411431 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31f672-2105-479d-aed4-a6813bc0f51f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:41:52.413001 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bb31f672-2105-479d-aed4-a6813bc0f51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:52.515838 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31f672-2105-479d-aed4-a6813bc0f51f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:41:52.559272 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:52.594954 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddde315-1158-469c-8493-8777a3f5bba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:41:52.595492 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddde315-1158-469c-8493-8777a3f5bba5 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:52.595773 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddde315-1158-469c-8493-8777a3f5bba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:52.596044 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddde315-1158-469c-8493-8777a3f5bba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:52.597674 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bddde315-1158-469c-8493-8777a3f5bba5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:52.707194 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddde315-1158-469c-8493-8777a3f5bba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:41:52.711422 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddde315-1158-469c-8493-8777a3f5bba5 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:41:52.727383 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 734/1449] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:41:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:41:54.987846 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1596e4-f9fc-4374-b2d4-40b1e24d20ef None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:54.988389 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1596e4-f9fc-4374-b2d4-40b1e24d20ef None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:54.988389 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1596e4-f9fc-4374-b2d4-40b1e24d20ef None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:54.989796 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 716/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 03:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:41:54.994967 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef67d1-b52b-432f-8b97-0ac5cc34f9e3 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:54.995366 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef67d1-b52b-432f-8b97-0ac5cc34f9e3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:54.995508 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef67d1-b52b-432f-8b97-0ac5cc34f9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:55.060895 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b8ef67d1-b52b-432f-8b97-0ac5cc34f9e3 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:41:55.062131 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b8ef67d1-b52b-432f-8b97-0ac5cc34f9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:55.082275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:55.157816 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 735/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 03:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:41:55.440658 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1596e4-f9fc-4374-b2d4-40b1e24d20ef None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:41:55.442248 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0c1596e4-f9fc-4374-b2d4-40b1e24d20ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:55.545225 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1596e4-f9fc-4374-b2d4-40b1e24d20ef None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:41:55.565231 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:55.616174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e3b71-805d-4ff6-833b-4eba5d97da32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:41:55.616767 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e3b71-805d-4ff6-833b-4eba5d97da32 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:55.617043 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e3b71-805d-4ff6-833b-4eba5d97da32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:55.617312 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e3b71-805d-4ff6-833b-4eba5d97da32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:55.618932 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c84e3b71-805d-4ff6-833b-4eba5d97da32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:55.726646 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84e3b71-805d-4ff6-833b-4eba5d97da32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:41:55.728102 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84e3b71-805d-4ff6-833b-4eba5d97da32 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:41:55.745759 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 717/1452] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:41:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:41:58.051987 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68968b09-4602-4e9a-b4dd-67dc6e80411a None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:58.052551 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68968b09-4602-4e9a-b4dd-67dc6e80411a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:58.052551 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68968b09-4602-4e9a-b4dd-67dc6e80411a None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:58.053893 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 736/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 03:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:41:58.059069 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d231036-a106-4af2-bccf-c3db80401e50 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:58.059532 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d231036-a106-4af2-bccf-c3db80401e50 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:58.059636 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d231036-a106-4af2-bccf-c3db80401e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:58.122135 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:58.124668 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5d231036-a106-4af2-bccf-c3db80401e50 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:41:58.126437 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5d231036-a106-4af2-bccf-c3db80401e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:58.220560 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 718/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 03:41:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:41:58.503550 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68968b09-4602-4e9a-b4dd-67dc6e80411a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:41:58.505096 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-68968b09-4602-4e9a-b4dd-67dc6e80411a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:58.613898 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68968b09-4602-4e9a-b4dd-67dc6e80411a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:41:58.662560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:41:58.686624 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8670754-afb2-4dc4-8d4e-779ebb12fead service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:41:58.687224 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8670754-afb2-4dc4-8d4e-779ebb12fead service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:41:58.687502 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8670754-afb2-4dc4-8d4e-779ebb12fead service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:41:58.687774 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8670754-afb2-4dc4-8d4e-779ebb12fead service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:41:58.689376 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c8670754-afb2-4dc4-8d4e-779ebb12fead service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:41:58.798647 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8670754-afb2-4dc4-8d4e-779ebb12fead service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:41:58.800081 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8670754-afb2-4dc4-8d4e-779ebb12fead service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:41:58.819021 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 737/1455] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:41:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:42:01.004559 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eed046-d91a-42e1-a1ff-421e02125459 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:42:01.005145 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eed046-d91a-42e1-a1ff-421e02125459 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:42:01.005145 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eed046-d91a-42e1-a1ff-421e02125459 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:42:01.006411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 719/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 03:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:42:01.011690 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf1c40-2049-48a3-819b-4f60b728e4f9 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:42:01.012118 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf1c40-2049-48a3-819b-4f60b728e4f9 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:42:01.012218 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf1c40-2049-48a3-819b-4f60b728e4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:42:01.076235 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c5bf1c40-2049-48a3-819b-4f60b728e4f9 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:42:01.077426 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c5bf1c40-2049-48a3-819b-4f60b728e4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:42:01.107259 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:42:01.176615 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 738/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 03:42:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:42:01.466523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eed046-d91a-42e1-a1ff-421e02125459 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:42:01.468064 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f6eed046-d91a-42e1-a1ff-421e02125459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:42:01.572206 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eed046-d91a-42e1-a1ff-421e02125459 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:42:01.606706 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:42:01.651342 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d802f2-d53e-4a74-9a58-0b9db89dde48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:42:01.651937 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d802f2-d53e-4a74-9a58-0b9db89dde48 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:42:01.652212 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d802f2-d53e-4a74-9a58-0b9db89dde48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:42:01.652477 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d802f2-d53e-4a74-9a58-0b9db89dde48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:42:01.654349 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-64d802f2-d53e-4a74-9a58-0b9db89dde48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:42:01.761558 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d802f2-d53e-4a74-9a58-0b9db89dde48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:42:01.762952 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d802f2-d53e-4a74-9a58-0b9db89dde48 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:42:01.781749 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 720/1458] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:42:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:42:03.975464 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd3c72-4b93-4ac2-a021-4c1d0cd33a6e None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:42:03.975996 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd3c72-4b93-4ac2-a021-4c1d0cd33a6e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:42:03.975996 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd3c72-4b93-4ac2-a021-4c1d0cd33a6e None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:42:03.977266 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 739/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 03:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:42:03.983002 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1d795-286f-4704-8867-a1bda7a26486 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:42:03.983455 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1d795-286f-4704-8867-a1bda7a26486 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:42:03.983656 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1d795-286f-4704-8867-a1bda7a26486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:42:04.050835 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-cff1d795-286f-4704-8867-a1bda7a26486 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:42:04.052050 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cff1d795-286f-4704-8867-a1bda7a26486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:42:04.060149 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:42:04.145158 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 721/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 03:42:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:42:04.437671 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd3c72-4b93-4ac2-a021-4c1d0cd33a6e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:42:04.437671 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-42dd3c72-4b93-4ac2-a021-4c1d0cd33a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:42:04.535128 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd3c72-4b93-4ac2-a021-4c1d0cd33a6e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:42:04.589061 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:42:04.607579 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699fe02-5aab-47e7-903b-eeaf2792e5bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:42:04.610040 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699fe02-5aab-47e7-903b-eeaf2792e5bd service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:42:04.610040 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699fe02-5aab-47e7-903b-eeaf2792e5bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:42:04.610040 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699fe02-5aab-47e7-903b-eeaf2792e5bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:42:04.610340 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4699fe02-5aab-47e7-903b-eeaf2792e5bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:42:04.719106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699fe02-5aab-47e7-903b-eeaf2792e5bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:42:04.720550 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699fe02-5aab-47e7-903b-eeaf2792e5bd service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:42:04.739505 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 740/1461] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:42:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:42:06.911028 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf42782-ec11-4c11-b8df-277e4e834744 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:42:06.911586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf42782-ec11-4c11-b8df-277e4e834744 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:42:06.911586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf42782-ec11-4c11-b8df-277e4e834744 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:42:06.912953 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 722/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 03:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:42:06.918278 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1263b-20f0-49d9-a2bc-93d575d7fad1 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:42:06.918703 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1263b-20f0-49d9-a2bc-93d575d7fad1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:42:06.918810 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1263b-20f0-49d9-a2bc-93d575d7fad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:42:06.983735 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e3f1263b-20f0-49d9-a2bc-93d575d7fad1 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:42:06.985432 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e3f1263b-20f0-49d9-a2bc-93d575d7fad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:42:07.022398 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:42:07.079710 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 741/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 03:42:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:42:07.361426 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf42782-ec11-4c11-b8df-277e4e834744 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:42:07.363337 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ecf42782-ec11-4c11-b8df-277e4e834744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:42:07.465025 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf42782-ec11-4c11-b8df-277e4e834744 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:42:07.502412 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:42:07.539108 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a88c0-9ac0-4d1f-bf97-7642aebf6e35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:42:07.539726 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a88c0-9ac0-4d1f-bf97-7642aebf6e35 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:42:07.540004 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a88c0-9ac0-4d1f-bf97-7642aebf6e35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:42:07.540274 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a88c0-9ac0-4d1f-bf97-7642aebf6e35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:42:07.541901 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-892a88c0-9ac0-4d1f-bf97-7642aebf6e35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:42:07.772296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a88c0-9ac0-4d1f-bf97-7642aebf6e35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:42:07.773803 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a88c0-9ac0-4d1f-bf97-7642aebf6e35 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:42:07.792586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 723/1464] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:42:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:42:09.948933 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa264ded-f336-4cc7-a625-3e04e5145ba1 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:42:09.949495 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa264ded-f336-4cc7-a625-3e04e5145ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:42:09.949608 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa264ded-f336-4cc7-a625-3e04e5145ba1 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:42:09.950899 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 742/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 03:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:42:09.957055 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c8c4b-0d06-4472-842b-16964ebffa77 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:42:09.957454 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c8c4b-0d06-4472-842b-16964ebffa77 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:42:09.957565 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c8c4b-0d06-4472-842b-16964ebffa77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:42:10.022048 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-eb1c8c4b-0d06-4472-842b-16964ebffa77 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:42:10.023253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-eb1c8c4b-0d06-4472-842b-16964ebffa77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:42:10.040949 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:42:10.116815 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 724/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 03:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:42:10.396138 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa264ded-f336-4cc7-a625-3e04e5145ba1 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:42:10.397738 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fa264ded-f336-4cc7-a625-3e04e5145ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:42:10.499093 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa264ded-f336-4cc7-a625-3e04e5145ba1 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:42:10.564485 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:42:10.570865 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794693c6-05c1-4a60-a8b8-7b0aa108c003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:42:10.571466 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794693c6-05c1-4a60-a8b8-7b0aa108c003 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:42:10.571749 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794693c6-05c1-4a60-a8b8-7b0aa108c003 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:42:10.572021 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794693c6-05c1-4a60-a8b8-7b0aa108c003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:42:10.573605 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-794693c6-05c1-4a60-a8b8-7b0aa108c003 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:42:10.680610 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794693c6-05c1-4a60-a8b8-7b0aa108c003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:42:10.682013 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794693c6-05c1-4a60-a8b8-7b0aa108c003 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:42:10.701048 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 743/1467] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:42:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:42:12.858649 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e2a36-5c9f-4c95-bbe2-eece348eec25 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:42:12.859768 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e2a36-5c9f-4c95-bbe2-eece348eec25 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:42:12.859892 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e2a36-5c9f-4c95-bbe2-eece348eec25 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:42:12.861272 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 725/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 03:42:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:42:12.866500 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f18fea-5327-4a64-adc3-d6f676bc602d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:42:12.866947 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f18fea-5327-4a64-adc3-d6f676bc602d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:42:12.867057 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f18fea-5327-4a64-adc3-d6f676bc602d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:42:12.932756 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b3f18fea-5327-4a64-adc3-d6f676bc602d None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:42:12.933930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b3f18fea-5327-4a64-adc3-d6f676bc602d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:42:12.982261 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:42:13.031726 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 744/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 03:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:42:13.314127 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e2a36-5c9f-4c95-bbe2-eece348eec25 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:42:13.315659 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0a8e2a36-5c9f-4c95-bbe2-eece348eec25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:42:13.414427 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e2a36-5c9f-4c95-bbe2-eece348eec25 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:42:13.461975 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:42:13.486700 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6eb9fb-a37d-430c-9d9e-046958d8d37e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:42:13.487298 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6eb9fb-a37d-430c-9d9e-046958d8d37e service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:42:13.487575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6eb9fb-a37d-430c-9d9e-046958d8d37e service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:42:13.487845 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6eb9fb-a37d-430c-9d9e-046958d8d37e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:42:13.489426 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cd6eb9fb-a37d-430c-9d9e-046958d8d37e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:42:13.595856 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6eb9fb-a37d-430c-9d9e-046958d8d37e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:42:13.597229 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6eb9fb-a37d-430c-9d9e-046958d8d37e service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:42:13.615182 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 726/1470] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:42:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:42:23.029412 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=22 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:42:23.612868 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=66 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:42:33.482350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9d827-8c3b-4379-8081-753b6251bab1 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:42:33.482966 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9d827-8c3b-4379-8081-753b6251bab1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:42:33.482966 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9d827-8c3b-4379-8081-753b6251bab1 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:42:33.484338 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 745/1471] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:42:33.489529 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06801fcf-a835-4078-a3b8-365fb2408d93 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:42:33.489996 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06801fcf-a835-4078-a3b8-365fb2408d93 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:42:33.490151 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06801fcf-a835-4078-a3b8-365fb2408d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:42:33.555134 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-06801fcf-a835-4078-a3b8-365fb2408d93 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:42:33.556344 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-06801fcf-a835-4078-a3b8-365fb2408d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:42:33.652584 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 727/1472] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:42:33.954099 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fff17-19cf-4ef1-8f29-91a80ded8161 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:42:33.954389 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fff17-19cf-4ef1-8f29-91a80ded8161 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:42:33.954665 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fff17-19cf-4ef1-8f29-91a80ded8161 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:42:33.955980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 746/1473] 10.222.0.33 () {54 vars in 962 bytes} [Fri Sep 16 03:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:42:33.961053 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f17510-fd22-4def-b027-41d1f164d244 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:42:33.961333 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f17510-fd22-4def-b027-41d1f164d244 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:42:33.961605 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f17510-fd22-4def-b027-41d1f164d244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:42:34.034661 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c3f17510-fd22-4def-b027-41d1f164d244 None None] MFA Rules not processed for user `aafb065e06c3481bbed8d98e893766ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:42:34.035854 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c3f17510-fd22-4def-b027-41d1f164d244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:42:34.055970 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:42:34.110675 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 728/1474] 10.222.0.33 () {58 vars in 1059 bytes} [Fri Sep 16 03:42:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:42:34.118336 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531fff17-19cf-4ef1-8f29-91a80ded8161 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:42:34.119882 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-531fff17-19cf-4ef1-8f29-91a80ded8161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:42:34.220197 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531fff17-19cf-4ef1-8f29-91a80ded8161 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:42:34.292698 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be46a97-8764-471c-a963-580b0c47b341 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aafb065e06c3481bbed8d98e893766ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:42:34.293299 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be46a97-8764-471c-a963-580b0c47b341 service glance] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:42:34.293578 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be46a97-8764-471c-a963-580b0c47b341 service glance] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:42:34.293875 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be46a97-8764-471c-a963-580b0c47b341 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:42:34.295471 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3be46a97-8764-471c-a963-580b0c47b341 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:42:34.348298 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:42:34.403348 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be46a97-8764-471c-a963-580b0c47b341 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:42:34.405031 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be46a97-8764-471c-a963-580b0c47b341 service glance] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:42:34.423487 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 747/1475] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:42:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:42:36.637166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2fc5d-6be7-4c34-8ba6-fb164c42b7a5 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:42:36.637737 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2fc5d-6be7-4c34-8ba6-fb164c42b7a5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:42:36.637737 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2fc5d-6be7-4c34-8ba6-fb164c42b7a5 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:42:36.639039 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 729/1476] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:42:36.644208 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d468dc6-891f-415d-ad45-fb9652d4c526 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:42:36.644645 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d468dc6-891f-415d-ad45-fb9652d4c526 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:42:36.644789 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d468dc6-891f-415d-ad45-fb9652d4c526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:42:36.713117 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-5d468dc6-891f-415d-ad45-fb9652d4c526 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:42:36.714389 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5d468dc6-891f-415d-ad45-fb9652d4c526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:42:36.810118 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 748/1477] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:42:37.081117 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2fc5d-6be7-4c34-8ba6-fb164c42b7a5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:42:37.082744 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b8f2fc5d-6be7-4c34-8ba6-fb164c42b7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:42:37.205046 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2fc5d-6be7-4c34-8ba6-fb164c42b7a5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:42:37.253494 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:42:37.296331 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea097c0-b20b-47b4-a7c6-5fdf7b6bcae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:42:37.296928 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea097c0-b20b-47b4-a7c6-5fdf7b6bcae6 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:42:37.297204 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea097c0-b20b-47b4-a7c6-5fdf7b6bcae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:42:37.297480 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea097c0-b20b-47b4-a7c6-5fdf7b6bcae6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:42:37.298143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea097c0-b20b-47b4-a7c6-5fdf7b6bcae6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:42:37.299864 dv-cinder-857993-1-smb devstack@keystone.service[81776]: WARNING py.warnings [None req-8ea097c0-b20b-47b4-a7c6-5fdf7b6bcae6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 03:42:37.299864 dv-cinder-857993-1-smb devstack@keystone.service[81776]: warnings.warn(msg) Sep 16 03:42:37.299864 dv-cinder-857993-1-smb devstack@keystone.service[81776]: Sep 16 03:42:37.300984 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea097c0-b20b-47b4-a7c6-5fdf7b6bcae6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:42:37.320011 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 730/1478] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 03:42:37 2022] GET /identity/v3/projects => generated 2553 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:42:39.477442 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36c707-d908-4c65-b382-e18a219a5288 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:42:39.478030 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36c707-d908-4c65-b382-e18a219a5288 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:42:39.478030 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36c707-d908-4c65-b382-e18a219a5288 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:42:39.479352 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 749/1479] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:42:39.485172 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f41cc1-b7a8-4c2c-b857-93794d1b05af None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:42:39.485597 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f41cc1-b7a8-4c2c-b857-93794d1b05af None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:42:39.485750 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f41cc1-b7a8-4c2c-b857-93794d1b05af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:42:39.550989 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-90f41cc1-b7a8-4c2c-b857-93794d1b05af None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:42:39.552202 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-90f41cc1-b7a8-4c2c-b857-93794d1b05af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:42:39.645904 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 731/1480] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:42:39.937564 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d36c707-d908-4c65-b382-e18a219a5288 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:42:39.939153 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3d36c707-d908-4c65-b382-e18a219a5288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:42:39.949027 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:42:40.084563 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d36c707-d908-4c65-b382-e18a219a5288 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:42:40.163627 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:42:40.195557 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642232c-38ab-4763-bc2a-ebf6a4587a2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:42:40.196095 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642232c-38ab-4763-bc2a-ebf6a4587a2d service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:42:40.196376 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642232c-38ab-4763-bc2a-ebf6a4587a2d service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:42:40.196647 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642232c-38ab-4763-bc2a-ebf6a4587a2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:42:40.198307 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3642232c-38ab-4763-bc2a-ebf6a4587a2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:42:40.287622 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642232c-38ab-4763-bc2a-ebf6a4587a2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:42:40.289209 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642232c-38ab-4763-bc2a-ebf6a4587a2d service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:42:40.307310 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 750/1481] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:42:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:42:42.608507 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fa53b-9faf-4bb8-8ce0-ab35816df39b None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:42:42.609026 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fa53b-9faf-4bb8-8ce0-ab35816df39b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:42:42.609026 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fa53b-9faf-4bb8-8ce0-ab35816df39b None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:42:42.610516 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 732/1482] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:42:42.615482 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3650757-5bb0-49b7-8d00-2cdcceaeb94c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:42:42.615867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3650757-5bb0-49b7-8d00-2cdcceaeb94c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:42:42.616023 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3650757-5bb0-49b7-8d00-2cdcceaeb94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:42:42.682246 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c3650757-5bb0-49b7-8d00-2cdcceaeb94c None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:42:42.692110 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c3650757-5bb0-49b7-8d00-2cdcceaeb94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:42:42.730170 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:42:42.780531 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 751/1483] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:42:43.068536 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506fa53b-9faf-4bb8-8ce0-ab35816df39b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:42:43.070133 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-506fa53b-9faf-4bb8-8ce0-ab35816df39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:42:43.093462 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:42:43.172255 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506fa53b-9faf-4bb8-8ce0-ab35816df39b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:42:43.245073 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833083a5-1214-4df4-90a3-a89f9a050223 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:42:43.245701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833083a5-1214-4df4-90a3-a89f9a050223 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:42:43.245983 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833083a5-1214-4df4-90a3-a89f9a050223 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:42:43.246254 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833083a5-1214-4df4-90a3-a89f9a050223 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:42:43.247870 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-833083a5-1214-4df4-90a3-a89f9a050223 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:42:43.320918 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:42:43.355777 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833083a5-1214-4df4-90a3-a89f9a050223 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:42:43.357243 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833083a5-1214-4df4-90a3-a89f9a050223 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:42:43.374658 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 733/1484] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:42:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:42:45.569803 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6113b-61d7-4142-af32-bf91a4c255a4 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:42:45.570371 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6113b-61d7-4142-af32-bf91a4c255a4 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:42:45.570371 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6113b-61d7-4142-af32-bf91a4c255a4 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:42:45.571691 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 752/1485] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:42:45.577418 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9b3e2-3ef6-49fb-8a2b-b8557b2efaec None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:42:45.577864 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9b3e2-3ef6-49fb-8a2b-b8557b2efaec None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:42:45.578018 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9b3e2-3ef6-49fb-8a2b-b8557b2efaec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:42:45.642248 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-76f9b3e2-3ef6-49fb-8a2b-b8557b2efaec None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:42:45.643463 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-76f9b3e2-3ef6-49fb-8a2b-b8557b2efaec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:42:45.738651 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 734/1486] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:42:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:42:46.027537 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6113b-61d7-4142-af32-bf91a4c255a4 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:42:46.029343 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-85b6113b-61d7-4142-af32-bf91a4c255a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:42:46.131641 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6113b-61d7-4142-af32-bf91a4c255a4 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:42:46.202809 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:42:46.204323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22edad-838a-40cf-9191-b6ad6df64575 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:42:46.204924 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22edad-838a-40cf-9191-b6ad6df64575 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:42:46.205202 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22edad-838a-40cf-9191-b6ad6df64575 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:42:46.205471 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22edad-838a-40cf-9191-b6ad6df64575 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:42:46.207126 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4b22edad-838a-40cf-9191-b6ad6df64575 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:42:46.316087 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b22edad-838a-40cf-9191-b6ad6df64575 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:42:46.317440 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b22edad-838a-40cf-9191-b6ad6df64575 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:42:46.335373 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 753/1487] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:42:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 03:42:48.560576 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d695d20-6008-4b7e-ab0b-73ebc4c66ef3 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:42:48.561212 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d695d20-6008-4b7e-ab0b-73ebc4c66ef3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:42:48.561212 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d695d20-6008-4b7e-ab0b-73ebc4c66ef3 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:42:48.562564 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 735/1488] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:42:48.567749 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b3ef9-e1a8-4bed-b945-a684a38bd0ef None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:42:48.568158 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b3ef9-e1a8-4bed-b945-a684a38bd0ef None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:42:48.568339 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b3ef9-e1a8-4bed-b945-a684a38bd0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:42:48.634304 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-eb0b3ef9-e1a8-4bed-b945-a684a38bd0ef None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:42:48.635439 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-eb0b3ef9-e1a8-4bed-b945-a684a38bd0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:42:48.687488 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:42:48.731962 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 754/1489] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:42:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:42:49.023001 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d695d20-6008-4b7e-ab0b-73ebc4c66ef3 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:42:49.024578 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2d695d20-6008-4b7e-ab0b-73ebc4c66ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:42:49.060626 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:42:49.126719 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d695d20-6008-4b7e-ab0b-73ebc4c66ef3 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:42:49.199681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843153f-7dea-4377-99e2-7c8b00eb6126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:42:49.200214 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843153f-7dea-4377-99e2-7c8b00eb6126 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:42:49.200493 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843153f-7dea-4377-99e2-7c8b00eb6126 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:42:49.200765 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843153f-7dea-4377-99e2-7c8b00eb6126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:42:49.202406 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3843153f-7dea-4377-99e2-7c8b00eb6126 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:42:49.279256 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:42:49.306861 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843153f-7dea-4377-99e2-7c8b00eb6126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:42:49.308297 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843153f-7dea-4377-99e2-7c8b00eb6126 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:42:49.326258 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 736/1490] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:42:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:42:51.831432 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a392d-41fb-4413-8a9d-1aa3697626e3 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:42:51.832009 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a392d-41fb-4413-8a9d-1aa3697626e3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:42:51.832009 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a392d-41fb-4413-8a9d-1aa3697626e3 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:42:51.833358 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 755/1491] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 03:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:42:51.838529 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69342d-496b-422f-8398-650ebd672fcd None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:42:51.838922 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69342d-496b-422f-8398-650ebd672fcd None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:42:51.839073 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69342d-496b-422f-8398-650ebd672fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:42:51.905333 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3c69342d-496b-422f-8398-650ebd672fcd None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:42:51.906564 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3c69342d-496b-422f-8398-650ebd672fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:42:52.000217 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 737/1492] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 03:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:42:52.297804 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a392d-41fb-4413-8a9d-1aa3697626e3 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:42:52.299385 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-186a392d-41fb-4413-8a9d-1aa3697626e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:42:52.401484 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a392d-41fb-4413-8a9d-1aa3697626e3 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:42:52.474603 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069da293-e7de-4115-a09b-085fb6b34904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:42:52.475205 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069da293-e7de-4115-a09b-085fb6b34904 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:42:52.475485 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069da293-e7de-4115-a09b-085fb6b34904 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:42:52.475755 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069da293-e7de-4115-a09b-085fb6b34904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:42:52.477351 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-069da293-e7de-4115-a09b-085fb6b34904 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:42:52.485692 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:42:52.583873 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069da293-e7de-4115-a09b-085fb6b34904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:42:52.585228 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069da293-e7de-4115-a09b-085fb6b34904 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:42:52.603325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 756/1493] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:42:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 03:43:01.998219 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=82 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:43:02.601168 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=50 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:44:41.465126 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d920b-cfa3-4b72-b45c-c458680a4c0e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:44:41.465771 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d920b-cfa3-4b72-b45c-c458680a4c0e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:44:41.465771 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d920b-cfa3-4b72-b45c-c458680a4c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:44:41.546195 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-218d920b-cfa3-4b72-b45c-c458680a4c0e None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:44:41.547390 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-218d920b-cfa3-4b72-b45c-c458680a4c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:44:41.648451 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 738/1494] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:44:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:44:41.657756 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9ac50-0adc-4759-9b66-92367a93409e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:44:41.658255 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9ac50-0adc-4759-9b66-92367a93409e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:44:41.658356 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9ac50-0adc-4759-9b66-92367a93409e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:44:41.678565 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-45a9ac50-0adc-4759-9b66-92367a93409e None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:44:41.679750 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-45a9ac50-0adc-4759-9b66-92367a93409e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:44:41.688262 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 757/1495] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:44:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:44:41.692776 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d920b-cfa3-4b72-b45c-c458680a4c0e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:44:41.702832 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d920b-cfa3-4b72-b45c-c458680a4c0e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:44:41.706864 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a2d86-d233-4a20-9eed-072384bd7c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:44:41.707459 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a2d86-d233-4a20-9eed-072384bd7c83 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:44:41.707734 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a2d86-d233-4a20-9eed-072384bd7c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:44:41.708003 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a2d86-d233-4a20-9eed-072384bd7c83 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:44:41.708642 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a2d86-d233-4a20-9eed-072384bd7c83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:44:41.708937 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a2d86-d233-4a20-9eed-072384bd7c83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:44:41.709976 dv-cinder-857993-1-smb devstack@keystone.service[81776]: WARNING py.warnings [None req-0a6a2d86-d233-4a20-9eed-072384bd7c83 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 16 03:44:41.709976 dv-cinder-857993-1-smb devstack@keystone.service[81776]: warnings.warn(msg) Sep 16 03:44:41.709976 dv-cinder-857993-1-smb devstack@keystone.service[81776]: Sep 16 03:44:41.710845 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a2d86-d233-4a20-9eed-072384bd7c83 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:44:41.722666 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 739/1496] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:44:41.731504 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9ac50-0adc-4759-9b66-92367a93409e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:44:41.740662 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9ac50-0adc-4759-9b66-92367a93409e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:44:41.745240 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee885c-0ba0-463e-beda-31e78e5f1656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:44:41.745882 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee885c-0ba0-463e-beda-31e78e5f1656 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:44:41.746164 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee885c-0ba0-463e-beda-31e78e5f1656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:44:41.746434 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee885c-0ba0-463e-beda-31e78e5f1656 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:44:41.747072 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee885c-0ba0-463e-beda-31e78e5f1656 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:44:41.748792 dv-cinder-857993-1-smb devstack@keystone.service[81775]: WARNING py.warnings [None req-16ee885c-0ba0-463e-beda-31e78e5f1656 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 03:44:41.748792 dv-cinder-857993-1-smb devstack@keystone.service[81775]: warnings.warn(msg) Sep 16 03:44:41.748792 dv-cinder-857993-1-smb devstack@keystone.service[81775]: Sep 16 03:44:41.750020 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee885c-0ba0-463e-beda-31e78e5f1656 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:44:41.847269 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 758/1497] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:44:41 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:44:41.851603 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a2d86-d233-4a20-9eed-072384bd7c83 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:44:41.861455 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a2d86-d233-4a20-9eed-072384bd7c83 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:44:41.911629 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:44:41.918640 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c73c34-1c62-4722-9710-d7ec74f21647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:44:41.924496 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c73c34-1c62-4722-9710-d7ec74f21647 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:44:41.924496 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c73c34-1c62-4722-9710-d7ec74f21647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:44:41.924496 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c73c34-1c62-4722-9710-d7ec74f21647 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:44:41.924496 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c73c34-1c62-4722-9710-d7ec74f21647 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:44:41.924496 dv-cinder-857993-1-smb devstack@keystone.service[81776]: WARNING py.warnings [None req-63c73c34-1c62-4722-9710-d7ec74f21647 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 03:44:41.924496 dv-cinder-857993-1-smb devstack@keystone.service[81776]: warnings.warn(msg) Sep 16 03:44:41.924496 dv-cinder-857993-1-smb devstack@keystone.service[81776]: Sep 16 03:44:41.925089 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c73c34-1c62-4722-9710-d7ec74f21647 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:44:41.995428 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 740/1498] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:44:41 2022] POST /identity/v3/users => generated 290 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:44:41.998867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee885c-0ba0-463e-beda-31e78e5f1656 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:44:42.009080 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee885c-0ba0-463e-beda-31e78e5f1656 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:44:42.014188 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e288c-952a-42c4-857c-6ae105af755c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:44:42.014784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e288c-952a-42c4-857c-6ae105af755c admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:44:42.015073 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e288c-952a-42c4-857c-6ae105af755c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:44:42.015347 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e288c-952a-42c4-857c-6ae105af755c admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:44:42.015986 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e288c-952a-42c4-857c-6ae105af755c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:44:42.016991 dv-cinder-857993-1-smb devstack@keystone.service[81775]: WARNING py.warnings [None req-e39e288c-952a-42c4-857c-6ae105af755c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 16 03:44:42.016991 dv-cinder-857993-1-smb devstack@keystone.service[81775]: warnings.warn(msg) Sep 16 03:44:42.016991 dv-cinder-857993-1-smb devstack@keystone.service[81775]: Sep 16 03:44:42.017910 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e288c-952a-42c4-857c-6ae105af755c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:44:42.032838 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 759/1499] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:44:42.036804 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c73c34-1c62-4722-9710-d7ec74f21647 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:44:42.047079 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c73c34-1c62-4722-9710-d7ec74f21647 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:44:42.051830 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab590d59-8d3d-4861-b63e-3faf650a9a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:44:42.052431 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab590d59-8d3d-4861-b63e-3faf650a9a8a admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:44:42.052713 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab590d59-8d3d-4861-b63e-3faf650a9a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:44:42.052987 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab590d59-8d3d-4861-b63e-3faf650a9a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:44:42.053622 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab590d59-8d3d-4861-b63e-3faf650a9a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:44:42.054663 dv-cinder-857993-1-smb devstack@keystone.service[81776]: WARNING py.warnings [None req-ab590d59-8d3d-4861-b63e-3faf650a9a8a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 16 03:44:42.054663 dv-cinder-857993-1-smb devstack@keystone.service[81776]: warnings.warn(msg) Sep 16 03:44:42.054663 dv-cinder-857993-1-smb devstack@keystone.service[81776]: Sep 16 03:44:42.055540 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab590d59-8d3d-4861-b63e-3faf650a9a8a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:44:42.068604 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 741/1500] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:44:42.073068 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e288c-952a-42c4-857c-6ae105af755c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:44:42.082925 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e288c-952a-42c4-857c-6ae105af755c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:44:42.087525 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a644af-67b7-4fbf-9031-ea1ee5e6a88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:44:42.088834 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a644af-67b7-4fbf-9031-ea1ee5e6a88e admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:44:42.089116 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a644af-67b7-4fbf-9031-ea1ee5e6a88e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:44:42.089390 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a644af-67b7-4fbf-9031-ea1ee5e6a88e admin admin] PATH_INFO: `/v3/projects/c428227963c2447ebc5e0fdb4637e549/users/f664747e650f4551b5e9afa86c9d4d18/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:44:42.103675 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a644af-67b7-4fbf-9031-ea1ee5e6a88e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c428227963c2447ebc5e0fdb4637e549, user_id=f664747e650f4551b5e9afa86c9d4d18, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:44:42.104707 dv-cinder-857993-1-smb devstack@keystone.service[81775]: WARNING py.warnings [None req-c9a644af-67b7-4fbf-9031-ea1ee5e6a88e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 03:44:42.104707 dv-cinder-857993-1-smb devstack@keystone.service[81775]: warnings.warn(msg) Sep 16 03:44:42.104707 dv-cinder-857993-1-smb devstack@keystone.service[81775]: Sep 16 03:44:42.106655 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a644af-67b7-4fbf-9031-ea1ee5e6a88e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:44:42.172186 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 760/1501] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:44:42 2022] PUT /identity/v3/projects/c428227963c2447ebc5e0fdb4637e549/users/f664747e650f4551b5e9afa86c9d4d18/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:44:42.184839 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c4007-1aca-4e8c-93cb-a931f7d09d6e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:44:42.185197 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c4007-1aca-4e8c-93cb-a931f7d09d6e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:44:42.185543 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c4007-1aca-4e8c-93cb-a931f7d09d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:44:42.213333 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d23c4007-1aca-4e8c-93cb-a931f7d09d6e None None] MFA Rules not processed for user `f664747e650f4551b5e9afa86c9d4d18`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:44:42.214577 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d23c4007-1aca-4e8c-93cb-a931f7d09d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:44:42.277085 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 742/1502] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:44:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:44:42.290755 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b02e7-6dec-493b-b434-3b5ad4df2cf0 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:44:42.291043 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b02e7-6dec-493b-b434-3b5ad4df2cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:44:42.291319 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b02e7-6dec-493b-b434-3b5ad4df2cf0 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:44:42.292647 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 761/1503] 10.222.0.33 () {54 vars in 964 bytes} [Fri Sep 16 03:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:44:42.297484 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cece1dd-a8e1-434e-8f96-0188494f46e0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:44:42.297807 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cece1dd-a8e1-434e-8f96-0188494f46e0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:44:42.298087 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cece1dd-a8e1-434e-8f96-0188494f46e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:44:42.356513 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8cece1dd-a8e1-434e-8f96-0188494f46e0 None None] MFA Rules not processed for user `d193a353763e43d0b5e8b49702f09faa`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:44:42.357766 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8cece1dd-a8e1-434e-8f96-0188494f46e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:44:42.432683 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 743/1504] 10.222.0.33 () {58 vars in 1061 bytes} [Fri Sep 16 03:44:42 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:44:42.440533 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b02e7-6dec-493b-b434-3b5ad4df2cf0 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:44:42.451081 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b02e7-6dec-493b-b434-3b5ad4df2cf0 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:44:42.454604 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f14d76-8691-44db-8951-986d6bd04ac8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:44:42.455192 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f14d76-8691-44db-8951-986d6bd04ac8 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:44:42.455470 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f14d76-8691-44db-8951-986d6bd04ac8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:44:42.455739 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f14d76-8691-44db-8951-986d6bd04ac8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:44:42.464186 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f14d76-8691-44db-8951-986d6bd04ac8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:44:42.465591 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f14d76-8691-44db-8951-986d6bd04ac8 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:44:42.474466 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 762/1505] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:44:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:44:42.519518 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5dd263-e6d0-4812-9212-1bcf05bf4f08 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:44:42.519969 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5dd263-e6d0-4812-9212-1bcf05bf4f08 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:44:42.520070 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5dd263-e6d0-4812-9212-1bcf05bf4f08 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:44:42.521327 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 744/1506] 10.222.0.33 () {52 vars in 830 bytes} [Fri Sep 16 03:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:44:42.524959 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f14d76-8691-44db-8951-986d6bd04ac8 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:44:42.586668 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f14d76-8691-44db-8951-986d6bd04ac8 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:44:42.591807 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94192068-2905-4d44-bf0a-57b1e5bec84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:44:42.592433 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94192068-2905-4d44-bf0a-57b1e5bec84c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:44:42.592716 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94192068-2905-4d44-bf0a-57b1e5bec84c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:44:42.592992 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94192068-2905-4d44-bf0a-57b1e5bec84c admin admin] PATH_INFO: `/v3/users/f664747e650f4551b5e9afa86c9d4d18` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:44:42.594157 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94192068-2905-4d44-bf0a-57b1e5bec84c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f664747e650f4551b5e9afa86c9d4d18)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:44:42.595175 dv-cinder-857993-1-smb devstack@keystone.service[81775]: WARNING py.warnings [None req-94192068-2905-4d44-bf0a-57b1e5bec84c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 03:44:42.595175 dv-cinder-857993-1-smb devstack@keystone.service[81775]: warnings.warn(msg) Sep 16 03:44:42.595175 dv-cinder-857993-1-smb devstack@keystone.service[81775]: Sep 16 03:44:42.596377 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94192068-2905-4d44-bf0a-57b1e5bec84c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:44:42.924769 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-94192068-2905-4d44-bf0a-57b1e5bec84c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f664747e650f4551b5e9afa86c9d4d18'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:44:42.925434 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-94192068-2905-4d44-bf0a-57b1e5bec84c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f664747e650f4551b5e9afa86c9d4d18'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:44:42.940925 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-94192068-2905-4d44-bf0a-57b1e5bec84c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f664747e650f4551b5e9afa86c9d4d18'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:44:42.964624 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-94192068-2905-4d44-bf0a-57b1e5bec84c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f664747e650f4551b5e9afa86c9d4d18'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:44:42.965463 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-94192068-2905-4d44-bf0a-57b1e5bec84c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f664747e650f4551b5e9afa86c9d4d18'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:44:42.969380 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:44:43.034745 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 763/1507] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:44:42 2022] DELETE /identity/v3/users/f664747e650f4551b5e9afa86c9d4d18 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:44:43.039237 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b46586-ec9c-4d49-b14d-cffaeb23e7e5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:44:43.043699 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b46586-ec9c-4d49-b14d-cffaeb23e7e5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:44:43.043699 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b46586-ec9c-4d49-b14d-cffaeb23e7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:44:43.059347 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e9b46586-ec9c-4d49-b14d-cffaeb23e7e5 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:44:43.060562 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e9b46586-ec9c-4d49-b14d-cffaeb23e7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:44:43.069544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:44:43.116669 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 745/1508] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:44:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:44:43.126931 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94192068-2905-4d44-bf0a-57b1e5bec84c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:44:43.128326 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-94192068-2905-4d44-bf0a-57b1e5bec84c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:44:43.206888 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94192068-2905-4d44-bf0a-57b1e5bec84c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:44:43.210516 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d7105-8d97-445c-870c-c603268caae6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:44:43.211128 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d7105-8d97-445c-870c-c603268caae6 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:44:43.211454 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d7105-8d97-445c-870c-c603268caae6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:44:43.211708 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d7105-8d97-445c-870c-c603268caae6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:44:43.223166 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d7105-8d97-445c-870c-c603268caae6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:44:43.224594 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d7105-8d97-445c-870c-c603268caae6 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:44:43.234627 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 764/1509] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:44:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:44:43.852521 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b46586-ec9c-4d49-b14d-cffaeb23e7e5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:44:43.855346 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e9b46586-ec9c-4d49-b14d-cffaeb23e7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:44:43.866160 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b46586-ec9c-4d49-b14d-cffaeb23e7e5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:44:43.872284 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34619ce-3e7f-43be-ba53-f96306a4b25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:44:43.872930 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34619ce-3e7f-43be-ba53-f96306a4b25b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:44:43.873485 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34619ce-3e7f-43be-ba53-f96306a4b25b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:44:43.873669 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34619ce-3e7f-43be-ba53-f96306a4b25b admin admin] PATH_INFO: `/v3/projects/c428227963c2447ebc5e0fdb4637e549` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:44:43.874818 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34619ce-3e7f-43be-ba53-f96306a4b25b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c428227963c2447ebc5e0fdb4637e549)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:44:43.877808 dv-cinder-857993-1-smb devstack@keystone.service[81776]: WARNING py.warnings [None req-b34619ce-3e7f-43be-ba53-f96306a4b25b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 03:44:43.877808 dv-cinder-857993-1-smb devstack@keystone.service[81776]: warnings.warn(msg) Sep 16 03:44:43.877808 dv-cinder-857993-1-smb devstack@keystone.service[81776]: Sep 16 03:44:43.877808 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34619ce-3e7f-43be-ba53-f96306a4b25b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:44:44.028290 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b34619ce-3e7f-43be-ba53-f96306a4b25b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c428227963c2447ebc5e0fdb4637e549', 'request_id': 'req-b34619ce-3e7f-43be-ba53-f96306a4b25b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:44:44.107188 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b34619ce-3e7f-43be-ba53-f96306a4b25b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c428227963c2447ebc5e0fdb4637e549', 'request_id': 'req-b34619ce-3e7f-43be-ba53-f96306a4b25b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:44:44.121400 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b34619ce-3e7f-43be-ba53-f96306a4b25b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c428227963c2447ebc5e0fdb4637e549', 'request_id': 'req-b34619ce-3e7f-43be-ba53-f96306a4b25b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:44:44.132346 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b34619ce-3e7f-43be-ba53-f96306a4b25b admin admin] The token cache is being invalidate because project c428227963c2447ebc5e0fdb4637e549 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:44:44.132633 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b34619ce-3e7f-43be-ba53-f96306a4b25b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:44:44.133363 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b34619ce-3e7f-43be-ba53-f96306a4b25b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:44:44.134861 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 746/1510] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:44:43 2022] DELETE /identity/v3/projects/c428227963c2447ebc5e0fdb4637e549 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:44:53.230843 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:44:54.129402 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:46:16.068778 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da1cbd-6aaa-4786-8993-bdd5bb9db249 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:46:16.069341 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da1cbd-6aaa-4786-8993-bdd5bb9db249 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:46:16.069341 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da1cbd-6aaa-4786-8993-bdd5bb9db249 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:46:16.070652 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 765/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 03:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:46:16.075648 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4dd08-dd21-4a4f-a81e-99d025874722 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:46:16.076106 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4dd08-dd21-4a4f-a81e-99d025874722 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:46:16.076211 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4dd08-dd21-4a4f-a81e-99d025874722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:46:16.095762 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-19b4dd08-dd21-4a4f-a81e-99d025874722 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:46:16.096947 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-19b4dd08-dd21-4a4f-a81e-99d025874722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:46:16.154061 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 747/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 03:46:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:46:16.311434 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da1cbd-6aaa-4786-8993-bdd5bb9db249 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:46:16.314600 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c8da1cbd-6aaa-4786-8993-bdd5bb9db249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:46:16.416454 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da1cbd-6aaa-4786-8993-bdd5bb9db249 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:46:16.421958 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477160c-9c39-436a-9ede-ee8930eaaf49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:46:16.422561 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477160c-9c39-436a-9ede-ee8930eaaf49 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:46:16.422845 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477160c-9c39-436a-9ede-ee8930eaaf49 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:46:16.423123 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477160c-9c39-436a-9ede-ee8930eaaf49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:46:16.431856 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6477160c-9c39-436a-9ede-ee8930eaaf49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:46:16.433435 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6477160c-9c39-436a-9ede-ee8930eaaf49 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:46:16.442863 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 766/1513] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:46:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:46:17.520641 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae05fdf-d4b7-43e7-a352-42c02dc3fa15 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:46:17.521180 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae05fdf-d4b7-43e7-a352-42c02dc3fa15 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:46:17.521303 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae05fdf-d4b7-43e7-a352-42c02dc3fa15 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:46:17.522611 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 748/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 03:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:46:17.529501 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0ace3-ebb5-444f-a72f-3583566e900a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:46:17.530001 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0ace3-ebb5-444f-a72f-3583566e900a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:46:17.530107 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0ace3-ebb5-444f-a72f-3583566e900a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:46:17.549869 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-25a0ace3-ebb5-444f-a72f-3583566e900a None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:46:17.551068 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-25a0ace3-ebb5-444f-a72f-3583566e900a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:46:17.558976 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 767/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 03:46:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:46:17.712581 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae05fdf-d4b7-43e7-a352-42c02dc3fa15 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:46:17.726846 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae05fdf-d4b7-43e7-a352-42c02dc3fa15 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:46:17.734047 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa898e-4849-45eb-bb30-95df70044429 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:46:17.734717 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa898e-4849-45eb-bb30-95df70044429 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:46:17.735006 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa898e-4849-45eb-bb30-95df70044429 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:46:17.735282 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa898e-4849-45eb-bb30-95df70044429 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:46:17.743870 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa898e-4849-45eb-bb30-95df70044429 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:46:17.745469 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa898e-4849-45eb-bb30-95df70044429 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:46:17.755163 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 749/1516] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:46:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:46:18.075928 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8e04a-b0fc-4563-9175-e3fa18617a1c None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:46:18.076119 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8e04a-b0fc-4563-9175-e3fa18617a1c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:46:18.076396 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8e04a-b0fc-4563-9175-e3fa18617a1c None None] PATH_INFO: `/v3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:46:18.077738 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 768/1517] 10.222.0.26 () {54 vars in 925 bytes} [Fri Sep 16 03:46:18 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:46:18.084115 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44351e5-0163-468d-bfee-7a914464ec44 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:46:18.084407 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44351e5-0163-468d-bfee-7a914464ec44 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:46:18.084715 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44351e5-0163-468d-bfee-7a914464ec44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:46:18.133373 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f44351e5-0163-468d-bfee-7a914464ec44 None None] MFA Rules not processed for user `c39fd09bea1a40babc5f629612c6702b`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:46:18.134605 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f44351e5-0163-468d-bfee-7a914464ec44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:46:18.204159 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 750/1518] 10.222.0.26 () {58 vars in 1015 bytes} [Fri Sep 16 03:46:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:46:21.973581 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c4afd-f64d-4678-ba92-c26261da2310 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:46:21.974104 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c4afd-f64d-4678-ba92-c26261da2310 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:46:21.974201 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c4afd-f64d-4678-ba92-c26261da2310 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:46:21.975509 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 769/1519] 10.222.0.33 () {54 vars in 961 bytes} [Fri Sep 16 03:46:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:46:21.981330 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fed50-47c6-4d90-81fd-e25e4c647247 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:46:21.981794 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fed50-47c6-4d90-81fd-e25e4c647247 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:46:21.981928 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fed50-47c6-4d90-81fd-e25e4c647247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:46:22.001703 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a56fed50-47c6-4d90-81fd-e25e4c647247 None None] MFA Rules not processed for user `c39fd09bea1a40babc5f629612c6702b`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:46:22.002903 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a56fed50-47c6-4d90-81fd-e25e4c647247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:46:22.011491 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 751/1520] 10.222.0.33 () {58 vars in 1058 bytes} [Fri Sep 16 03:46:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:46:22.019229 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c4afd-f64d-4678-ba92-c26261da2310 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:46:22.033248 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c4afd-f64d-4678-ba92-c26261da2310 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:46:22.038155 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f39526-4ea3-4d42-85d9-b7e8a98f1888 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c39fd09bea1a40babc5f629612c6702b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:46:22.038748 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f39526-4ea3-4d42-85d9-b7e8a98f1888 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:46:22.039028 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f39526-4ea3-4d42-85d9-b7e8a98f1888 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:46:22.039982 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f39526-4ea3-4d42-85d9-b7e8a98f1888 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:46:22.048691 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f39526-4ea3-4d42-85d9-b7e8a98f1888 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:46:22.050307 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f39526-4ea3-4d42-85d9-b7e8a98f1888 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:46:22.059890 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 770/1521] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:46:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:46:29.229344 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e4b9a-d41b-4967-a26d-f53b95f59c1c None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:46:29.229922 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e4b9a-d41b-4967-a26d-f53b95f59c1c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:46:29.230216 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e4b9a-d41b-4967-a26d-f53b95f59c1c None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:46:29.231567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 752/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 03:46:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:46:29.237989 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15531372-c010-4bf6-b257-76f7e7372be6 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:46:29.238426 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15531372-c010-4bf6-b257-76f7e7372be6 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:46:29.238540 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15531372-c010-4bf6-b257-76f7e7372be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:46:29.260510 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-15531372-c010-4bf6-b257-76f7e7372be6 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:46:29.261739 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-15531372-c010-4bf6-b257-76f7e7372be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:46:29.269491 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 771/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 03:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:46:29.426648 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e4b9a-d41b-4967-a26d-f53b95f59c1c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:46:29.440966 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e4b9a-d41b-4967-a26d-f53b95f59c1c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:46:29.446450 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ecf7f3-721f-46bc-ae03-daf358540fb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:46:29.447035 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ecf7f3-721f-46bc-ae03-daf358540fb7 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:46:29.447314 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ecf7f3-721f-46bc-ae03-daf358540fb7 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:46:29.447586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ecf7f3-721f-46bc-ae03-daf358540fb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:46:29.455572 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ecf7f3-721f-46bc-ae03-daf358540fb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:46:29.457151 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ecf7f3-721f-46bc-ae03-daf358540fb7 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:46:29.467183 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 753/1524] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:46:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:46:30.534527 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ab98c-7765-4ec9-9b11-b28020e6847d None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:46:30.535041 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ab98c-7765-4ec9-9b11-b28020e6847d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:46:30.535149 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ab98c-7765-4ec9-9b11-b28020e6847d None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:46:30.536427 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 772/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 03:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:46:30.542567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a2ca9-a21d-4058-8f0c-d349b3f10c26 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:46:30.542972 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a2ca9-a21d-4058-8f0c-d349b3f10c26 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:46:30.543126 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a2ca9-a21d-4058-8f0c-d349b3f10c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:46:30.562128 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3e5a2ca9-a21d-4058-8f0c-d349b3f10c26 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:46:30.563303 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3e5a2ca9-a21d-4058-8f0c-d349b3f10c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:46:30.571479 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 754/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 03:46:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:46:30.724686 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ab98c-7765-4ec9-9b11-b28020e6847d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:46:30.738797 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ab98c-7765-4ec9-9b11-b28020e6847d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:46:30.744221 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f1de6-b2f7-466e-8e9c-aa416b3dc56d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:46:30.747130 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f1de6-b2f7-466e-8e9c-aa416b3dc56d service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:46:30.747130 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f1de6-b2f7-466e-8e9c-aa416b3dc56d service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:46:30.747130 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f1de6-b2f7-466e-8e9c-aa416b3dc56d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:46:30.753827 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f1de6-b2f7-466e-8e9c-aa416b3dc56d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:46:30.755008 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f1de6-b2f7-466e-8e9c-aa416b3dc56d service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:46:30.764978 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 773/1527] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:46:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:46:34.633263 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d76da5-2d4e-44bd-9833-03562e260590 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:46:34.633843 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d76da5-2d4e-44bd-9833-03562e260590 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:46:34.633843 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d76da5-2d4e-44bd-9833-03562e260590 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:46:34.635171 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 755/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 03:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:46:34.640605 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a231d-19e2-472b-803a-dcb60c6dca77 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:46:34.641019 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a231d-19e2-472b-803a-dcb60c6dca77 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:46:34.641153 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a231d-19e2-472b-803a-dcb60c6dca77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:46:34.660907 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b60a231d-19e2-472b-803a-dcb60c6dca77 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:46:34.662137 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b60a231d-19e2-472b-803a-dcb60c6dca77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:46:34.671490 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 774/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 03:46:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:46:34.960145 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d76da5-2d4e-44bd-9833-03562e260590 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:46:34.962384 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-55d76da5-2d4e-44bd-9833-03562e260590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:46:34.989881 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:46:35.018160 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d76da5-2d4e-44bd-9833-03562e260590 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:46:35.021613 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf304c8-a524-4d28-9e39-3e950144e9a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:46:35.022240 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf304c8-a524-4d28-9e39-3e950144e9a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:46:35.022519 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf304c8-a524-4d28-9e39-3e950144e9a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:46:35.022791 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf304c8-a524-4d28-9e39-3e950144e9a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:46:35.033188 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf304c8-a524-4d28-9e39-3e950144e9a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:46:35.034640 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf304c8-a524-4d28-9e39-3e950144e9a5 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:46:35.043719 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 756/1530] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:46:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:46:37.195709 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51675a11-bd80-4f9a-9e87-6ce5dba59ec3 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:46:37.196360 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51675a11-bd80-4f9a-9e87-6ce5dba59ec3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:46:37.196360 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51675a11-bd80-4f9a-9e87-6ce5dba59ec3 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:46:37.197465 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 775/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 03:46:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:46:37.202645 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128cf98-36d5-4b60-86f0-ce33104441e9 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:46:37.203051 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128cf98-36d5-4b60-86f0-ce33104441e9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:46:37.203194 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128cf98-36d5-4b60-86f0-ce33104441e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:46:37.223054 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6128cf98-36d5-4b60-86f0-ce33104441e9 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:46:37.224234 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6128cf98-36d5-4b60-86f0-ce33104441e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:46:37.232069 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 757/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 03:46:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:46:37.522547 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51675a11-bd80-4f9a-9e87-6ce5dba59ec3 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:46:37.534023 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51675a11-bd80-4f9a-9e87-6ce5dba59ec3 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:46:37.537521 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d704fd-ed7e-40b9-9bcf-d2abc8d0d9ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:46:37.538151 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d704fd-ed7e-40b9-9bcf-d2abc8d0d9ab service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:46:37.538430 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d704fd-ed7e-40b9-9bcf-d2abc8d0d9ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:46:37.538704 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d704fd-ed7e-40b9-9bcf-d2abc8d0d9ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:46:37.547339 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d704fd-ed7e-40b9-9bcf-d2abc8d0d9ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:46:37.548800 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d704fd-ed7e-40b9-9bcf-d2abc8d0d9ab service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:46:37.558483 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 776/1533] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:46:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:46:41.174119 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12298f-7780-4910-8bb7-4f2851695c2d None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:46:41.174685 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12298f-7780-4910-8bb7-4f2851695c2d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:46:41.174685 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12298f-7780-4910-8bb7-4f2851695c2d None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:46:41.176007 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 758/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 03:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:46:41.181956 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9505613-22de-4e07-badf-496564305cf8 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:46:41.182404 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9505613-22de-4e07-badf-496564305cf8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:46:41.182515 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9505613-22de-4e07-badf-496564305cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:46:41.202479 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a9505613-22de-4e07-badf-496564305cf8 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:46:41.203663 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a9505613-22de-4e07-badf-496564305cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:46:41.211261 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 777/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 03:46:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:46:41.511942 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12298f-7780-4910-8bb7-4f2851695c2d None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:46:41.513821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-aa12298f-7780-4910-8bb7-4f2851695c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:46:41.570450 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12298f-7780-4910-8bb7-4f2851695c2d None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:46:41.573954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592050c7-c35e-4803-8a10-e5df82a7ab5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:46:41.574556 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592050c7-c35e-4803-8a10-e5df82a7ab5f service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:46:41.574837 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592050c7-c35e-4803-8a10-e5df82a7ab5f service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:46:41.575112 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592050c7-c35e-4803-8a10-e5df82a7ab5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:46:41.583727 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592050c7-c35e-4803-8a10-e5df82a7ab5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:46:41.585153 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592050c7-c35e-4803-8a10-e5df82a7ab5f service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:46:41.594838 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 759/1536] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:46:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:46:43.725795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea40b0c-3094-49ba-bb95-2ad35d49663b None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:46:43.726265 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea40b0c-3094-49ba-bb95-2ad35d49663b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:46:43.726371 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea40b0c-3094-49ba-bb95-2ad35d49663b None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:46:43.727757 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 778/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 03:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 03:46:43.733027 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d61b88-866b-42cf-add2-b70db1e9b4fa None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:46:43.733419 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d61b88-866b-42cf-add2-b70db1e9b4fa None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:46:43.733575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d61b88-866b-42cf-add2-b70db1e9b4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:46:43.754360 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-28d61b88-866b-42cf-add2-b70db1e9b4fa None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:46:43.755560 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-28d61b88-866b-42cf-add2-b70db1e9b4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:46:43.763892 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 760/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 03:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:46:44.061835 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea40b0c-3094-49ba-bb95-2ad35d49663b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:46:44.063572 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2ea40b0c-3094-49ba-bb95-2ad35d49663b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:46:44.071263 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=77 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:46:44.077216 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea40b0c-3094-49ba-bb95-2ad35d49663b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:46:44.087838 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eeaca4-e318-411f-a8ff-dde0bdb99384 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:46:44.087838 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eeaca4-e318-411f-a8ff-dde0bdb99384 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:46:44.087838 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eeaca4-e318-411f-a8ff-dde0bdb99384 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:46:44.087838 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eeaca4-e318-411f-a8ff-dde0bdb99384 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:46:44.090876 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eeaca4-e318-411f-a8ff-dde0bdb99384 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:46:44.092405 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eeaca4-e318-411f-a8ff-dde0bdb99384 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:46:44.102236 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 779/1539] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:46:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:46:53.749458 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=47 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:46:54.103769 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:10.126231 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55da97-6347-4423-a3f6-2c4cb5e201e9 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:10.127459 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55da97-6347-4423-a3f6-2c4cb5e201e9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:10.127769 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55da97-6347-4423-a3f6-2c4cb5e201e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:10.154329 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2f55da97-6347-4423-a3f6-2c4cb5e201e9 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:10.155606 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2f55da97-6347-4423-a3f6-2c4cb5e201e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:10.167779 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 761/1540] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:10.180531 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed81e2-4b70-49e2-be9a-ae9d4a4a77af None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:10.181484 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed81e2-4b70-49e2-be9a-ae9d4a4a77af None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:10.182042 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed81e2-4b70-49e2-be9a-ae9d4a4a77af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:10.215631 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-5bed81e2-4b70-49e2-be9a-ae9d4a4a77af None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:10.217138 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5bed81e2-4b70-49e2-be9a-ae9d4a4a77af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:10.229461 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 780/1541] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:10.234068 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55da97-6347-4423-a3f6-2c4cb5e201e9 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:10.247585 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55da97-6347-4423-a3f6-2c4cb5e201e9 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:10.254097 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56ae60-42bf-4c70-a11c-2054b6235576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:10.254743 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56ae60-42bf-4c70-a11c-2054b6235576 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:10.255025 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56ae60-42bf-4c70-a11c-2054b6235576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:10.255302 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56ae60-42bf-4c70-a11c-2054b6235576 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:10.255980 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d56ae60-42bf-4c70-a11c-2054b6235576 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:48:10.256292 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d56ae60-42bf-4c70-a11c-2054b6235576 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:10.258098 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d56ae60-42bf-4c70-a11c-2054b6235576 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:10.276392 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 762/1542] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:48:10.291962 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed81e2-4b70-49e2-be9a-ae9d4a4a77af None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:10.307774 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed81e2-4b70-49e2-be9a-ae9d4a4a77af None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:10.317268 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34908faa-811a-483e-adda-b52d5e67ec57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:10.317923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34908faa-811a-483e-adda-b52d5e67ec57 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:10.318209 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34908faa-811a-483e-adda-b52d5e67ec57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:10.318484 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34908faa-811a-483e-adda-b52d5e67ec57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:10.319128 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34908faa-811a-483e-adda-b52d5e67ec57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:10.321064 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34908faa-811a-483e-adda-b52d5e67ec57 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:10.353456 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf817870-f224-4f4f-98eb-c49fa56db97f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:10.355485 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf817870-f224-4f4f-98eb-c49fa56db97f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:10.355485 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf817870-f224-4f4f-98eb-c49fa56db97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:10.390760 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-cf817870-f224-4f4f-98eb-c49fa56db97f None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:10.390760 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cf817870-f224-4f4f-98eb-c49fa56db97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:10.395792 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 763/1543] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:10.405402 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18390087-df75-4598-a76a-7f7b6f34bc95 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:10.405768 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18390087-df75-4598-a76a-7f7b6f34bc95 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:10.406003 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18390087-df75-4598-a76a-7f7b6f34bc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:10.420259 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 781/1544] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:48:10 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:10.425321 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34908faa-811a-483e-adda-b52d5e67ec57 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:10.447451 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-18390087-df75-4598-a76a-7f7b6f34bc95 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:10.448832 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-18390087-df75-4598-a76a-7f7b6f34bc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:10.562618 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34908faa-811a-483e-adda-b52d5e67ec57 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:10.571771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965b180-6145-4434-a2d3-35bb32cfcd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:10.572509 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965b180-6145-4434-a2d3-35bb32cfcd2e admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:10.572793 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965b180-6145-4434-a2d3-35bb32cfcd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:10.573059 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965b180-6145-4434-a2d3-35bb32cfcd2e admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:10.573720 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965b180-6145-4434-a2d3-35bb32cfcd2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:10.574650 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 764/1545] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:48:10.574798 dv-cinder-857993-1-smb devstack@keystone.service[81775]: WARNING py.warnings [None req-1965b180-6145-4434-a2d3-35bb32cfcd2e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 03:48:10.574798 dv-cinder-857993-1-smb devstack@keystone.service[81775]: warnings.warn(msg) Sep 16 03:48:10.574798 dv-cinder-857993-1-smb devstack@keystone.service[81775]: Sep 16 03:48:10.575908 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965b180-6145-4434-a2d3-35bb32cfcd2e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:10.576061 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e130a4-a03e-4c6b-bb72-8ce0deaaa5c1 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:10.576238 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e130a4-a03e-4c6b-bb72-8ce0deaaa5c1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:10.576489 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e130a4-a03e-4c6b-bb72-8ce0deaaa5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:10.616112 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-01e130a4-a03e-4c6b-bb72-8ce0deaaa5c1 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:10.617426 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-01e130a4-a03e-4c6b-bb72-8ce0deaaa5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:10.626870 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 765/1546] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:10.627668 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e130a4-a03e-4c6b-bb72-8ce0deaaa5c1 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:10.638734 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e130a4-a03e-4c6b-bb72-8ce0deaaa5c1 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:10.643919 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07389123-6c1c-4911-856e-92a3b3f75575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:10.644465 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07389123-6c1c-4911-856e-92a3b3f75575 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:10.644746 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07389123-6c1c-4911-856e-92a3b3f75575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:10.645021 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07389123-6c1c-4911-856e-92a3b3f75575 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:10.645934 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07389123-6c1c-4911-856e-92a3b3f75575 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:48:10.648388 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07389123-6c1c-4911-856e-92a3b3f75575 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:10.648564 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07389123-6c1c-4911-856e-92a3b3f75575 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:10.662082 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 766/1547] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:48:10.663377 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841fdc5-7307-4c87-bf73-94faf4eb5920 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:10.663662 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841fdc5-7307-4c87-bf73-94faf4eb5920 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:10.663936 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841fdc5-7307-4c87-bf73-94faf4eb5920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:10.685751 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5841fdc5-7307-4c87-bf73-94faf4eb5920 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:10.687421 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5841fdc5-7307-4c87-bf73-94faf4eb5920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:10.689810 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 782/1548] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:48:10 2022] POST /identity/v3/users => generated 293 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:10.691155 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607faf7-7ed3-4bf6-a17f-77c93bb6f2e0 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:10.691444 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607faf7-7ed3-4bf6-a17f-77c93bb6f2e0 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:10.691718 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607faf7-7ed3-4bf6-a17f-77c93bb6f2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:10.714246 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 767/1549] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:10.715536 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7b769-5000-4249-a8f7-882e4b1af363 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:10.715817 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7b769-5000-4249-a8f7-882e4b1af363 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:10.716096 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7b769-5000-4249-a8f7-882e4b1af363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:10.739576 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b607faf7-7ed3-4bf6-a17f-77c93bb6f2e0 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:10.740484 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b607faf7-7ed3-4bf6-a17f-77c93bb6f2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:10.750166 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 783/1550] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:10.750975 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607faf7-7ed3-4bf6-a17f-77c93bb6f2e0 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:10.756296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4cf7b769-5000-4249-a8f7-882e4b1af363 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:10.758127 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4cf7b769-5000-4249-a8f7-882e4b1af363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:10.766539 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607faf7-7ed3-4bf6-a17f-77c93bb6f2e0 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:10.773335 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 768/1551] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:10.773335 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7b769-5000-4249-a8f7-882e4b1af363 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:10.773574 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7f6fc-5d9d-4de5-95cf-db672c4ff626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:10.773574 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7f6fc-5d9d-4de5-95cf-db672c4ff626 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:10.773574 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7f6fc-5d9d-4de5-95cf-db672c4ff626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:10.773574 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7f6fc-5d9d-4de5-95cf-db672c4ff626 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:10.773968 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e7f6fc-5d9d-4de5-95cf-db672c4ff626 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:10.775233 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e7f6fc-5d9d-4de5-95cf-db672c4ff626 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:10.778779 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7b769-5000-4249-a8f7-882e4b1af363 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:10.783458 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7661a-ef96-483d-871e-2d1b01113fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:10.784052 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7661a-ef96-483d-871e-2d1b01113fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:10.784333 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7661a-ef96-483d-871e-2d1b01113fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:10.784608 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7661a-ef96-483d-871e-2d1b01113fa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:10.785243 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7661a-ef96-483d-871e-2d1b01113fa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:10.786865 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7661a-ef96-483d-871e-2d1b01113fa1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:10.798068 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 769/1552] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:10.799363 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc8c29-0b0b-4434-a78c-4bdceb382843 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:10.799643 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc8c29-0b0b-4434-a78c-4bdceb382843 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:10.799917 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc8c29-0b0b-4434-a78c-4bdceb382843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:10.819467 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-dddc8c29-0b0b-4434-a78c-4bdceb382843 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:10.820659 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-dddc8c29-0b0b-4434-a78c-4bdceb382843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:10.828761 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 770/1553] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:10.830143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed7b6d-9d88-4de2-83c5-b31502f6b43e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:10.830428 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed7b6d-9d88-4de2-83c5-b31502f6b43e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:10.830703 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed7b6d-9d88-4de2-83c5-b31502f6b43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:10.850287 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-fbed7b6d-9d88-4de2-83c5-b31502f6b43e None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:10.851990 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fbed7b6d-9d88-4de2-83c5-b31502f6b43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:10.859945 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 771/1554] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:10.861299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5948b5a-b06e-4c5e-8613-447289aeeb64 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:10.861583 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5948b5a-b06e-4c5e-8613-447289aeeb64 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:10.861921 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5948b5a-b06e-4c5e-8613-447289aeeb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:10.880972 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a5948b5a-b06e-4c5e-8613-447289aeeb64 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:10.882752 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a5948b5a-b06e-4c5e-8613-447289aeeb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:10.890563 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 772/1555] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:10.891827 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacceb3-1eac-4e70-b20e-8f8f74a62646 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:10.892119 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacceb3-1eac-4e70-b20e-8f8f74a62646 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:10.892398 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacceb3-1eac-4e70-b20e-8f8f74a62646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:10.909725 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 784/1556] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:48:10 2022] POST /identity/v3/projects => generated 363 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:10.909725 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def4a16-0336-4b9a-b2ff-52173dc55c38 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:10.909725 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def4a16-0336-4b9a-b2ff-52173dc55c38 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:10.909725 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def4a16-0336-4b9a-b2ff-52173dc55c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:10.913182 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ceacceb3-1eac-4e70-b20e-8f8f74a62646 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:10.914419 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ceacceb3-1eac-4e70-b20e-8f8f74a62646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:10.927926 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4def4a16-0336-4b9a-b2ff-52173dc55c38 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:10.929749 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4def4a16-0336-4b9a-b2ff-52173dc55c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:10.975781 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 773/1557] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:10.977122 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceacceb3-1eac-4e70-b20e-8f8f74a62646 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:10.986305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceacceb3-1eac-4e70-b20e-8f8f74a62646 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:10.989862 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 785/1558] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:10.990933 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cfbf4b-65bd-450c-8981-9ea3607a4424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:10.991531 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cfbf4b-65bd-450c-8981-9ea3607a4424 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:10.991809 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cfbf4b-65bd-450c-8981-9ea3607a4424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:10.992080 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cfbf4b-65bd-450c-8981-9ea3607a4424 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:10.992757 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cfbf4b-65bd-450c-8981-9ea3607a4424 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:48:10.993055 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cfbf4b-65bd-450c-8981-9ea3607a4424 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:10.994557 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def4a16-0336-4b9a-b2ff-52173dc55c38 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:10.994712 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cfbf4b-65bd-450c-8981-9ea3607a4424 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:11.001999 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:11.005540 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def4a16-0336-4b9a-b2ff-52173dc55c38 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:11.006849 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 774/1559] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:48:11.008041 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9941d04-648d-40bd-9c98-4b242f79df81 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:11.008319 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9941d04-648d-40bd-9c98-4b242f79df81 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:11.008597 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9941d04-648d-40bd-9c98-4b242f79df81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:11.017582 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1c9f0-4742-4251-9ab4-baf61117334a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:11.018263 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1c9f0-4742-4251-9ab4-baf61117334a admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:11.018542 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1c9f0-4742-4251-9ab4-baf61117334a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:11.018819 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1c9f0-4742-4251-9ab4-baf61117334a admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:11.019486 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1c9f0-4742-4251-9ab4-baf61117334a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:11.021130 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1c9f0-4742-4251-9ab4-baf61117334a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:11.031449 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a9941d04-648d-40bd-9c98-4b242f79df81 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:11.031980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 786/1560] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:11.032664 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a9941d04-648d-40bd-9c98-4b242f79df81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:11.032778 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1c9f0-4742-4251-9ab4-baf61117334a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:11.040713 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 775/1561] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:11.041946 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afce907-c6a4-4040-af89-46f7f0db4357 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:11.042235 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afce907-c6a4-4040-af89-46f7f0db4357 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:11.042511 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afce907-c6a4-4040-af89-46f7f0db4357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:11.046918 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1c9f0-4742-4251-9ab4-baf61117334a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:11.052297 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50014317-ae59-43af-80b4-fdca2bef106f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:11.052894 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50014317-ae59-43af-80b4-fdca2bef106f admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:11.053173 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50014317-ae59-43af-80b4-fdca2bef106f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:11.053445 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50014317-ae59-43af-80b4-fdca2bef106f admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:11.054726 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50014317-ae59-43af-80b4-fdca2bef106f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:48:11.055026 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50014317-ae59-43af-80b4-fdca2bef106f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:11.056021 dv-cinder-857993-1-smb devstack@keystone.service[81775]: WARNING py.warnings [None req-50014317-ae59-43af-80b4-fdca2bef106f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 16 03:48:11.056021 dv-cinder-857993-1-smb devstack@keystone.service[81775]: warnings.warn(msg) Sep 16 03:48:11.056021 dv-cinder-857993-1-smb devstack@keystone.service[81775]: Sep 16 03:48:11.056898 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50014317-ae59-43af-80b4-fdca2bef106f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:11.062298 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5afce907-c6a4-4040-af89-46f7f0db4357 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:11.063484 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5afce907-c6a4-4040-af89-46f7f0db4357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:11.068869 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 787/1562] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:48:11.069982 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50014317-ae59-43af-80b4-fdca2bef106f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:11.077381 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 776/1563] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:11.078215 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afce907-c6a4-4040-af89-46f7f0db4357 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:11.088683 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50014317-ae59-43af-80b4-fdca2bef106f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:11.088947 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afce907-c6a4-4040-af89-46f7f0db4357 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:11.093356 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27879181-ecf5-45df-8346-4b864b9922ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:11.099006 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14cf38-e860-4b8c-a614-802ee24e9884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:11.099152 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27879181-ecf5-45df-8346-4b864b9922ea admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:11.099269 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14cf38-e860-4b8c-a614-802ee24e9884 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:11.099368 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27879181-ecf5-45df-8346-4b864b9922ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:11.099462 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14cf38-e860-4b8c-a614-802ee24e9884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:11.099618 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27879181-ecf5-45df-8346-4b864b9922ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:11.099722 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14cf38-e860-4b8c-a614-802ee24e9884 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:11.099836 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27879181-ecf5-45df-8346-4b864b9922ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:48:11.099931 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14cf38-e860-4b8c-a614-802ee24e9884 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:11.100044 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27879181-ecf5-45df-8346-4b864b9922ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:11.100044 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27879181-ecf5-45df-8346-4b864b9922ea admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:11.100225 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14cf38-e860-4b8c-a614-802ee24e9884 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:11.106353 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:11.110244 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 777/1564] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:48:11.111464 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab2362-99e5-4590-8ea5-3d00a3b18aa0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:11.111783 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab2362-99e5-4590-8ea5-3d00a3b18aa0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:11.112026 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab2362-99e5-4590-8ea5-3d00a3b18aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:11.132085 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-62ab2362-99e5-4590-8ea5-3d00a3b18aa0 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:11.134781 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-62ab2362-99e5-4590-8ea5-3d00a3b18aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:11.141257 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 778/1565] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:11.142015 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab2362-99e5-4590-8ea5-3d00a3b18aa0 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:11.151693 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab2362-99e5-4590-8ea5-3d00a3b18aa0 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:11.156719 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041cab4-eaa9-4683-a3eb-21927dbe0f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:11.157291 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041cab4-eaa9-4683-a3eb-21927dbe0f27 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:11.157569 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041cab4-eaa9-4683-a3eb-21927dbe0f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:11.157875 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041cab4-eaa9-4683-a3eb-21927dbe0f27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:11.158494 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7041cab4-eaa9-4683-a3eb-21927dbe0f27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:11.159513 dv-cinder-857993-1-smb devstack@keystone.service[81776]: WARNING py.warnings [None req-7041cab4-eaa9-4683-a3eb-21927dbe0f27 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 03:48:11.159513 dv-cinder-857993-1-smb devstack@keystone.service[81776]: warnings.warn(msg) Sep 16 03:48:11.159513 dv-cinder-857993-1-smb devstack@keystone.service[81776]: Sep 16 03:48:11.160775 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7041cab4-eaa9-4683-a3eb-21927dbe0f27 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:11.352099 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 788/1566] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:48:11 2022] POST /identity/v3/users => generated 282 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:11.352099 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14cf38-e860-4b8c-a614-802ee24e9884 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:11.352738 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 779/1567] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:48:11 2022] POST /identity/v3/projects => generated 385 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:11.352738 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041cab4-eaa9-4683-a3eb-21927dbe0f27 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:11.362475 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14cf38-e860-4b8c-a614-802ee24e9884 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:11.416242 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041cab4-eaa9-4683-a3eb-21927dbe0f27 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:11.420833 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cf3b0-1dc6-4ddc-abe0-2413f18406f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:11.421473 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cf3b0-1dc6-4ddc-abe0-2413f18406f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:11.421698 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be24f5-13d1-4fd0-92ff-eb64949ccf0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:11.421819 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cf3b0-1dc6-4ddc-abe0-2413f18406f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:11.422125 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cf3b0-1dc6-4ddc-abe0-2413f18406f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:11.422419 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be24f5-13d1-4fd0-92ff-eb64949ccf0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:11.422697 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316cf3b0-1dc6-4ddc-abe0-2413f18406f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:48:11.422834 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be24f5-13d1-4fd0-92ff-eb64949ccf0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:11.423005 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316cf3b0-1dc6-4ddc-abe0-2413f18406f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:11.423174 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be24f5-13d1-4fd0-92ff-eb64949ccf0b admin admin] PATH_INFO: `/v3/projects/f6d1a4d6749a484f8cb0f78bc77b179c/users/6efa7a654e2d4e3e9066aa361460729d/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:11.424630 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316cf3b0-1dc6-4ddc-abe0-2413f18406f1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:11.436796 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 780/1568] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:48:11.437767 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cf3b0-1dc6-4ddc-abe0-2413f18406f1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:11.439266 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77be24f5-13d1-4fd0-92ff-eb64949ccf0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6d1a4d6749a484f8cb0f78bc77b179c, user_id=6efa7a654e2d4e3e9066aa361460729d, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:11.442101 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77be24f5-13d1-4fd0-92ff-eb64949ccf0b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:11.447356 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cf3b0-1dc6-4ddc-abe0-2413f18406f1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:11.451926 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b3ddc-c7ac-41b0-910a-99bd5d70c150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:11.452514 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b3ddc-c7ac-41b0-910a-99bd5d70c150 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:11.452793 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b3ddc-c7ac-41b0-910a-99bd5d70c150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:11.453064 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b3ddc-c7ac-41b0-910a-99bd5d70c150 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:11.453718 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b3ddc-c7ac-41b0-910a-99bd5d70c150 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:11.455617 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b3ddc-c7ac-41b0-910a-99bd5d70c150 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:11.593709 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 789/1569] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:48:11 2022] PUT /identity/v3/projects/f6d1a4d6749a484f8cb0f78bc77b179c/users/6efa7a654e2d4e3e9066aa361460729d/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:11.594546 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be24f5-13d1-4fd0-92ff-eb64949ccf0b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:11.628284 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 781/1570] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:48:11 2022] POST /identity/v3/projects => generated 379 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:11.628284 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b3ddc-c7ac-41b0-910a-99bd5d70c150 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:11.658465 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be24f5-13d1-4fd0-92ff-eb64949ccf0b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:11.688233 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b3ddc-c7ac-41b0-910a-99bd5d70c150 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:11.694013 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f458e-1726-4a57-8807-d1725f4c7927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:11.695198 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f458e-1726-4a57-8807-d1725f4c7927 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:11.695484 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f458e-1726-4a57-8807-d1725f4c7927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:11.695758 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f458e-1726-4a57-8807-d1725f4c7927 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:11.696397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f458e-1726-4a57-8807-d1725f4c7927 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:11.700666 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f458e-1726-4a57-8807-d1725f4c7927 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:11.718070 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6df794-71ff-4826-a440-527ab46a550c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:11.718714 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6df794-71ff-4826-a440-527ab46a550c admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:11.719073 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6df794-71ff-4826-a440-527ab46a550c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:11.719422 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6df794-71ff-4826-a440-527ab46a550c admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:11.720249 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6df794-71ff-4826-a440-527ab46a550c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:48:11.720602 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6df794-71ff-4826-a440-527ab46a550c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:11.722499 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6df794-71ff-4826-a440-527ab46a550c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:11.735502 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 790/1571] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:48:11.746406 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6df794-71ff-4826-a440-527ab46a550c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:11.746406 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6df794-71ff-4826-a440-527ab46a550c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:11.750713 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69e931-069c-4e6f-a644-ddfb9480da2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:11.751273 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69e931-069c-4e6f-a644-ddfb9480da2c admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:11.751550 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69e931-069c-4e6f-a644-ddfb9480da2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:11.751820 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69e931-069c-4e6f-a644-ddfb9480da2c admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:11.752432 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69e931-069c-4e6f-a644-ddfb9480da2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:48:11.752734 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69e931-069c-4e6f-a644-ddfb9480da2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:11.754318 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69e931-069c-4e6f-a644-ddfb9480da2c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:11.766628 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 791/1572] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:48:11.767383 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69e931-069c-4e6f-a644-ddfb9480da2c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:11.772231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:11.777324 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69e931-069c-4e6f-a644-ddfb9480da2c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:11.782153 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063344fc-3bad-468a-8bd3-de398b4d243d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:11.782710 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063344fc-3bad-468a-8bd3-de398b4d243d admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:11.782984 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063344fc-3bad-468a-8bd3-de398b4d243d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:11.783253 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063344fc-3bad-468a-8bd3-de398b4d243d admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:11.783854 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063344fc-3bad-468a-8bd3-de398b4d243d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:11.785380 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063344fc-3bad-468a-8bd3-de398b4d243d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:11.795040 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 792/1573] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:11.795774 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063344fc-3bad-468a-8bd3-de398b4d243d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:11.805333 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063344fc-3bad-468a-8bd3-de398b4d243d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:11.809893 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e1960-f00b-4139-a3ab-9fc56f61c152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:11.810430 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e1960-f00b-4139-a3ab-9fc56f61c152 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:11.810708 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e1960-f00b-4139-a3ab-9fc56f61c152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:11.810976 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e1960-f00b-4139-a3ab-9fc56f61c152 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:11.811567 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e1960-f00b-4139-a3ab-9fc56f61c152 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:11.813382 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e1960-f00b-4139-a3ab-9fc56f61c152 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:11.863410 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:11.869646 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 782/1574] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:48:11 2022] POST /identity/v3/projects => generated 373 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:11.870484 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f458e-1726-4a57-8807-d1725f4c7927 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:11.930004 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f458e-1726-4a57-8807-d1725f4c7927 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:11.934593 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3750f7-fea4-453d-9f07-0f72b45b16f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:11.935204 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3750f7-fea4-453d-9f07-0f72b45b16f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:11.935508 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3750f7-fea4-453d-9f07-0f72b45b16f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:11.935779 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3750f7-fea4-453d-9f07-0f72b45b16f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:11.936402 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3750f7-fea4-453d-9f07-0f72b45b16f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:11.938424 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3750f7-fea4-453d-9f07-0f72b45b16f6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:11.945599 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 793/1575] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:48:11 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:11.947202 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3bac56-0755-4320-8786-815576628943 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:11.947832 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3bac56-0755-4320-8786-815576628943 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:11.948228 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3bac56-0755-4320-8786-815576628943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:11.968524 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ab3bac56-0755-4320-8786-815576628943 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:11.969791 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ab3bac56-0755-4320-8786-815576628943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:11.978263 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 794/1576] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:11.978975 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3bac56-0755-4320-8786-815576628943 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:11.989232 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3bac56-0755-4320-8786-815576628943 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:11.994760 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc735ee-cbaf-44a7-8caa-1a124f5dd057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:11.995380 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc735ee-cbaf-44a7-8caa-1a124f5dd057 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:11.995660 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc735ee-cbaf-44a7-8caa-1a124f5dd057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:11.995930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc735ee-cbaf-44a7-8caa-1a124f5dd057 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:11.996573 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc735ee-cbaf-44a7-8caa-1a124f5dd057 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:11.998564 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc735ee-cbaf-44a7-8caa-1a124f5dd057 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:12.049362 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 783/1577] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:48:11 2022] POST /identity/v3/projects => generated 377 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:12.049362 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3750f7-fea4-453d-9f07-0f72b45b16f6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:12.109155 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3750f7-fea4-453d-9f07-0f72b45b16f6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:12.113796 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ee7af-8dbc-4363-a019-efa06112cd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:12.114396 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ee7af-8dbc-4363-a019-efa06112cd48 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:12.114681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ee7af-8dbc-4363-a019-efa06112cd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:12.114957 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ee7af-8dbc-4363-a019-efa06112cd48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:12.115604 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ee7af-8dbc-4363-a019-efa06112cd48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:12.118141 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ee7af-8dbc-4363-a019-efa06112cd48 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:12.171379 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 795/1578] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:48:11 2022] POST /identity/v3/users => generated 290 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:12.172367 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc735ee-cbaf-44a7-8caa-1a124f5dd057 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:12.182891 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc735ee-cbaf-44a7-8caa-1a124f5dd057 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:12.187594 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1daac-2286-41ba-b3dd-be8e1c7c325f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:12.188173 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1daac-2286-41ba-b3dd-be8e1c7c325f admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:12.188498 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1daac-2286-41ba-b3dd-be8e1c7c325f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:12.188722 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1daac-2286-41ba-b3dd-be8e1c7c325f admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:12.189337 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1daac-2286-41ba-b3dd-be8e1c7c325f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:12.191259 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1daac-2286-41ba-b3dd-be8e1c7c325f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:12.337703 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 784/1579] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:48:12 2022] POST /identity/v3/projects => generated 403 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:12.338553 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ee7af-8dbc-4363-a019-efa06112cd48 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:12.367628 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 796/1580] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:48:12 2022] POST /identity/v3/projects => generated 365 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:12.367628 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1daac-2286-41ba-b3dd-be8e1c7c325f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:12.401705 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ee7af-8dbc-4363-a019-efa06112cd48 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:12.414632 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:12.429842 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1daac-2286-41ba-b3dd-be8e1c7c325f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:12.434477 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f44ea-d0fb-49cf-83ed-10a1b6f49314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:12.435090 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f44ea-d0fb-49cf-83ed-10a1b6f49314 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:12.435374 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f44ea-d0fb-49cf-83ed-10a1b6f49314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:12.435647 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f44ea-d0fb-49cf-83ed-10a1b6f49314 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:12.436280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f44ea-d0fb-49cf-83ed-10a1b6f49314 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:12.438230 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f44ea-d0fb-49cf-83ed-10a1b6f49314 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:12.458242 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa43477-84e2-4aaf-96cf-173ad2fc3caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:12.461916 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa43477-84e2-4aaf-96cf-173ad2fc3caf admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:12.461916 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa43477-84e2-4aaf-96cf-173ad2fc3caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:12.461916 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa43477-84e2-4aaf-96cf-173ad2fc3caf admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:12.461916 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa43477-84e2-4aaf-96cf-173ad2fc3caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:12.462270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa43477-84e2-4aaf-96cf-173ad2fc3caf admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:12.471568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 785/1581] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:12.472391 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa43477-84e2-4aaf-96cf-173ad2fc3caf admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:12.482338 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa43477-84e2-4aaf-96cf-173ad2fc3caf admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:12.486761 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90dc9b-926d-49b8-8d90-bed4d8eb1358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:12.487343 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90dc9b-926d-49b8-8d90-bed4d8eb1358 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:12.487612 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90dc9b-926d-49b8-8d90-bed4d8eb1358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:12.487882 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90dc9b-926d-49b8-8d90-bed4d8eb1358 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:12.488472 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da90dc9b-926d-49b8-8d90-bed4d8eb1358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:12.490049 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da90dc9b-926d-49b8-8d90-bed4d8eb1358 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:12.500160 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 786/1582] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:12.501075 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90dc9b-926d-49b8-8d90-bed4d8eb1358 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:12.537157 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 797/1583] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:48:12 2022] POST /identity/v3/users => generated 287 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:12.539353 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f44ea-d0fb-49cf-83ed-10a1b6f49314 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:12.547990 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f44ea-d0fb-49cf-83ed-10a1b6f49314 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:12.552697 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb272ef-1ff4-4dad-9e5e-684ef42cd1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:12.553293 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb272ef-1ff4-4dad-9e5e-684ef42cd1f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:12.553572 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb272ef-1ff4-4dad-9e5e-684ef42cd1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:12.554395 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb272ef-1ff4-4dad-9e5e-684ef42cd1f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:12.555028 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb272ef-1ff4-4dad-9e5e-684ef42cd1f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:12.556932 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb272ef-1ff4-4dad-9e5e-684ef42cd1f6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:12.557042 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90dc9b-926d-49b8-8d90-bed4d8eb1358 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:12.560750 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df4737-3300-43a7-8887-1f77e729fa36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:12.561379 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df4737-3300-43a7-8887-1f77e729fa36 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:12.561824 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df4737-3300-43a7-8887-1f77e729fa36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:12.562099 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df4737-3300-43a7-8887-1f77e729fa36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:12.571719 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df4737-3300-43a7-8887-1f77e729fa36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:12.573143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df4737-3300-43a7-8887-1f77e729fa36 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:12.582367 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 787/1584] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:12.583140 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df4737-3300-43a7-8887-1f77e729fa36 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:12.591799 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df4737-3300-43a7-8887-1f77e729fa36 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:12.596284 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431d350-769f-4f34-8a26-4954c37bf938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:12.596859 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431d350-769f-4f34-8a26-4954c37bf938 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:12.597137 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431d350-769f-4f34-8a26-4954c37bf938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:12.597405 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431d350-769f-4f34-8a26-4954c37bf938 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:12.598098 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8431d350-769f-4f34-8a26-4954c37bf938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:12.602468 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8431d350-769f-4f34-8a26-4954c37bf938 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:12.610575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 788/1585] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:12.611354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431d350-769f-4f34-8a26-4954c37bf938 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:12.620955 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431d350-769f-4f34-8a26-4954c37bf938 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:12.625432 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320c823-0dbb-4a6d-b0a9-5465f60b57d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:12.626035 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320c823-0dbb-4a6d-b0a9-5465f60b57d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:12.626315 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320c823-0dbb-4a6d-b0a9-5465f60b57d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:12.626590 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320c823-0dbb-4a6d-b0a9-5465f60b57d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:12.627188 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6320c823-0dbb-4a6d-b0a9-5465f60b57d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:12.629056 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6320c823-0dbb-4a6d-b0a9-5465f60b57d9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:12.714542 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 798/1586] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:48:12 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:12.715320 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb272ef-1ff4-4dad-9e5e-684ef42cd1f6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:12.727852 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb272ef-1ff4-4dad-9e5e-684ef42cd1f6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:12.733548 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 789/1587] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:48:12 2022] POST /identity/v3/users => generated 302 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:12.733548 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320c823-0dbb-4a6d-b0a9-5465f60b57d9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:12.737952 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea35f5-2819-439a-9964-257c2bfa47d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:12.737952 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea35f5-2819-439a-9964-257c2bfa47d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:12.737952 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea35f5-2819-439a-9964-257c2bfa47d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:12.737952 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea35f5-2819-439a-9964-257c2bfa47d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:12.738419 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea35f5-2819-439a-9964-257c2bfa47d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:12.738688 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea35f5-2819-439a-9964-257c2bfa47d2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:12.744598 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320c823-0dbb-4a6d-b0a9-5465f60b57d9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:12.751284 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b8527-ff3d-491c-a709-bba1c63a1f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:12.752789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b8527-ff3d-491c-a709-bba1c63a1f58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:12.753142 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b8527-ff3d-491c-a709-bba1c63a1f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:12.753485 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b8527-ff3d-491c-a709-bba1c63a1f58 admin admin] PATH_INFO: `/v3/projects/a4edae41e06847e6ad0d814390dc0def/users/ed51c458e66d45d88fc5db8744a9c2e3/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:12.769544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b8527-ff3d-491c-a709-bba1c63a1f58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4edae41e06847e6ad0d814390dc0def, user_id=ed51c458e66d45d88fc5db8744a9c2e3, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:12.770605 dv-cinder-857993-1-smb devstack@keystone.service[81776]: WARNING py.warnings [None req-0d6b8527-ff3d-491c-a709-bba1c63a1f58 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 03:48:12.770605 dv-cinder-857993-1-smb devstack@keystone.service[81776]: warnings.warn(msg) Sep 16 03:48:12.770605 dv-cinder-857993-1-smb devstack@keystone.service[81776]: Sep 16 03:48:12.772566 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b8527-ff3d-491c-a709-bba1c63a1f58 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:12.902342 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 790/1588] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:48:12 2022] PUT /identity/v3/projects/a4edae41e06847e6ad0d814390dc0def/users/ed51c458e66d45d88fc5db8744a9c2e3/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:12.906668 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 799/1589] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:48:12 2022] POST /identity/v3/users => generated 283 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:12.906804 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b8527-ff3d-491c-a709-bba1c63a1f58 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:12.906917 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea35f5-2819-439a-9964-257c2bfa47d2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:12.921419 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea35f5-2819-439a-9964-257c2bfa47d2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:12.967337 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=84,keystone:INSERT=16 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:12.988108 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:12.988361 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d79dd-23c1-4954-b703-15405b67a4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:12.988361 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d79dd-23c1-4954-b703-15405b67a4ac admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:12.988361 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d79dd-23c1-4954-b703-15405b67a4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:12.988361 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d79dd-23c1-4954-b703-15405b67a4ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:12.988656 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d79dd-23c1-4954-b703-15405b67a4ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:12.989926 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d79dd-23c1-4954-b703-15405b67a4ac admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:12.996982 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b8527-ff3d-491c-a709-bba1c63a1f58 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:13.001908 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84964014-a5bb-4b41-9ad9-811b092316f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:13.002363 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 800/1590] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:13.002847 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84964014-a5bb-4b41-9ad9-811b092316f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:13.003127 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84964014-a5bb-4b41-9ad9-811b092316f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:13.003395 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84964014-a5bb-4b41-9ad9-811b092316f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:13.004034 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84964014-a5bb-4b41-9ad9-811b092316f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:13.004341 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d79dd-23c1-4954-b703-15405b67a4ac admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:13.005777 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84964014-a5bb-4b41-9ad9-811b092316f4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:13.015583 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d79dd-23c1-4954-b703-15405b67a4ac admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:13.021702 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 791/1591] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:13.021702 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84964014-a5bb-4b41-9ad9-811b092316f4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:13.025119 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a011d61-a6b2-411e-b904-ea914d9bf1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:13.025960 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a011d61-a6b2-411e-b904-ea914d9bf1c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:13.028352 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a011d61-a6b2-411e-b904-ea914d9bf1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:13.028646 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a011d61-a6b2-411e-b904-ea914d9bf1c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:13.029433 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a011d61-a6b2-411e-b904-ea914d9bf1c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:13.030210 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84964014-a5bb-4b41-9ad9-811b092316f4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:13.031283 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a011d61-a6b2-411e-b904-ea914d9bf1c8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:13.035213 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66faaa-04a8-469a-8fc7-157efdc06c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:13.035815 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66faaa-04a8-469a-8fc7-157efdc06c03 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:13.036091 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66faaa-04a8-469a-8fc7-157efdc06c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:13.036363 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66faaa-04a8-469a-8fc7-157efdc06c03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:13.037334 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66faaa-04a8-469a-8fc7-157efdc06c03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:13.039206 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66faaa-04a8-469a-8fc7-157efdc06c03 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:13.044668 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 801/1592] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:13.045567 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a011d61-a6b2-411e-b904-ea914d9bf1c8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:13.050761 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 792/1593] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:13.050761 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66faaa-04a8-469a-8fc7-157efdc06c03 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:13.057025 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a011d61-a6b2-411e-b904-ea914d9bf1c8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:13.060956 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66faaa-04a8-469a-8fc7-157efdc06c03 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:13.062497 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc900a3-8c5b-461b-95d6-34eafcc9970b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:13.063107 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc900a3-8c5b-461b-95d6-34eafcc9970b admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:13.063384 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc900a3-8c5b-461b-95d6-34eafcc9970b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:13.063661 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc900a3-8c5b-461b-95d6-34eafcc9970b admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:13.064302 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc900a3-8c5b-461b-95d6-34eafcc9970b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:13.065797 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4bf28-d714-47e8-aef8-e900db482719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:13.065949 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc900a3-8c5b-461b-95d6-34eafcc9970b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:13.066390 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4bf28-d714-47e8-aef8-e900db482719 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:13.066657 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4bf28-d714-47e8-aef8-e900db482719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:13.066928 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4bf28-d714-47e8-aef8-e900db482719 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:13.067545 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4bf28-d714-47e8-aef8-e900db482719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:13.069127 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4bf28-d714-47e8-aef8-e900db482719 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:13.076661 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 802/1594] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:13.077984 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45ed19-7d6e-428e-8abc-9330a6925fe8 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:13.078272 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45ed19-7d6e-428e-8abc-9330a6925fe8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:13.078518 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45ed19-7d6e-428e-8abc-9330a6925fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:13.081806 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 793/1595] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:13.082966 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4bf28-d714-47e8-aef8-e900db482719 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:13.092606 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4bf28-d714-47e8-aef8-e900db482719 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:13.097092 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be5e78-f8d6-43df-8efd-3dfaef47652a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:13.097704 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be5e78-f8d6-43df-8efd-3dfaef47652a admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:13.097986 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be5e78-f8d6-43df-8efd-3dfaef47652a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:13.098258 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be5e78-f8d6-43df-8efd-3dfaef47652a admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:13.098880 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be5e78-f8d6-43df-8efd-3dfaef47652a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:13.101070 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be5e78-f8d6-43df-8efd-3dfaef47652a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:13.106910 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-7d45ed19-7d6e-428e-8abc-9330a6925fe8 None None] MFA Rules not processed for user `ed51c458e66d45d88fc5db8744a9c2e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:13.108157 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7d45ed19-7d6e-428e-8abc-9330a6925fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:13.112504 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 794/1596] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:13.113289 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be5e78-f8d6-43df-8efd-3dfaef47652a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:13.126435 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be5e78-f8d6-43df-8efd-3dfaef47652a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:13.131607 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb695fcf-dd44-41fb-a04b-b2183cde5ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:13.132305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb695fcf-dd44-41fb-a04b-b2183cde5ecb admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:13.134477 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb695fcf-dd44-41fb-a04b-b2183cde5ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:13.134477 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb695fcf-dd44-41fb-a04b-b2183cde5ecb admin admin] PATH_INFO: `/v3/projects/53a117163c954df19033f4d7b59184a8/users/76f4e95a87a1499a828b2bfb6e3ed1d7/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:13.148638 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb695fcf-dd44-41fb-a04b-b2183cde5ecb admin admin] RBAC: Authorizing `identity:create_grant(project_id=53a117163c954df19033f4d7b59184a8, user_id=76f4e95a87a1499a828b2bfb6e3ed1d7, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:13.151578 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb695fcf-dd44-41fb-a04b-b2183cde5ecb admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:13.180570 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 803/1597] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:13.181462 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45ed19-7d6e-428e-8abc-9330a6925fe8 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:13.197562 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45ed19-7d6e-428e-8abc-9330a6925fe8 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:13.200018 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26330e0-3aa7-473c-aed2-233a8ab5dcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:13.200676 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26330e0-3aa7-473c-aed2-233a8ab5dcc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:13.200957 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26330e0-3aa7-473c-aed2-233a8ab5dcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:13.201230 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26330e0-3aa7-473c-aed2-233a8ab5dcc2 admin admin] PATH_INFO: `/v3/projects/665f0a8950634436b7efe6fbd34675e3/users/5832b2a9564f49338f91e6672343ef61/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:13.218009 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26330e0-3aa7-473c-aed2-233a8ab5dcc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=665f0a8950634436b7efe6fbd34675e3, user_id=5832b2a9564f49338f91e6672343ef61, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:13.220919 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26330e0-3aa7-473c-aed2-233a8ab5dcc2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:13.262524 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 795/1598] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:48:13 2022] PUT /identity/v3/projects/53a117163c954df19033f4d7b59184a8/users/76f4e95a87a1499a828b2bfb6e3ed1d7/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:13.263487 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb695fcf-dd44-41fb-a04b-b2183cde5ecb admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:13.324726 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb695fcf-dd44-41fb-a04b-b2183cde5ecb admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:13.330293 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 804/1599] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:48:13 2022] PUT /identity/v3/projects/665f0a8950634436b7efe6fbd34675e3/users/5832b2a9564f49338f91e6672343ef61/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:13.331125 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26330e0-3aa7-473c-aed2-233a8ab5dcc2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:13.382742 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fac776-d0a3-4670-9bd3-94125427317a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:13.383459 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fac776-d0a3-4670-9bd3-94125427317a admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:13.383810 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fac776-d0a3-4670-9bd3-94125427317a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:13.384080 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fac776-d0a3-4670-9bd3-94125427317a admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:13.384739 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fac776-d0a3-4670-9bd3-94125427317a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:13.386366 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fac776-d0a3-4670-9bd3-94125427317a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:13.395830 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26330e0-3aa7-473c-aed2-233a8ab5dcc2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:13.396766 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 796/1600] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:13.398824 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fac776-d0a3-4670-9bd3-94125427317a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:13.405140 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6001e-6020-4185-8364-58a43ec387a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:13.405805 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6001e-6020-4185-8364-58a43ec387a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:13.406131 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6001e-6020-4185-8364-58a43ec387a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:13.406403 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6001e-6020-4185-8364-58a43ec387a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:13.407046 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6001e-6020-4185-8364-58a43ec387a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:13.408640 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6001e-6020-4185-8364-58a43ec387a4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:13.410072 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fac776-d0a3-4670-9bd3-94125427317a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:13.415157 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a84b92-f9a2-4736-beb3-fbf2cefa1a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:13.416031 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a84b92-f9a2-4736-beb3-fbf2cefa1a2e admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:13.416387 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a84b92-f9a2-4736-beb3-fbf2cefa1a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:13.416668 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a84b92-f9a2-4736-beb3-fbf2cefa1a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:13.417335 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a84b92-f9a2-4736-beb3-fbf2cefa1a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:13.418966 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a84b92-f9a2-4736-beb3-fbf2cefa1a2e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:13.420094 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 805/1601] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:13.421566 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6001e-6020-4185-8364-58a43ec387a4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:13.431529 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 797/1602] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:13.432422 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a84b92-f9a2-4736-beb3-fbf2cefa1a2e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:13.435782 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6001e-6020-4185-8364-58a43ec387a4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:13.440458 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73379dca-f0c2-4af0-b910-634b1d70d24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:13.441189 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73379dca-f0c2-4af0-b910-634b1d70d24c admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:13.441567 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73379dca-f0c2-4af0-b910-634b1d70d24c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:13.441977 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73379dca-f0c2-4af0-b910-634b1d70d24c admin admin] PATH_INFO: `/v3/projects/f0a60ffebb9b4e17915fa1a53914a3a0/users/bdec02d06b5e45b5bb6d4738541306d0/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:13.443177 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a84b92-f9a2-4736-beb3-fbf2cefa1a2e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:13.448861 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8cb68a-cc66-4ea4-a212-6ee7587ce07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:13.449570 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cb68a-cc66-4ea4-a212-6ee7587ce07f admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:13.449903 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cb68a-cc66-4ea4-a212-6ee7587ce07f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:13.450181 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cb68a-cc66-4ea4-a212-6ee7587ce07f admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:13.450815 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8cb68a-cc66-4ea4-a212-6ee7587ce07f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:13.452734 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8cb68a-cc66-4ea4-a212-6ee7587ce07f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:13.460518 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73379dca-f0c2-4af0-b910-634b1d70d24c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0a60ffebb9b4e17915fa1a53914a3a0, user_id=bdec02d06b5e45b5bb6d4738541306d0, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:13.463230 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73379dca-f0c2-4af0-b910-634b1d70d24c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:13.465733 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:13.559823 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 806/1603] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:48:13 2022] PUT /identity/v3/projects/f0a60ffebb9b4e17915fa1a53914a3a0/users/bdec02d06b5e45b5bb6d4738541306d0/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:13.563853 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 798/1604] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:48:13 2022] POST /identity/v3/projects => generated 363 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:13.563853 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062be44-efd0-44f3-af77-d433c133dbb0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:13.563853 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062be44-efd0-44f3-af77-d433c133dbb0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:13.563853 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062be44-efd0-44f3-af77-d433c133dbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:13.570390 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:13.572668 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70331942-f826-4151-b1aa-55fed21a4cf5 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:13.572957 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70331942-f826-4151-b1aa-55fed21a4cf5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:13.573234 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70331942-f826-4151-b1aa-55fed21a4cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:13.582629 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b062be44-efd0-44f3-af77-d433c133dbb0 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:13.587069 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b062be44-efd0-44f3-af77-d433c133dbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:13.604068 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-70331942-f826-4151-b1aa-55fed21a4cf5 None None] MFA Rules not processed for user `76f4e95a87a1499a828b2bfb6e3ed1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:13.605407 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-70331942-f826-4151-b1aa-55fed21a4cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:13.657001 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 799/1605] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:13.658274 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062be44-efd0-44f3-af77-d433c133dbb0 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:13.683701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062be44-efd0-44f3-af77-d433c133dbb0 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:13.695225 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 807/1606] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:13.696697 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70331942-f826-4151-b1aa-55fed21a4cf5 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:13.697252 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9672a-e4aa-447c-bf3f-45d4088a1f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:13.697996 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9672a-e4aa-447c-bf3f-45d4088a1f1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:13.698282 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9672a-e4aa-447c-bf3f-45d4088a1f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:13.698567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9672a-e4aa-447c-bf3f-45d4088a1f1d admin admin] PATH_INFO: `/v3/projects/606dddf2fd0248a4b2a7fe0f69835e57/users/c04a0f9a09a24473a9377ca68fc638b7/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:13.711307 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70331942-f826-4151-b1aa-55fed21a4cf5 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:13.717821 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8326789-1e7b-4ad3-b1b3-6dbf14aaeb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:13.718706 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8326789-1e7b-4ad3-b1b3-6dbf14aaeb52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:13.719104 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8326789-1e7b-4ad3-b1b3-6dbf14aaeb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:13.719486 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8326789-1e7b-4ad3-b1b3-6dbf14aaeb52 admin admin] PATH_INFO: `/v3/projects/60c50188ec1948abbb0d66ff910ebee8/users/6052160b0fdf4dfcab85c2d357f3e052/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:13.741523 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8326789-1e7b-4ad3-b1b3-6dbf14aaeb52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60c50188ec1948abbb0d66ff910ebee8, user_id=6052160b0fdf4dfcab85c2d357f3e052, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:13.743650 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e9672a-e4aa-447c-bf3f-45d4088a1f1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=606dddf2fd0248a4b2a7fe0f69835e57, user_id=c04a0f9a09a24473a9377ca68fc638b7, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:13.745002 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8326789-1e7b-4ad3-b1b3-6dbf14aaeb52 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:13.748344 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e9672a-e4aa-447c-bf3f-45d4088a1f1d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:13.867628 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 808/1607] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:48:13 2022] PUT /identity/v3/projects/60c50188ec1948abbb0d66ff910ebee8/users/6052160b0fdf4dfcab85c2d357f3e052/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:13.871605 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 800/1608] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:48:13 2022] PUT /identity/v3/projects/606dddf2fd0248a4b2a7fe0f69835e57/users/c04a0f9a09a24473a9377ca68fc638b7/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:13.872464 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9672a-e4aa-447c-bf3f-45d4088a1f1d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:13.875933 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8326789-1e7b-4ad3-b1b3-6dbf14aaeb52 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:13.964343 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8326789-1e7b-4ad3-b1b3-6dbf14aaeb52 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:13.965315 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9672a-e4aa-447c-bf3f-45d4088a1f1d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:13.969252 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6841418-deee-4a36-839a-a4007c6b910f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:13.970170 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6841418-deee-4a36-839a-a4007c6b910f admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:13.970554 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6841418-deee-4a36-839a-a4007c6b910f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:13.970933 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6841418-deee-4a36-839a-a4007c6b910f admin admin] PATH_INFO: `/v3/projects/485d2843797d4df9bd9a1700516a88d4/users/4dc376951a6c43bb895a23aaa7ca0501/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:13.971235 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c3bf7-55d6-4ec1-9c05-9f083cf7f716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:13.971857 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c3bf7-55d6-4ec1-9c05-9f083cf7f716 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:13.972185 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c3bf7-55d6-4ec1-9c05-9f083cf7f716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:13.973452 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c3bf7-55d6-4ec1-9c05-9f083cf7f716 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:13.974371 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c3bf7-55d6-4ec1-9c05-9f083cf7f716 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:13.977914 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c3bf7-55d6-4ec1-9c05-9f083cf7f716 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:13.989035 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6841418-deee-4a36-839a-a4007c6b910f admin admin] RBAC: Authorizing `identity:create_grant(project_id=485d2843797d4df9bd9a1700516a88d4, user_id=4dc376951a6c43bb895a23aaa7ca0501, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:13.992456 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6841418-deee-4a36-839a-a4007c6b910f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:14.097114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 801/1609] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:48:13 2022] POST /identity/v3/users => generated 288 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:14.098380 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302eaf3-8003-42d5-8728-a57a8bf6c3b1 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:14.098656 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302eaf3-8003-42d5-8728-a57a8bf6c3b1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:14.098928 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302eaf3-8003-42d5-8728-a57a8bf6c3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:14.130962 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0302eaf3-8003-42d5-8728-a57a8bf6c3b1 None None] MFA Rules not processed for user `bdec02d06b5e45b5bb6d4738541306d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:14.130962 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0302eaf3-8003-42d5-8728-a57a8bf6c3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:14.132997 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 809/1610] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:48:13 2022] PUT /identity/v3/projects/485d2843797d4df9bd9a1700516a88d4/users/4dc376951a6c43bb895a23aaa7ca0501/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:14.134614 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6841418-deee-4a36-839a-a4007c6b910f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:14.136766 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f6841418-deee-4a36-839a-a4007c6b910f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:14.206489 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:14.221050 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6841418-deee-4a36-839a-a4007c6b910f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:14.225876 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4accdbb8-3c72-48b8-b942-42851c584059 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:14.226808 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4accdbb8-3c72-48b8-b942-42851c584059 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:14.227241 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4accdbb8-3c72-48b8-b942-42851c584059 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:14.227677 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4accdbb8-3c72-48b8-b942-42851c584059 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:14.232123 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:14.239878 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 802/1611] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:14.241930 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1433a-e1dc-4b1f-ab94-f8b50129315a None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:14.242350 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1433a-e1dc-4b1f-ab94-f8b50129315a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:14.242980 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1433a-e1dc-4b1f-ab94-f8b50129315a None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:14.249784 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 803/1612] 10.222.0.33 () {54 vars in 962 bytes} [Fri Sep 16 03:48:14 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:48:14.253007 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01b0e0-f51f-4d37-8920-61aae7ada428 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:14.255163 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01b0e0-f51f-4d37-8920-61aae7ada428 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:14.255163 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01b0e0-f51f-4d37-8920-61aae7ada428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:14.293119 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6b01b0e0-f51f-4d37-8920-61aae7ada428 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:14.296588 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6b01b0e0-f51f-4d37-8920-61aae7ada428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:14.322411 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4accdbb8-3c72-48b8-b942-42851c584059 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:14.323907 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4accdbb8-3c72-48b8-b942-42851c584059 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:14.342079 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 810/1613] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:14.345966 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad3a51-6cd1-438f-aa37-d5a9303faabc None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:14.348093 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad3a51-6cd1-438f-aa37-d5a9303faabc None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:14.348574 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad3a51-6cd1-438f-aa37-d5a9303faabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:14.370600 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 804/1614] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:14.371722 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01b0e0-f51f-4d37-8920-61aae7ada428 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:14.385235 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01b0e0-f51f-4d37-8920-61aae7ada428 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:14.389476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c3ad3a51-6cd1-438f-aa37-d5a9303faabc None None] MFA Rules not processed for user `6052160b0fdf4dfcab85c2d357f3e052`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:14.390802 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c3ad3a51-6cd1-438f-aa37-d5a9303faabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:14.392820 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da372226-cd4f-4782-8a9b-8bcce9f2f946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:14.392820 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da372226-cd4f-4782-8a9b-8bcce9f2f946 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:14.392820 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da372226-cd4f-4782-8a9b-8bcce9f2f946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:14.392820 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da372226-cd4f-4782-8a9b-8bcce9f2f946 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:14.393209 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da372226-cd4f-4782-8a9b-8bcce9f2f946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:14.394723 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da372226-cd4f-4782-8a9b-8bcce9f2f946 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:14.411160 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 805/1615] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:14.411160 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529eecf2-67aa-4ab7-a633-1a093b35edb6 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:14.411160 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529eecf2-67aa-4ab7-a633-1a093b35edb6 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:14.411160 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529eecf2-67aa-4ab7-a633-1a093b35edb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:14.443458 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-529eecf2-67aa-4ab7-a633-1a093b35edb6 None None] MFA Rules not processed for user `4dc376951a6c43bb895a23aaa7ca0501`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:14.445395 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-529eecf2-67aa-4ab7-a633-1a093b35edb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:14.462132 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 811/1616] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:14 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:14.463507 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1476fd-abbb-43d4-a0e6-64d031d9bc99 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:14.463982 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1476fd-abbb-43d4-a0e6-64d031d9bc99 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:14.464535 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1476fd-abbb-43d4-a0e6-64d031d9bc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:14.526326 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 806/1617] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:14.526326 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b50bd4-14e0-46ba-bf49-091f6dc9fa9b None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:14.526326 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b50bd4-14e0-46ba-bf49-091f6dc9fa9b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:14.526326 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b50bd4-14e0-46ba-bf49-091f6dc9fa9b None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:14.527914 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 807/1618] 10.222.0.33 () {54 vars in 962 bytes} [Fri Sep 16 03:48:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:48:14.528761 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b50bd4-14e0-46ba-bf49-091f6dc9fa9b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:14.540004 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9e1476fd-abbb-43d4-a0e6-64d031d9bc99 None None] MFA Rules not processed for user `c09d1a4ac8b64921a6b05fcd567bb770`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:14.552350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9e1476fd-abbb-43d4-a0e6-64d031d9bc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:14.562329 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b50bd4-14e0-46ba-bf49-091f6dc9fa9b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:14.568958 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb3f027-b01e-4bea-9f2e-35a70f1ae4b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:14.570307 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3f027-b01e-4bea-9f2e-35a70f1ae4b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:14.570653 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3f027-b01e-4bea-9f2e-35a70f1ae4b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:14.571140 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3f027-b01e-4bea-9f2e-35a70f1ae4b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:14.584262 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb3f027-b01e-4bea-9f2e-35a70f1ae4b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:14.587603 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb3f027-b01e-4bea-9f2e-35a70f1ae4b2 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:14.610449 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 808/1619] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:14.616552 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb3f027-b01e-4bea-9f2e-35a70f1ae4b2 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:14.638305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb3f027-b01e-4bea-9f2e-35a70f1ae4b2 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:14.645158 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 812/1620] 10.222.0.33 () {58 vars in 1059 bytes} [Fri Sep 16 03:48:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:14.645158 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1476fd-abbb-43d4-a0e6-64d031d9bc99 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:14.649504 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b42093-cf18-494f-83e2-eb92ed2eb0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:14.650224 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b42093-cf18-494f-83e2-eb92ed2eb0c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:14.650502 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b42093-cf18-494f-83e2-eb92ed2eb0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:14.650819 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b42093-cf18-494f-83e2-eb92ed2eb0c0 admin admin] PATH_INFO: `/v3/projects/3361c1a8f6f64aae8eb1ae0ca6d7e50a/users/2c45ecf98d2340239c745dea29fcebfa/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:14.655292 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1476fd-abbb-43d4-a0e6-64d031d9bc99 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:14.666356 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dccbfe1-6fbc-4356-86ec-4391758fdcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:14.667998 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dccbfe1-6fbc-4356-86ec-4391758fdcb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:14.668275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dccbfe1-6fbc-4356-86ec-4391758fdcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:14.668544 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dccbfe1-6fbc-4356-86ec-4391758fdcb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:14.669186 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dccbfe1-6fbc-4356-86ec-4391758fdcb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:14.674341 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dccbfe1-6fbc-4356-86ec-4391758fdcb3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:14.678182 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b42093-cf18-494f-83e2-eb92ed2eb0c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3361c1a8f6f64aae8eb1ae0ca6d7e50a, user_id=2c45ecf98d2340239c745dea29fcebfa, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:14.681564 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b42093-cf18-494f-83e2-eb92ed2eb0c0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:14.768460 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 809/1621] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:48:14 2022] PUT /identity/v3/projects/3361c1a8f6f64aae8eb1ae0ca6d7e50a/users/2c45ecf98d2340239c745dea29fcebfa/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:14.769608 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b42093-cf18-494f-83e2-eb92ed2eb0c0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:14.835671 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 813/1622] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:48:14 2022] POST /identity/v3/projects => generated 405 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:14.837048 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246a6ab-1bac-4c99-868c-c92ffc34adde None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:14.837396 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246a6ab-1bac-4c99-868c-c92ffc34adde None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:14.837754 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246a6ab-1bac-4c99-868c-c92ffc34adde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:14.843054 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b42093-cf18-494f-83e2-eb92ed2eb0c0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:14.857952 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c246a6ab-1bac-4c99-868c-c92ffc34adde None None] MFA Rules not processed for user `c09d1a4ac8b64921a6b05fcd567bb770`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:14.859160 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c246a6ab-1bac-4c99-868c-c92ffc34adde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:14.863163 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:14.918763 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0193ec-7b27-4074-8c4c-65c1099b80a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:14.919633 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0193ec-7b27-4074-8c4c-65c1099b80a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:14.922481 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0193ec-7b27-4074-8c4c-65c1099b80a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:14.922818 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0193ec-7b27-4074-8c4c-65c1099b80a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:14.923561 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0193ec-7b27-4074-8c4c-65c1099b80a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:14.925871 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0193ec-7b27-4074-8c4c-65c1099b80a9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:14.949046 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:14.998468 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 814/1623] 10.222.0.33 () {58 vars in 1059 bytes} [Fri Sep 16 03:48:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:15.000410 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246a6ab-1bac-4c99-868c-c92ffc34adde None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:15.025014 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246a6ab-1bac-4c99-868c-c92ffc34adde None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:15.035133 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83accdf-c07a-4e5d-bfd9-f7b9513eb5b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:15.035776 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83accdf-c07a-4e5d-bfd9-f7b9513eb5b1 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:15.036096 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83accdf-c07a-4e5d-bfd9-f7b9513eb5b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:15.037153 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83accdf-c07a-4e5d-bfd9-f7b9513eb5b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:15.056743 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 810/1624] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:48:14 2022] POST /identity/v3/projects => generated 363 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:15.057728 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0193ec-7b27-4074-8c4c-65c1099b80a9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:15.116268 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83accdf-c07a-4e5d-bfd9-f7b9513eb5b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:15.195926 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83accdf-c07a-4e5d-bfd9-f7b9513eb5b1 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:15.195926 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 815/1625] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:15.195926 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83accdf-c07a-4e5d-bfd9-f7b9513eb5b1 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:15.195926 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83accdf-c07a-4e5d-bfd9-f7b9513eb5b1 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:15.204334 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e87f11c-a576-4630-adcc-4a02d34f5548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:15.204334 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87f11c-a576-4630-adcc-4a02d34f5548 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:15.204334 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87f11c-a576-4630-adcc-4a02d34f5548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:15.204334 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87f11c-a576-4630-adcc-4a02d34f5548 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:15.205101 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e87f11c-a576-4630-adcc-4a02d34f5548 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:15.205101 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e87f11c-a576-4630-adcc-4a02d34f5548 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:15.205433 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0193ec-7b27-4074-8c4c-65c1099b80a9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:15.205433 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c2178-97f5-44a4-9613-e337fcf72ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:15.205433 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c2178-97f5-44a4-9613-e337fcf72ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:15.205433 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c2178-97f5-44a4-9613-e337fcf72ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:15.205784 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c2178-97f5-44a4-9613-e337fcf72ac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:15.206415 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0c2178-97f5-44a4-9613-e337fcf72ac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:15.209735 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0c2178-97f5-44a4-9613-e337fcf72ac5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:15.236920 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 811/1626] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:15.238086 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c2178-97f5-44a4-9613-e337fcf72ac5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:15.354507 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c2178-97f5-44a4-9613-e337fcf72ac5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:15.361218 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953c0ba-6e4c-434b-9930-6b31a80bd4b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:15.362205 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953c0ba-6e4c-434b-9930-6b31a80bd4b0 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:15.362705 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953c0ba-6e4c-434b-9930-6b31a80bd4b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:15.363205 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953c0ba-6e4c-434b-9930-6b31a80bd4b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:15.400187 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 816/1627] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:48:15 2022] POST /identity/v3/users => generated 309 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:15.406630 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e87f11c-a576-4630-adcc-4a02d34f5548 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:15.427358 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e87f11c-a576-4630-adcc-4a02d34f5548 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:15.434015 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04882185-c7ea-4d07-b466-17d76efa321d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:15.435205 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04882185-c7ea-4d07-b466-17d76efa321d admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:15.435619 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04882185-c7ea-4d07-b466-17d76efa321d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:15.436427 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04882185-c7ea-4d07-b466-17d76efa321d admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:15.437959 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04882185-c7ea-4d07-b466-17d76efa321d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:15.450812 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04882185-c7ea-4d07-b466-17d76efa321d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:15.454355 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953c0ba-6e4c-434b-9930-6b31a80bd4b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:15.456621 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953c0ba-6e4c-434b-9930-6b31a80bd4b0 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:15.478023 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 812/1628] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:15.480562 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953c0ba-6e4c-434b-9930-6b31a80bd4b0 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:15.496990 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953c0ba-6e4c-434b-9930-6b31a80bd4b0 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:15.497275 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce8df5-aa2f-411f-b1ac-58a1f397f4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:15.497960 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce8df5-aa2f-411f-b1ac-58a1f397f4d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:15.498245 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce8df5-aa2f-411f-b1ac-58a1f397f4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:15.498521 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce8df5-aa2f-411f-b1ac-58a1f397f4d5 admin admin] PATH_INFO: `/v3/projects/3361c1a8f6f64aae8eb1ae0ca6d7e50a/users/2c45ecf98d2340239c745dea29fcebfa/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:15.500550 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce8df5-aa2f-411f-b1ac-58a1f397f4d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3361c1a8f6f64aae8eb1ae0ca6d7e50a, user_id=2c45ecf98d2340239c745dea29fcebfa, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:15.503345 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce8df5-aa2f-411f-b1ac-58a1f397f4d5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:15.515465 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 813/1629] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:48:15 2022] PUT /identity/v3/projects/3361c1a8f6f64aae8eb1ae0ca6d7e50a/users/2c45ecf98d2340239c745dea29fcebfa/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:15.516469 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce8df5-aa2f-411f-b1ac-58a1f397f4d5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:15.572559 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:15.579356 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 817/1630] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:48:15 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:15.582459 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cdd3e-8f88-489c-a369-4aa1aed89569 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:15.582854 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cdd3e-8f88-489c-a369-4aa1aed89569 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:15.584560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cdd3e-8f88-489c-a369-4aa1aed89569 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:15.589147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 818/1631] 10.222.0.33 () {54 vars in 912 bytes} [Fri Sep 16 03:48:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:48:15.863800 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb99b4f-9ba0-4632-97d7-2234d4512376 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:15.863800 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb99b4f-9ba0-4632-97d7-2234d4512376 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:15.863800 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb99b4f-9ba0-4632-97d7-2234d4512376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:15.866329 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce8df5-aa2f-411f-b1ac-58a1f397f4d5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:15.866329 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f0761-5fea-4d69-9e42-e8b04a1cc2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:15.866329 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f0761-5fea-4d69-9e42-e8b04a1cc2fb admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:15.866329 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f0761-5fea-4d69-9e42-e8b04a1cc2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:15.866546 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f0761-5fea-4d69-9e42-e8b04a1cc2fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:15.866546 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843f0761-5fea-4d69-9e42-e8b04a1cc2fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:15.866546 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843f0761-5fea-4d69-9e42-e8b04a1cc2fb admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:15.866691 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-deb99b4f-9ba0-4632-97d7-2234d4512376 None None] MFA Rules not processed for user `2c45ecf98d2340239c745dea29fcebfa`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:15.866691 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-deb99b4f-9ba0-4632-97d7-2234d4512376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:15.866790 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 814/1632] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:15.866790 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f0761-5fea-4d69-9e42-e8b04a1cc2fb admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:15.866790 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f0761-5fea-4d69-9e42-e8b04a1cc2fb admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:15.866790 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b195ca-b078-4cf7-a549-5464bff6b4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:15.867004 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b195ca-b078-4cf7-a549-5464bff6b4a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:15.867004 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b195ca-b078-4cf7-a549-5464bff6b4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:15.867004 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b195ca-b078-4cf7-a549-5464bff6b4a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:15.867004 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b195ca-b078-4cf7-a549-5464bff6b4a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:15.867004 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b195ca-b078-4cf7-a549-5464bff6b4a3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:15.867231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:15.867301 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 815/1633] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:15.867301 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e2504-4d6f-4909-9599-388f0c08c29a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:15.867301 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e2504-4d6f-4909-9599-388f0c08c29a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:15.867301 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e2504-4d6f-4909-9599-388f0c08c29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:15.867301 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f30e2504-4d6f-4909-9599-388f0c08c29a None None] MFA Rules not processed for user `c09d1a4ac8b64921a6b05fcd567bb770`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:15.867301 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f30e2504-4d6f-4909-9599-388f0c08c29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:15.867651 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 819/1634] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:15 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:15.867651 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb99b4f-9ba0-4632-97d7-2234d4512376 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:15.867651 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb99b4f-9ba0-4632-97d7-2234d4512376 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:15.867651 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d907c3-1f4f-4544-806d-92e4194d3b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:15.867879 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d907c3-1f4f-4544-806d-92e4194d3b55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:15.867879 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d907c3-1f4f-4544-806d-92e4194d3b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:15.867879 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d907c3-1f4f-4544-806d-92e4194d3b55 admin admin] PATH_INFO: `/v3/projects/f608310eee1444c29439fbf92892f485/users/0ec0c0cd62ac41f9a4c93b255e982a04/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:15.871177 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 816/1635] 10.222.0.33 () {58 vars in 1009 bytes} [Fri Sep 16 03:48:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:15.872105 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e2504-4d6f-4909-9599-388f0c08c29a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:15.876440 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d907c3-1f4f-4544-806d-92e4194d3b55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f608310eee1444c29439fbf92892f485, user_id=0ec0c0cd62ac41f9a4c93b255e982a04, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:15.884872 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d907c3-1f4f-4544-806d-92e4194d3b55 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:15.943100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e2504-4d6f-4909-9599-388f0c08c29a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:15.943100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91f930-d4c1-4914-83be-f1fb0f9870de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:15.943100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91f930-d4c1-4914-83be-f1fb0f9870de admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:15.943100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91f930-d4c1-4914-83be-f1fb0f9870de admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:15.943856 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91f930-d4c1-4914-83be-f1fb0f9870de admin admin] PATH_INFO: `/v3/projects/7f32d978507e45589d06fcc5a8516636/users/dfb00d5aab68423096bfcaaca970576e/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:15.943856 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91f930-d4c1-4914-83be-f1fb0f9870de admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f32d978507e45589d06fcc5a8516636, user_id=dfb00d5aab68423096bfcaaca970576e, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:15.943856 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91f930-d4c1-4914-83be-f1fb0f9870de admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:16.331485 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 820/1636] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:48:15 2022] PUT /identity/v3/projects/f608310eee1444c29439fbf92892f485/users/0ec0c0cd62ac41f9a4c93b255e982a04/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:16.332776 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d18138-b612-43a0-92a0-a5a0901f9fd2 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:16.333068 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d18138-b612-43a0-92a0-a5a0901f9fd2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:16.333346 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d18138-b612-43a0-92a0-a5a0901f9fd2 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:16.335415 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 821/1637] 10.222.0.33 () {54 vars in 912 bytes} [Fri Sep 16 03:48:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:48:16.336144 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 817/1638] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:48:15 2022] PUT /identity/v3/projects/7f32d978507e45589d06fcc5a8516636/users/dfb00d5aab68423096bfcaaca970576e/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:16.336261 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d18138-b612-43a0-92a0-a5a0901f9fd2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:16.337035 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91f930-d4c1-4914-83be-f1fb0f9870de admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:16.407647 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91f930-d4c1-4914-83be-f1fb0f9870de admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:16.414375 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d52fe3f-d9bc-445f-ae09-18cc6f8a8739 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:16.415422 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52fe3f-d9bc-445f-ae09-18cc6f8a8739 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:16.415715 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52fe3f-d9bc-445f-ae09-18cc6f8a8739 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:16.415997 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52fe3f-d9bc-445f-ae09-18cc6f8a8739 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:16.454492 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d18138-b612-43a0-92a0-a5a0901f9fd2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:16.460414 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59c691-7735-470e-9ecb-c832a648029e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:16.461069 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59c691-7735-470e-9ecb-c832a648029e service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:16.461376 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59c691-7735-470e-9ecb-c832a648029e service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:16.461729 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59c691-7735-470e-9ecb-c832a648029e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:16.505385 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d52fe3f-d9bc-445f-ae09-18cc6f8a8739 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:16.508007 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d52fe3f-d9bc-445f-ae09-18cc6f8a8739 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:16.523348 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 818/1639] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:16.524664 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d52fe3f-d9bc-445f-ae09-18cc6f8a8739 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:16.614936 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b59c691-7735-470e-9ecb-c832a648029e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:16.616472 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b59c691-7735-470e-9ecb-c832a648029e service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:16.644680 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 822/1640] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:16 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:16.645704 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59c691-7735-470e-9ecb-c832a648029e service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:16.705308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d52fe3f-d9bc-445f-ae09-18cc6f8a8739 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:16.727544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423350e8-b523-4817-b496-1f90b7ac82e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:16.728242 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423350e8-b523-4817-b496-1f90b7ac82e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:16.728527 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423350e8-b523-4817-b496-1f90b7ac82e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:16.728857 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423350e8-b523-4817-b496-1f90b7ac82e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:16.729555 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423350e8-b523-4817-b496-1f90b7ac82e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:16.731406 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423350e8-b523-4817-b496-1f90b7ac82e7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:16.766362 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 819/1641] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:16.771840 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd7f9a-95b6-4147-aff4-9e172a5720c1 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:16.771989 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59c691-7735-470e-9ecb-c832a648029e service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:16.773823 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd7f9a-95b6-4147-aff4-9e172a5720c1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:16.774471 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd7f9a-95b6-4147-aff4-9e172a5720c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:16.778263 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490daca-8e9b-4cab-926e-a78a81d07a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:16.778982 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490daca-8e9b-4cab-926e-a78a81d07a20 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:16.779394 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490daca-8e9b-4cab-926e-a78a81d07a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:16.779743 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490daca-8e9b-4cab-926e-a78a81d07a20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:16.780412 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7490daca-8e9b-4cab-926e-a78a81d07a20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:16.782060 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7490daca-8e9b-4cab-926e-a78a81d07a20 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:16.793208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:16.799361 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 823/1642] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:16.800288 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490daca-8e9b-4cab-926e-a78a81d07a20 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:16.816634 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-aacd7f9a-95b6-4147-aff4-9e172a5720c1 None None] MFA Rules not processed for user `c09d1a4ac8b64921a6b05fcd567bb770`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:16.816966 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490daca-8e9b-4cab-926e-a78a81d07a20 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:16.821000 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-aacd7f9a-95b6-4147-aff4-9e172a5720c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:16.827819 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3259327-16e5-4d96-8a43-1ce766abc602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:16.828476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3259327-16e5-4d96-8a43-1ce766abc602 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:16.828870 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3259327-16e5-4d96-8a43-1ce766abc602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:16.829154 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3259327-16e5-4d96-8a43-1ce766abc602 admin admin] PATH_INFO: `/v3/projects/f608310eee1444c29439fbf92892f485/users/0ec0c0cd62ac41f9a4c93b255e982a04/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:16.834668 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3259327-16e5-4d96-8a43-1ce766abc602 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f608310eee1444c29439fbf92892f485, user_id=0ec0c0cd62ac41f9a4c93b255e982a04, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:16.835165 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 820/1643] 10.222.0.33 () {58 vars in 1009 bytes} [Fri Sep 16 03:48:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:16.845101 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd7f9a-95b6-4147-aff4-9e172a5720c1 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:16.847689 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3259327-16e5-4d96-8a43-1ce766abc602 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:16.860849 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd7f9a-95b6-4147-aff4-9e172a5720c1 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:16.873683 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 824/1644] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:48:16 2022] PUT /identity/v3/projects/f608310eee1444c29439fbf92892f485/users/0ec0c0cd62ac41f9a4c93b255e982a04/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:16.881241 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53477f2c-fdba-4c2c-b58d-14fca47582fe None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:16.882731 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53477f2c-fdba-4c2c-b58d-14fca47582fe None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:16.883193 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53477f2c-fdba-4c2c-b58d-14fca47582fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:16.961663 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-53477f2c-fdba-4c2c-b58d-14fca47582fe None None] MFA Rules not processed for user `0ec0c0cd62ac41f9a4c93b255e982a04`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:16.963908 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-53477f2c-fdba-4c2c-b58d-14fca47582fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:16.995544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281136e-5962-4306-80ed-b9765ad83ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:16.996474 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281136e-5962-4306-80ed-b9765ad83ca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:16.997121 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281136e-5962-4306-80ed-b9765ad83ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:16.997402 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281136e-5962-4306-80ed-b9765ad83ca7 admin admin] PATH_INFO: `/v3/projects/7f32d978507e45589d06fcc5a8516636/users/dfb00d5aab68423096bfcaaca970576e/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:17.003363 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281136e-5962-4306-80ed-b9765ad83ca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f32d978507e45589d06fcc5a8516636, user_id=dfb00d5aab68423096bfcaaca970576e, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:17.010986 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281136e-5962-4306-80ed-b9765ad83ca7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:17.039581 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 821/1645] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:48:16 2022] PUT /identity/v3/projects/7f32d978507e45589d06fcc5a8516636/users/dfb00d5aab68423096bfcaaca970576e/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:17.042011 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281136e-5962-4306-80ed-b9765ad83ca7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:17.045102 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:17.112413 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 825/1646] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:16 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:48:17.113914 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756f44f-8db3-41e5-9ed3-b960436730dd None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:17.114209 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756f44f-8db3-41e5-9ed3-b960436730dd None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:17.114489 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756f44f-8db3-41e5-9ed3-b960436730dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:17.154068 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281136e-5962-4306-80ed-b9765ad83ca7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:17.154261 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1756f44f-8db3-41e5-9ed3-b960436730dd None None] MFA Rules not processed for user `dfb00d5aab68423096bfcaaca970576e`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:17.154261 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1756f44f-8db3-41e5-9ed3-b960436730dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:17.155760 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307eb1b0-6b8c-4c45-b132-0e970492479e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:17.156756 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307eb1b0-6b8c-4c45-b132-0e970492479e service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:17.157181 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307eb1b0-6b8c-4c45-b132-0e970492479e service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:17.157658 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307eb1b0-6b8c-4c45-b132-0e970492479e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:17.262438 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307eb1b0-6b8c-4c45-b132-0e970492479e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:17.264302 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307eb1b0-6b8c-4c45-b132-0e970492479e service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:17.272762 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 826/1647] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:17 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:17.297966 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 822/1648] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:17.951763 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756f44f-8db3-41e5-9ed3-b960436730dd None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:17.966826 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756f44f-8db3-41e5-9ed3-b960436730dd None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:17.975785 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa0178-fd70-4da8-8f5f-6f4fd7b02d9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:17.976387 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa0178-fd70-4da8-8f5f-6f4fd7b02d9a service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:17.976648 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa0178-fd70-4da8-8f5f-6f4fd7b02d9a service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:17.976939 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa0178-fd70-4da8-8f5f-6f4fd7b02d9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:18.051268 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fa0178-fd70-4da8-8f5f-6f4fd7b02d9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:18.052778 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fa0178-fd70-4da8-8f5f-6f4fd7b02d9a service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:18.089924 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 827/1649] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:18.149059 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:18.765233 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:18.860696 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307eb1b0-6b8c-4c45-b132-0e970492479e service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:18.872081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307eb1b0-6b8c-4c45-b132-0e970492479e service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:18.889681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b590f-f7a8-4d2e-85ec-1f5973233477 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:18.890442 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b590f-f7a8-4d2e-85ec-1f5973233477 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:18.890717 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b590f-f7a8-4d2e-85ec-1f5973233477 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:18.890994 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b590f-f7a8-4d2e-85ec-1f5973233477 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:18.951201 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa0178-fd70-4da8-8f5f-6f4fd7b02d9a service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:18.964345 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa0178-fd70-4da8-8f5f-6f4fd7b02d9a service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:18.979005 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fdf450-5142-48a4-a82e-d615b5ff8b55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:18.979759 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdf450-5142-48a4-a82e-d615b5ff8b55 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:18.980067 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdf450-5142-48a4-a82e-d615b5ff8b55 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:18.980318 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdf450-5142-48a4-a82e-d615b5ff8b55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:19.017099 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fdf450-5142-48a4-a82e-d615b5ff8b55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:19.032489 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fdf450-5142-48a4-a82e-d615b5ff8b55 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:19.036664 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b590f-f7a8-4d2e-85ec-1f5973233477 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:19.061772 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b590f-f7a8-4d2e-85ec-1f5973233477 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:19.087551 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 828/1650] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:18 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 03:48:19.095023 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 823/1651] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:18 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:19.927098 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fdf450-5142-48a4-a82e-d615b5ff8b55 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:20.093426 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fdf450-5142-48a4-a82e-d615b5ff8b55 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:20.101228 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27a6fa-fba4-4bf3-9cba-2b41a4fe62bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:20.102756 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27a6fa-fba4-4bf3-9cba-2b41a4fe62bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:20.103374 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27a6fa-fba4-4bf3-9cba-2b41a4fe62bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:20.103914 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27a6fa-fba4-4bf3-9cba-2b41a4fe62bf admin admin] PATH_INFO: `/v3/users/6052160b0fdf4dfcab85c2d357f3e052` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:20.105799 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27a6fa-fba4-4bf3-9cba-2b41a4fe62bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6052160b0fdf4dfcab85c2d357f3e052)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:20.112525 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27a6fa-fba4-4bf3-9cba-2b41a4fe62bf admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:20.451325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1a27a6fa-fba4-4bf3-9cba-2b41a4fe62bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6052160b0fdf4dfcab85c2d357f3e052'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:20.452825 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1a27a6fa-fba4-4bf3-9cba-2b41a4fe62bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6052160b0fdf4dfcab85c2d357f3e052'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:20.465468 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1a27a6fa-fba4-4bf3-9cba-2b41a4fe62bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6052160b0fdf4dfcab85c2d357f3e052'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:20.482697 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1a27a6fa-fba4-4bf3-9cba-2b41a4fe62bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6052160b0fdf4dfcab85c2d357f3e052'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:20.483529 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1a27a6fa-fba4-4bf3-9cba-2b41a4fe62bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6052160b0fdf4dfcab85c2d357f3e052'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:20.621721 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 829/1652] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:48:19 2022] DELETE /identity/v3/users/6052160b0fdf4dfcab85c2d357f3e052 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:20.626122 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ddc7f-0d91-439b-8dcb-4142835aee2a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:20.627295 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ddc7f-0d91-439b-8dcb-4142835aee2a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:20.627711 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ddc7f-0d91-439b-8dcb-4142835aee2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:20.665232 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f62ddc7f-0d91-439b-8dcb-4142835aee2a None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:20.667011 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f62ddc7f-0d91-439b-8dcb-4142835aee2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:20.729839 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:20.842951 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 824/1653] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:20.860675 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27a6fa-fba4-4bf3-9cba-2b41a4fe62bf admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:20.863027 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1a27a6fa-fba4-4bf3-9cba-2b41a4fe62bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:21.060149 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27a6fa-fba4-4bf3-9cba-2b41a4fe62bf admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:21.073677 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad6b59-971a-4829-9334-35961f01a2b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:21.076922 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad6b59-971a-4829-9334-35961f01a2b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:21.077929 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad6b59-971a-4829-9334-35961f01a2b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:21.079769 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad6b59-971a-4829-9334-35961f01a2b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:21.108266 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad6b59-971a-4829-9334-35961f01a2b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:21.112060 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad6b59-971a-4829-9334-35961f01a2b3 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:21.154743 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 830/1654] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:21.547230 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:22.464517 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ddc7f-0d91-439b-8dcb-4142835aee2a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:22.466129 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f62ddc7f-0d91-439b-8dcb-4142835aee2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:22.513695 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ddc7f-0d91-439b-8dcb-4142835aee2a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:22.537267 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131b27c-1f68-4e1f-ab71-e5e14c2bfae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:22.537981 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131b27c-1f68-4e1f-ab71-e5e14c2bfae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:22.542785 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131b27c-1f68-4e1f-ab71-e5e14c2bfae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:22.543122 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131b27c-1f68-4e1f-ab71-e5e14c2bfae5 admin admin] PATH_INFO: `/v3/users/4dc376951a6c43bb895a23aaa7ca0501` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:22.551053 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131b27c-1f68-4e1f-ab71-e5e14c2bfae5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dc376951a6c43bb895a23aaa7ca0501)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:22.554374 dv-cinder-857993-1-smb devstack@keystone.service[81776]: WARNING py.warnings [None req-1131b27c-1f68-4e1f-ab71-e5e14c2bfae5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 03:48:22.554374 dv-cinder-857993-1-smb devstack@keystone.service[81776]: warnings.warn(msg) Sep 16 03:48:22.554374 dv-cinder-857993-1-smb devstack@keystone.service[81776]: Sep 16 03:48:22.561115 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131b27c-1f68-4e1f-ab71-e5e14c2bfae5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:22.631243 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b202d-db06-420f-b017-9963d24f1059 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:22.631792 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b202d-db06-420f-b017-9963d24f1059 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:22.631865 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b202d-db06-420f-b017-9963d24f1059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:22.716130 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b28b202d-db06-420f-b017-9963d24f1059 None None] MFA Rules not processed for user `6efa7a654e2d4e3e9066aa361460729d`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:22.728405 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b28b202d-db06-420f-b017-9963d24f1059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:22.958497 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1131b27c-1f68-4e1f-ab71-e5e14c2bfae5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dc376951a6c43bb895a23aaa7ca0501'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:22.959263 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1131b27c-1f68-4e1f-ab71-e5e14c2bfae5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dc376951a6c43bb895a23aaa7ca0501'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:22.979947 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 831/1655] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:48:22.981201 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b202d-db06-420f-b017-9963d24f1059 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:22.984331 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b28b202d-db06-420f-b017-9963d24f1059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:22.989393 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1131b27c-1f68-4e1f-ab71-e5e14c2bfae5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dc376951a6c43bb895a23aaa7ca0501'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:23.014462 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b202d-db06-420f-b017-9963d24f1059 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:23.044888 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fa5ae-cf72-4507-9d27-299bc1eb9638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:23.044888 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fa5ae-cf72-4507-9d27-299bc1eb9638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:23.044888 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fa5ae-cf72-4507-9d27-299bc1eb9638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:23.045255 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fa5ae-cf72-4507-9d27-299bc1eb9638 admin admin] PATH_INFO: `/v3/projects/60c50188ec1948abbb0d66ff910ebee8` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:23.047307 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002fa5ae-cf72-4507-9d27-299bc1eb9638 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60c50188ec1948abbb0d66ff910ebee8)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:23.048972 dv-cinder-857993-1-smb devstack@keystone.service[81775]: WARNING py.warnings [None req-002fa5ae-cf72-4507-9d27-299bc1eb9638 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 03:48:23.048972 dv-cinder-857993-1-smb devstack@keystone.service[81775]: warnings.warn(msg) Sep 16 03:48:23.048972 dv-cinder-857993-1-smb devstack@keystone.service[81775]: Sep 16 03:48:23.050728 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1131b27c-1f68-4e1f-ab71-e5e14c2bfae5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dc376951a6c43bb895a23aaa7ca0501'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:23.051149 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002fa5ae-cf72-4507-9d27-299bc1eb9638 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:23.051509 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1131b27c-1f68-4e1f-ab71-e5e14c2bfae5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dc376951a6c43bb895a23aaa7ca0501'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:23.176083 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 825/1656] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:48:22 2022] DELETE /identity/v3/users/4dc376951a6c43bb895a23aaa7ca0501 => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:23.180393 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131b27c-1f68-4e1f-ab71-e5e14c2bfae5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:23.182673 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1131b27c-1f68-4e1f-ab71-e5e14c2bfae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:23.284321 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:23.310543 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131b27c-1f68-4e1f-ab71-e5e14c2bfae5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:23.323225 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-002fa5ae-cf72-4507-9d27-299bc1eb9638 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60c50188ec1948abbb0d66ff910ebee8', 'request_id': 'req-002fa5ae-cf72-4507-9d27-299bc1eb9638'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:23.416975 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-002fa5ae-cf72-4507-9d27-299bc1eb9638 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60c50188ec1948abbb0d66ff910ebee8', 'request_id': 'req-002fa5ae-cf72-4507-9d27-299bc1eb9638'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:23.468810 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-002fa5ae-cf72-4507-9d27-299bc1eb9638 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60c50188ec1948abbb0d66ff910ebee8', 'request_id': 'req-002fa5ae-cf72-4507-9d27-299bc1eb9638'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:23.491095 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-002fa5ae-cf72-4507-9d27-299bc1eb9638 admin admin] The token cache is being invalidate because project 60c50188ec1948abbb0d66ff910ebee8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:48:23.492161 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-002fa5ae-cf72-4507-9d27-299bc1eb9638 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:23.498770 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-002fa5ae-cf72-4507-9d27-299bc1eb9638 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:23.499301 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c29fd-a520-4700-8858-0626c20f6bba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:23.500485 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c29fd-a520-4700-8858-0626c20f6bba service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:23.500954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c29fd-a520-4700-8858-0626c20f6bba service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:23.501575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c29fd-a520-4700-8858-0626c20f6bba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:23.503898 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-385c29fd-a520-4700-8858-0626c20f6bba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:23.505686 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 832/1657] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:48:22 2022] DELETE /identity/v3/projects/60c50188ec1948abbb0d66ff910ebee8 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:23.509140 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08c29b-b1d3-4c0e-91b4-42a8b5efae81 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:23.509437 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08c29b-b1d3-4c0e-91b4-42a8b5efae81 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:23.509737 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08c29b-b1d3-4c0e-91b4-42a8b5efae81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:23.569672 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3d08c29b-b1d3-4c0e-91b4-42a8b5efae81 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:23.571051 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3d08c29b-b1d3-4c0e-91b4-42a8b5efae81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:23.735687 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 833/1658] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:23.737370 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08c29b-b1d3-4c0e-91b4-42a8b5efae81 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:23.745904 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3d08c29b-b1d3-4c0e-91b4-42a8b5efae81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:23.768299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c29fd-a520-4700-8858-0626c20f6bba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:23.778861 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c29fd-a520-4700-8858-0626c20f6bba service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:23.779100 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08c29b-b1d3-4c0e-91b4-42a8b5efae81 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:23.785547 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404768b3-9c85-4ba5-a041-d812f5d1f508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:23.786759 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404768b3-9c85-4ba5-a041-d812f5d1f508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:23.786889 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404768b3-9c85-4ba5-a041-d812f5d1f508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:23.787256 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404768b3-9c85-4ba5-a041-d812f5d1f508 admin admin] PATH_INFO: `/v3/users/bdec02d06b5e45b5bb6d4738541306d0` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:23.794099 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404768b3-9c85-4ba5-a041-d812f5d1f508 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdec02d06b5e45b5bb6d4738541306d0)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:23.799220 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404768b3-9c85-4ba5-a041-d812f5d1f508 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:23.814669 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 826/1659] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:23.826307 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c29fd-a520-4700-8858-0626c20f6bba service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:23.832736 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-385c29fd-a520-4700-8858-0626c20f6bba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:23.876276 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c29fd-a520-4700-8858-0626c20f6bba service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:23.882104 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1979178-16cb-468d-b63f-21a5c01901dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:23.883095 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1979178-16cb-468d-b63f-21a5c01901dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:23.883595 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1979178-16cb-468d-b63f-21a5c01901dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:23.884065 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1979178-16cb-468d-b63f-21a5c01901dc admin admin] PATH_INFO: `/v3/users/0ec0c0cd62ac41f9a4c93b255e982a04` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:23.885470 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1979178-16cb-468d-b63f-21a5c01901dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ec0c0cd62ac41f9a4c93b255e982a04)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:23.888253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1979178-16cb-468d-b63f-21a5c01901dc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:24.079414 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-404768b3-9c85-4ba5-a041-d812f5d1f508 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdec02d06b5e45b5bb6d4738541306d0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:24.081392 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-404768b3-9c85-4ba5-a041-d812f5d1f508 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdec02d06b5e45b5bb6d4738541306d0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:24.116816 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-404768b3-9c85-4ba5-a041-d812f5d1f508 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdec02d06b5e45b5bb6d4738541306d0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:24.133794 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-404768b3-9c85-4ba5-a041-d812f5d1f508 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdec02d06b5e45b5bb6d4738541306d0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:24.134680 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-404768b3-9c85-4ba5-a041-d812f5d1f508 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdec02d06b5e45b5bb6d4738541306d0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:24.213421 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e1979178-16cb-468d-b63f-21a5c01901dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ec0c0cd62ac41f9a4c93b255e982a04'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:24.214451 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e1979178-16cb-468d-b63f-21a5c01901dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ec0c0cd62ac41f9a4c93b255e982a04'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:24.238334 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e1979178-16cb-468d-b63f-21a5c01901dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ec0c0cd62ac41f9a4c93b255e982a04'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:24.257995 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 834/1660] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:48:23 2022] DELETE /identity/v3/users/bdec02d06b5e45b5bb6d4738541306d0 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:24.257995 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404768b3-9c85-4ba5-a041-d812f5d1f508 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:24.259959 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-404768b3-9c85-4ba5-a041-d812f5d1f508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:24.286623 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e1979178-16cb-468d-b63f-21a5c01901dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ec0c0cd62ac41f9a4c93b255e982a04'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:24.288934 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e1979178-16cb-468d-b63f-21a5c01901dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ec0c0cd62ac41f9a4c93b255e982a04'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:24.392698 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 827/1661] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:48:23 2022] DELETE /identity/v3/users/0ec0c0cd62ac41f9a4c93b255e982a04 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:24.399386 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde1d9a-e543-4902-912a-1f4a330a6aac None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:24.400368 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde1d9a-e543-4902-912a-1f4a330a6aac None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:24.400368 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde1d9a-e543-4902-912a-1f4a330a6aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:24.427843 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404768b3-9c85-4ba5-a041-d812f5d1f508 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:24.439904 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8cde1d9a-e543-4902-912a-1f4a330a6aac None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:24.441377 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8cde1d9a-e543-4902-912a-1f4a330a6aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:24.598843 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 828/1662] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:24.600239 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51fe1b8-2858-4313-97f5-e885b2aa6e8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:24.601357 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fe1b8-2858-4313-97f5-e885b2aa6e8b service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:24.601659 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fe1b8-2858-4313-97f5-e885b2aa6e8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:24.601942 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fe1b8-2858-4313-97f5-e885b2aa6e8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:24.604803 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b51fe1b8-2858-4313-97f5-e885b2aa6e8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:24.632853 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde1d9a-e543-4902-912a-1f4a330a6aac None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:24.633545 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51fe1b8-2858-4313-97f5-e885b2aa6e8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:24.635081 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51fe1b8-2858-4313-97f5-e885b2aa6e8b service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:24.638249 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8cde1d9a-e543-4902-912a-1f4a330a6aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:24.661452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 835/1663] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:24.673013 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde1d9a-e543-4902-912a-1f4a330a6aac None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:24.688560 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfcc7f0-0a24-4eae-ad38-3c92a22c3e68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:24.690536 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcc7f0-0a24-4eae-ad38-3c92a22c3e68 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:24.691140 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcc7f0-0a24-4eae-ad38-3c92a22c3e68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:24.691140 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcc7f0-0a24-4eae-ad38-3c92a22c3e68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:24.715484 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfcc7f0-0a24-4eae-ad38-3c92a22c3e68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:24.719041 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfcc7f0-0a24-4eae-ad38-3c92a22c3e68 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:24.747848 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 829/1664] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 03:48:24.788149 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:25.329142 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51fe1b8-2858-4313-97f5-e885b2aa6e8b service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:25.329142 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b51fe1b8-2858-4313-97f5-e885b2aa6e8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:25.355335 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51fe1b8-2858-4313-97f5-e885b2aa6e8b service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:25.390387 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668fc24-12fe-405c-837d-6059a90e585e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:25.390387 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668fc24-12fe-405c-837d-6059a90e585e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:25.390387 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668fc24-12fe-405c-837d-6059a90e585e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:25.390387 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668fc24-12fe-405c-837d-6059a90e585e admin admin] PATH_INFO: `/v3/users/76f4e95a87a1499a828b2bfb6e3ed1d7` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:25.390687 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f668fc24-12fe-405c-837d-6059a90e585e admin admin] RBAC: Authorizing `identity:delete_user(user_id=76f4e95a87a1499a828b2bfb6e3ed1d7)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:25.390687 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f668fc24-12fe-405c-837d-6059a90e585e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:25.734891 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f668fc24-12fe-405c-837d-6059a90e585e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76f4e95a87a1499a828b2bfb6e3ed1d7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:25.741847 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f668fc24-12fe-405c-837d-6059a90e585e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76f4e95a87a1499a828b2bfb6e3ed1d7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:25.761699 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f668fc24-12fe-405c-837d-6059a90e585e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76f4e95a87a1499a828b2bfb6e3ed1d7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:25.795927 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f668fc24-12fe-405c-837d-6059a90e585e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76f4e95a87a1499a828b2bfb6e3ed1d7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:25.798975 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f668fc24-12fe-405c-837d-6059a90e585e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76f4e95a87a1499a828b2bfb6e3ed1d7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:25.895245 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 836/1665] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:48:25 2022] DELETE /identity/v3/users/76f4e95a87a1499a828b2bfb6e3ed1d7 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:25.900090 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf08f0-ede2-4d44-87b1-27c90b01c721 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:25.901337 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf08f0-ede2-4d44-87b1-27c90b01c721 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:25.901850 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf08f0-ede2-4d44-87b1-27c90b01c721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:25.946997 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-bfdf08f0-ede2-4d44-87b1-27c90b01c721 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:25.947756 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668fc24-12fe-405c-837d-6059a90e585e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:25.949513 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f668fc24-12fe-405c-837d-6059a90e585e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:25.950403 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bfdf08f0-ede2-4d44-87b1-27c90b01c721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:26.070375 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:26.122107 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 830/1666] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:26.123735 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d081dd-322b-4759-892f-077585fa3459 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:26.134106 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d081dd-322b-4759-892f-077585fa3459 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:26.140116 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d081dd-322b-4759-892f-077585fa3459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:26.208369 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668fc24-12fe-405c-837d-6059a90e585e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:26.227038 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf9f46-6d0d-43cc-baae-871567d48e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:26.228363 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf9f46-6d0d-43cc-baae-871567d48e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:26.232339 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf9f46-6d0d-43cc-baae-871567d48e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:26.233149 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf9f46-6d0d-43cc-baae-871567d48e7b admin admin] PATH_INFO: `/v3/projects/f608310eee1444c29439fbf92892f485` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:26.237476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf9f46-6d0d-43cc-baae-871567d48e7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f608310eee1444c29439fbf92892f485)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:26.244830 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf9f46-6d0d-43cc-baae-871567d48e7b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:26.275366 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e2d081dd-322b-4759-892f-077585fa3459 None None] MFA Rules not processed for user `c04a0f9a09a24473a9377ca68fc638b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:26.276716 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e2d081dd-322b-4759-892f-077585fa3459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:26.474081 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5cbf9f46-6d0d-43cc-baae-871567d48e7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f608310eee1444c29439fbf92892f485', 'request_id': 'req-5cbf9f46-6d0d-43cc-baae-871567d48e7b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:26.474648 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 831/1667] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:26.476295 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d081dd-322b-4759-892f-077585fa3459 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:26.486573 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e2d081dd-322b-4759-892f-077585fa3459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:26.583671 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5cbf9f46-6d0d-43cc-baae-871567d48e7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f608310eee1444c29439fbf92892f485', 'request_id': 'req-5cbf9f46-6d0d-43cc-baae-871567d48e7b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:26.595271 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5cbf9f46-6d0d-43cc-baae-871567d48e7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f608310eee1444c29439fbf92892f485', 'request_id': 'req-5cbf9f46-6d0d-43cc-baae-871567d48e7b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:26.623591 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5cbf9f46-6d0d-43cc-baae-871567d48e7b admin admin] The token cache is being invalidate because project f608310eee1444c29439fbf92892f485 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:48:26.623888 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5cbf9f46-6d0d-43cc-baae-871567d48e7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:26.624976 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d081dd-322b-4759-892f-077585fa3459 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:26.625461 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5cbf9f46-6d0d-43cc-baae-871567d48e7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:26.634077 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 837/1668] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:48:25 2022] DELETE /identity/v3/projects/f608310eee1444c29439fbf92892f485 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:26.639619 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf9f46-6d0d-43cc-baae-871567d48e7b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:26.641241 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5cbf9f46-6d0d-43cc-baae-871567d48e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:26.802724 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79144f-4492-4f1a-8230-1c4219de5169 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:26.803883 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79144f-4492-4f1a-8230-1c4219de5169 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:26.804159 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79144f-4492-4f1a-8230-1c4219de5169 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:26.804435 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79144f-4492-4f1a-8230-1c4219de5169 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:26.809867 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6e79144f-4492-4f1a-8230-1c4219de5169 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:26.911139 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf9f46-6d0d-43cc-baae-871567d48e7b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:26.927016 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff88b1e-ea40-4a52-bb5e-e4358d9b7dc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:26.927728 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff88b1e-ea40-4a52-bb5e-e4358d9b7dc3 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:26.928856 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff88b1e-ea40-4a52-bb5e-e4358d9b7dc3 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:26.929154 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff88b1e-ea40-4a52-bb5e-e4358d9b7dc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:26.933282 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2ff88b1e-ea40-4a52-bb5e-e4358d9b7dc3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:27.054856 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79144f-4492-4f1a-8230-1c4219de5169 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:27.057056 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79144f-4492-4f1a-8230-1c4219de5169 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:27.074064 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 832/1669] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:27.075986 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c47f8-d0c2-4925-a900-cd90f4b376f9 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:27.076550 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c47f8-d0c2-4925-a900-cd90f4b376f9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:27.087434 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c47f8-d0c2-4925-a900-cd90f4b376f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:27.128843 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff88b1e-ea40-4a52-bb5e-e4358d9b7dc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:27.130035 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-af4c47f8-d0c2-4925-a900-cd90f4b376f9 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:27.130540 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff88b1e-ea40-4a52-bb5e-e4358d9b7dc3 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:27.131626 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-af4c47f8-d0c2-4925-a900-cd90f4b376f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:27.141040 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 833/1670] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:27.142373 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c47f8-d0c2-4925-a900-cd90f4b376f9 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:27.144218 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-af4c47f8-d0c2-4925-a900-cd90f4b376f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:27.157532 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c47f8-d0c2-4925-a900-cd90f4b376f9 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:27.182163 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 838/1671] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:27.183213 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff88b1e-ea40-4a52-bb5e-e4358d9b7dc3 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:27.205336 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2ff88b1e-ea40-4a52-bb5e-e4358d9b7dc3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:27.208074 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c448a-1602-4575-949d-bda47530ba23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:27.212453 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c448a-1602-4575-949d-bda47530ba23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:27.212453 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c448a-1602-4575-949d-bda47530ba23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:27.215965 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c448a-1602-4575-949d-bda47530ba23 admin admin] PATH_INFO: `/v3/projects/485d2843797d4df9bd9a1700516a88d4` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:27.222640 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c448a-1602-4575-949d-bda47530ba23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=485d2843797d4df9bd9a1700516a88d4)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:27.235796 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c448a-1602-4575-949d-bda47530ba23 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:27.279051 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff88b1e-ea40-4a52-bb5e-e4358d9b7dc3 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:27.317865 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290407ae-b4af-41be-8abe-82bc6dbc7666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:27.318537 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290407ae-b4af-41be-8abe-82bc6dbc7666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:27.318854 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290407ae-b4af-41be-8abe-82bc6dbc7666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:27.319325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290407ae-b4af-41be-8abe-82bc6dbc7666 admin admin] PATH_INFO: `/v3/projects/f0a60ffebb9b4e17915fa1a53914a3a0` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:27.322230 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290407ae-b4af-41be-8abe-82bc6dbc7666 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0a60ffebb9b4e17915fa1a53914a3a0)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:27.345889 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290407ae-b4af-41be-8abe-82bc6dbc7666 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:27.542822 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-040c448a-1602-4575-949d-bda47530ba23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '485d2843797d4df9bd9a1700516a88d4', 'request_id': 'req-040c448a-1602-4575-949d-bda47530ba23'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:27.569621 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:27.596513 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-290407ae-b4af-41be-8abe-82bc6dbc7666 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0a60ffebb9b4e17915fa1a53914a3a0', 'request_id': 'req-290407ae-b4af-41be-8abe-82bc6dbc7666'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:27.681547 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-040c448a-1602-4575-949d-bda47530ba23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '485d2843797d4df9bd9a1700516a88d4', 'request_id': 'req-040c448a-1602-4575-949d-bda47530ba23'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:27.694040 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-040c448a-1602-4575-949d-bda47530ba23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '485d2843797d4df9bd9a1700516a88d4', 'request_id': 'req-040c448a-1602-4575-949d-bda47530ba23'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:27.710576 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-040c448a-1602-4575-949d-bda47530ba23 admin admin] The token cache is being invalidate because project 485d2843797d4df9bd9a1700516a88d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:48:27.710880 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-040c448a-1602-4575-949d-bda47530ba23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:27.711955 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-040c448a-1602-4575-949d-bda47530ba23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:27.714665 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 834/1672] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:48:27 2022] DELETE /identity/v3/projects/485d2843797d4df9bd9a1700516a88d4 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:27.717568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c99f9d-dfcc-4783-889f-08a691d236bd None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:27.717568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c99f9d-dfcc-4783-889f-08a691d236bd None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:27.717568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c99f9d-dfcc-4783-889f-08a691d236bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:27.761644 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f1c99f9d-dfcc-4783-889f-08a691d236bd None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:27.764533 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-290407ae-b4af-41be-8abe-82bc6dbc7666 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0a60ffebb9b4e17915fa1a53914a3a0', 'request_id': 'req-290407ae-b4af-41be-8abe-82bc6dbc7666'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:27.764659 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f1c99f9d-dfcc-4783-889f-08a691d236bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:27.774689 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-290407ae-b4af-41be-8abe-82bc6dbc7666 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0a60ffebb9b4e17915fa1a53914a3a0', 'request_id': 'req-290407ae-b4af-41be-8abe-82bc6dbc7666'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:27.804706 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-290407ae-b4af-41be-8abe-82bc6dbc7666 admin admin] The token cache is being invalidate because project f0a60ffebb9b4e17915fa1a53914a3a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:48:27.805218 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-290407ae-b4af-41be-8abe-82bc6dbc7666 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:27.809491 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-290407ae-b4af-41be-8abe-82bc6dbc7666 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:27.811233 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 839/1673] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:48:27 2022] DELETE /identity/v3/projects/f0a60ffebb9b4e17915fa1a53914a3a0 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:27.813395 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d48e7-50b0-491e-8a70-83d936a5dcdd None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:27.813896 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d48e7-50b0-491e-8a70-83d936a5dcdd None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:27.819856 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d48e7-50b0-491e-8a70-83d936a5dcdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:27.901600 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d38d48e7-50b0-491e-8a70-83d936a5dcdd None None] MFA Rules not processed for user `5832b2a9564f49338f91e6672343ef61`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:27.907082 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 835/1674] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:27.907200 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d38d48e7-50b0-491e-8a70-83d936a5dcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:27.908508 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c99f9d-dfcc-4783-889f-08a691d236bd None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:27.913097 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f1c99f9d-dfcc-4783-889f-08a691d236bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:27.926956 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c99f9d-dfcc-4783-889f-08a691d236bd None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:27.948654 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5c4d0-d5e4-49c2-a371-3bc925edeb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:27.950162 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5c4d0-d5e4-49c2-a371-3bc925edeb2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:27.952994 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5c4d0-d5e4-49c2-a371-3bc925edeb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:27.952994 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5c4d0-d5e4-49c2-a371-3bc925edeb2a admin admin] PATH_INFO: `/v3/users/dfb00d5aab68423096bfcaaca970576e` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:27.952994 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e5c4d0-d5e4-49c2-a371-3bc925edeb2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfb00d5aab68423096bfcaaca970576e)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:27.960183 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e5c4d0-d5e4-49c2-a371-3bc925edeb2a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:28.058004 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 840/1675] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:28.059951 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cae59d-c935-4163-a390-fd50a00fe182 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:28.060822 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cae59d-c935-4163-a390-fd50a00fe182 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:28.061257 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cae59d-c935-4163-a390-fd50a00fe182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:28.100818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-79cae59d-c935-4163-a390-fd50a00fe182 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:28.102282 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-79cae59d-c935-4163-a390-fd50a00fe182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:28.113312 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 841/1676] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:28.114610 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cae59d-c935-4163-a390-fd50a00fe182 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:28.130734 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cae59d-c935-4163-a390-fd50a00fe182 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:28.137219 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b7592-149d-483f-96eb-db8440cf5cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:28.138229 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b7592-149d-483f-96eb-db8440cf5cbe admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:28.138756 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b7592-149d-483f-96eb-db8440cf5cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:28.139224 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b7592-149d-483f-96eb-db8440cf5cbe admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:28.140074 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b7592-149d-483f-96eb-db8440cf5cbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:48:28.140533 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b7592-149d-483f-96eb-db8440cf5cbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:28.142329 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b7592-149d-483f-96eb-db8440cf5cbe admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:28.181360 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 842/1677] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:48:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:48:28.183101 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b337fc1-29cb-47a8-9d7d-37c1b761c17d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:28.183602 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b337fc1-29cb-47a8-9d7d-37c1b761c17d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:28.184614 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b337fc1-29cb-47a8-9d7d-37c1b761c17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:28.217923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3b337fc1-29cb-47a8-9d7d-37c1b761c17d None None] MFA Rules not processed for user `5832b2a9564f49338f91e6672343ef61`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:28.225095 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3b337fc1-29cb-47a8-9d7d-37c1b761c17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:28.236905 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-16e5c4d0-d5e4-49c2-a371-3bc925edeb2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfb00d5aab68423096bfcaaca970576e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:28.238620 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-16e5c4d0-d5e4-49c2-a371-3bc925edeb2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfb00d5aab68423096bfcaaca970576e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:28.247586 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 843/1678] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:28.250346 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48551eb8-7ccf-4d9b-97fd-5aab8072ed18 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:28.251247 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48551eb8-7ccf-4d9b-97fd-5aab8072ed18 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:28.252299 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48551eb8-7ccf-4d9b-97fd-5aab8072ed18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:28.258688 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-16e5c4d0-d5e4-49c2-a371-3bc925edeb2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfb00d5aab68423096bfcaaca970576e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:28.290584 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-16e5c4d0-d5e4-49c2-a371-3bc925edeb2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfb00d5aab68423096bfcaaca970576e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:28.291611 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-16e5c4d0-d5e4-49c2-a371-3bc925edeb2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfb00d5aab68423096bfcaaca970576e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:28.294618 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-48551eb8-7ccf-4d9b-97fd-5aab8072ed18 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:28.297982 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-48551eb8-7ccf-4d9b-97fd-5aab8072ed18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:28.308262 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 844/1679] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:28.309463 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48551eb8-7ccf-4d9b-97fd-5aab8072ed18 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:28.311200 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-48551eb8-7ccf-4d9b-97fd-5aab8072ed18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:28.326257 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48551eb8-7ccf-4d9b-97fd-5aab8072ed18 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:28.331487 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6d971-e98f-4a54-8730-6d55327a8c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:28.332429 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6d971-e98f-4a54-8730-6d55327a8c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:28.333516 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6d971-e98f-4a54-8730-6d55327a8c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:28.333516 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6d971-e98f-4a54-8730-6d55327a8c77 admin admin] PATH_INFO: `/v3/projects/53a117163c954df19033f4d7b59184a8` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:28.335509 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead6d971-e98f-4a54-8730-6d55327a8c77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53a117163c954df19033f4d7b59184a8)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:28.337496 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead6d971-e98f-4a54-8730-6d55327a8c77 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:28.431127 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 836/1680] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:48:27 2022] DELETE /identity/v3/users/dfb00d5aab68423096bfcaaca970576e => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:28.433337 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5c4d0-d5e4-49c2-a371-3bc925edeb2a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:28.441444 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-16e5c4d0-d5e4-49c2-a371-3bc925edeb2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:28.480311 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ead6d971-e98f-4a54-8730-6d55327a8c77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53a117163c954df19033f4d7b59184a8', 'request_id': 'req-ead6d971-e98f-4a54-8730-6d55327a8c77'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:28.554342 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5c4d0-d5e4-49c2-a371-3bc925edeb2a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:28.564567 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ead6d971-e98f-4a54-8730-6d55327a8c77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53a117163c954df19033f4d7b59184a8', 'request_id': 'req-ead6d971-e98f-4a54-8730-6d55327a8c77'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:28.581104 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ead6d971-e98f-4a54-8730-6d55327a8c77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53a117163c954df19033f4d7b59184a8', 'request_id': 'req-ead6d971-e98f-4a54-8730-6d55327a8c77'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:28.628196 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ead6d971-e98f-4a54-8730-6d55327a8c77 admin admin] The token cache is being invalidate because project 53a117163c954df19033f4d7b59184a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:48:28.629985 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ead6d971-e98f-4a54-8730-6d55327a8c77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:28.632101 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ead6d971-e98f-4a54-8730-6d55327a8c77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:28.635470 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 845/1681] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:48:28 2022] DELETE /identity/v3/projects/53a117163c954df19033f4d7b59184a8 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:28.642170 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6d971-e98f-4a54-8730-6d55327a8c77 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:28.648677 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ead6d971-e98f-4a54-8730-6d55327a8c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:28.673921 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1cc1c-8bca-4d1d-b268-204e8073dff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:28.674743 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1cc1c-8bca-4d1d-b268-204e8073dff9 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:28.675031 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1cc1c-8bca-4d1d-b268-204e8073dff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:28.675307 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1cc1c-8bca-4d1d-b268-204e8073dff9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:28.676091 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d1cc1c-8bca-4d1d-b268-204e8073dff9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:28.678116 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d1cc1c-8bca-4d1d-b268-204e8073dff9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:28.725292 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:28.777063 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6d971-e98f-4a54-8730-6d55327a8c77 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:28.784381 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002818a-dc70-4335-b531-0db8ffafd39d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:28.785020 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002818a-dc70-4335-b531-0db8ffafd39d service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:28.785306 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002818a-dc70-4335-b531-0db8ffafd39d service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:28.785585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002818a-dc70-4335-b531-0db8ffafd39d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:28.787618 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0002818a-dc70-4335-b531-0db8ffafd39d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:28.856827 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002818a-dc70-4335-b531-0db8ffafd39d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:28.859072 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002818a-dc70-4335-b531-0db8ffafd39d service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:28.868579 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 837/1682] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:48:28 2022] POST /identity/v3/projects => generated 371 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:28.869573 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1cc1c-8bca-4d1d-b268-204e8073dff9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:28.871497 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a2d1cc1c-8bca-4d1d-b268-204e8073dff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:28.873043 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 846/1683] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:28.875049 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe1b2e-d091-4a36-9f14-f8e1dc675e84 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:28.876100 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe1b2e-d091-4a36-9f14-f8e1dc675e84 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:28.876698 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe1b2e-d091-4a36-9f14-f8e1dc675e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:28.901093 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-adbe1b2e-d091-4a36-9f14-f8e1dc675e84 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:28.902820 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-adbe1b2e-d091-4a36-9f14-f8e1dc675e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:28.964951 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1cc1c-8bca-4d1d-b268-204e8073dff9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:28.972468 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f25c731-e1ec-4a31-a17c-75ca69532aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:28.973686 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f25c731-e1ec-4a31-a17c-75ca69532aff admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:28.974368 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f25c731-e1ec-4a31-a17c-75ca69532aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:28.975832 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f25c731-e1ec-4a31-a17c-75ca69532aff admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:28.976936 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f25c731-e1ec-4a31-a17c-75ca69532aff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:48:28.977441 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f25c731-e1ec-4a31-a17c-75ca69532aff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:28.984397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f25c731-e1ec-4a31-a17c-75ca69532aff admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:29.012756 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 838/1684] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:48:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:48:29.015523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f25c731-e1ec-4a31-a17c-75ca69532aff admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:29.016264 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9f25c731-e1ec-4a31-a17c-75ca69532aff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:29.056191 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f25c731-e1ec-4a31-a17c-75ca69532aff admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:29.075899 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2cbab-edb9-4903-a4d5-170056ec6e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:29.076543 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2cbab-edb9-4903-a4d5-170056ec6e13 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:29.076825 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2cbab-edb9-4903-a4d5-170056ec6e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:29.077099 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2cbab-edb9-4903-a4d5-170056ec6e13 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:29.077770 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e2cbab-edb9-4903-a4d5-170056ec6e13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:29.084282 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 847/1685] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:29.085548 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe1b2e-d091-4a36-9f14-f8e1dc675e84 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:29.086942 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e2cbab-edb9-4903-a4d5-170056ec6e13 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:29.119892 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe1b2e-d091-4a36-9f14-f8e1dc675e84 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:29.131686 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f3420-3b82-4a9f-b96d-c82055b6bfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:29.132815 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f3420-3b82-4a9f-b96d-c82055b6bfc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:29.134326 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f3420-3b82-4a9f-b96d-c82055b6bfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:29.134995 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f3420-3b82-4a9f-b96d-c82055b6bfc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:29.138406 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93f3420-3b82-4a9f-b96d-c82055b6bfc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:29.142110 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93f3420-3b82-4a9f-b96d-c82055b6bfc7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:29.234666 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 839/1686] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:48:29 2022] POST /identity/v3/users => generated 286 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:29.236632 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee959a-0273-4a44-94c4-234b3f67e33e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:29.237423 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee959a-0273-4a44-94c4-234b3f67e33e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:29.237969 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee959a-0273-4a44-94c4-234b3f67e33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:29.271638 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e2ee959a-0273-4a44-94c4-234b3f67e33e None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:29.273382 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e2ee959a-0273-4a44-94c4-234b3f67e33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:29.275107 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 848/1687] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:48:29 2022] POST /identity/v3/projects => generated 375 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:29.276957 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f3420-3b82-4a9f-b96d-c82055b6bfc7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:29.378630 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 840/1688] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:29.379775 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee959a-0273-4a44-94c4-234b3f67e33e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:29.404026 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee959a-0273-4a44-94c4-234b3f67e33e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:29.413001 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155bb217-02b5-4f00-8362-f3fce5bcfb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:29.413878 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155bb217-02b5-4f00-8362-f3fce5bcfb24 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:29.414173 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155bb217-02b5-4f00-8362-f3fce5bcfb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:29.414493 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155bb217-02b5-4f00-8362-f3fce5bcfb24 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:29.415154 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155bb217-02b5-4f00-8362-f3fce5bcfb24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:29.418956 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155bb217-02b5-4f00-8362-f3fce5bcfb24 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:29.441946 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f3420-3b82-4a9f-b96d-c82055b6bfc7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:29.448020 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98092a1c-89c3-4cc4-9043-42c452edd4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:29.448656 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98092a1c-89c3-4cc4-9043-42c452edd4da admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:29.448938 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98092a1c-89c3-4cc4-9043-42c452edd4da admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:29.449213 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98092a1c-89c3-4cc4-9043-42c452edd4da admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:29.452664 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98092a1c-89c3-4cc4-9043-42c452edd4da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:29.454385 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98092a1c-89c3-4cc4-9043-42c452edd4da admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:29.470736 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 849/1689] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:29.472417 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31516f1-7a7f-4518-a38c-821793c28efe None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:29.472943 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31516f1-7a7f-4518-a38c-821793c28efe None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:29.473468 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31516f1-7a7f-4518-a38c-821793c28efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:29.498632 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c31516f1-7a7f-4518-a38c-821793c28efe None None] MFA Rules not processed for user `6efa7a654e2d4e3e9066aa361460729d`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:29.500476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c31516f1-7a7f-4518-a38c-821793c28efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:29.537670 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 841/1690] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:48:29 2022] POST /identity/v3/users => generated 288 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:29.538517 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155bb217-02b5-4f00-8362-f3fce5bcfb24 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:29.564048 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155bb217-02b5-4f00-8362-f3fce5bcfb24 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:29.573987 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6165c8-ee80-458a-af3f-7199335b7b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:29.574944 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6165c8-ee80-458a-af3f-7199335b7b44 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:29.575380 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6165c8-ee80-458a-af3f-7199335b7b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:29.575911 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6165c8-ee80-458a-af3f-7199335b7b44 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:29.581421 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 850/1691] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:29.581421 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31516f1-7a7f-4518-a38c-821793c28efe None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:29.582736 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6165c8-ee80-458a-af3f-7199335b7b44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:48:29.583261 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6165c8-ee80-458a-af3f-7199335b7b44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:29.591766 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6165c8-ee80-458a-af3f-7199335b7b44 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:29.592751 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31516f1-7a7f-4518-a38c-821793c28efe None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:29.598825 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f38f8-cc99-4e2f-bed0-8c3fc3caf7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:29.599531 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f38f8-cc99-4e2f-bed0-8c3fc3caf7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:29.599881 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f38f8-cc99-4e2f-bed0-8c3fc3caf7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:29.600380 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f38f8-cc99-4e2f-bed0-8c3fc3caf7e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:29.601132 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f38f8-cc99-4e2f-bed0-8c3fc3caf7e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:29.603017 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f38f8-cc99-4e2f-bed0-8c3fc3caf7e8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:29.617089 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:29.622226 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 851/1692] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:29.623410 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f38f8-cc99-4e2f-bed0-8c3fc3caf7e8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:29.627806 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 842/1693] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:48:29.634862 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6165c8-ee80-458a-af3f-7199335b7b44 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:29.645716 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f38f8-cc99-4e2f-bed0-8c3fc3caf7e8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:29.652202 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f353f-a77c-42f4-b0a6-f846fedebda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:29.653398 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f353f-a77c-42f4-b0a6-f846fedebda7 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:29.653791 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f353f-a77c-42f4-b0a6-f846fedebda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:29.654091 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6165c8-ee80-458a-af3f-7199335b7b44 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:29.654227 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f353f-a77c-42f4-b0a6-f846fedebda7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:29.654993 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f353f-a77c-42f4-b0a6-f846fedebda7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:29.656804 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f353f-a77c-42f4-b0a6-f846fedebda7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:29.671349 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67feed13-3fd8-4658-90e8-fa30faddd671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:29.673850 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67feed13-3fd8-4658-90e8-fa30faddd671 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:29.674153 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67feed13-3fd8-4658-90e8-fa30faddd671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:29.674489 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67feed13-3fd8-4658-90e8-fa30faddd671 admin admin] PATH_INFO: `/v3/projects/b406efc4a4f746f0bcc9d0013cf73d70/users/44a65f9bb5f54e65b9b8bd3bdc9565c0/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:29.684998 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 852/1694] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:29.684998 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f353f-a77c-42f4-b0a6-f846fedebda7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:29.694963 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f353f-a77c-42f4-b0a6-f846fedebda7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:29.706013 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac0318-cc6a-446e-9bd1-005300df5799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:29.706752 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac0318-cc6a-446e-9bd1-005300df5799 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:29.707489 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac0318-cc6a-446e-9bd1-005300df5799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:29.707593 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac0318-cc6a-446e-9bd1-005300df5799 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:29.708304 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac0318-cc6a-446e-9bd1-005300df5799 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:29.710934 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac0318-cc6a-446e-9bd1-005300df5799 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:29.728929 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67feed13-3fd8-4658-90e8-fa30faddd671 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b406efc4a4f746f0bcc9d0013cf73d70, user_id=44a65f9bb5f54e65b9b8bd3bdc9565c0, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:29.737540 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67feed13-3fd8-4658-90e8-fa30faddd671 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:29.894180 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 853/1696] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:48:29 2022] POST /identity/v3/projects => generated 385 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:29.894352 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 843/1696] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:48:29 2022] PUT /identity/v3/projects/b406efc4a4f746f0bcc9d0013cf73d70/users/44a65f9bb5f54e65b9b8bd3bdc9565c0/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:29.894352 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10f552-2b27-45ab-b1fc-4f0beb6606cd None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:29.894352 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10f552-2b27-45ab-b1fc-4f0beb6606cd None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:29.894352 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10f552-2b27-45ab-b1fc-4f0beb6606cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:29.894618 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac0318-cc6a-446e-9bd1-005300df5799 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:29.950564 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8d10f552-2b27-45ab-b1fc-4f0beb6606cd None None] MFA Rules not processed for user `44a65f9bb5f54e65b9b8bd3bdc9565c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:29.951872 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8d10f552-2b27-45ab-b1fc-4f0beb6606cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:30.010966 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:30.025742 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac0318-cc6a-446e-9bd1-005300df5799 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:30.044038 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3ac1f-c651-483d-b1d6-e15ad8e8861d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:30.046257 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3ac1f-c651-483d-b1d6-e15ad8e8861d admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:30.046545 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3ac1f-c651-483d-b1d6-e15ad8e8861d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:30.046819 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3ac1f-c651-483d-b1d6-e15ad8e8861d admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:30.047479 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a3ac1f-c651-483d-b1d6-e15ad8e8861d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:30.055222 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a3ac1f-c651-483d-b1d6-e15ad8e8861d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:30.081439 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 844/1697] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:30.083620 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d10f552-2b27-45ab-b1fc-4f0beb6606cd None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:30.088165 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 854/1698] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:30.091467 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167b196-6bf0-4750-8c9a-a1ba13fce416 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:30.091778 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167b196-6bf0-4750-8c9a-a1ba13fce416 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:30.092077 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167b196-6bf0-4750-8c9a-a1ba13fce416 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:30.102073 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 855/1699] 10.222.0.33 () {54 vars in 912 bytes} [Fri Sep 16 03:48:30 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:48:30.104046 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167b196-6bf0-4750-8c9a-a1ba13fce416 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:30.107433 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0167b196-6bf0-4750-8c9a-a1ba13fce416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:30.110677 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d10f552-2b27-45ab-b1fc-4f0beb6606cd None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:30.126249 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253a2f3-5d98-4801-aeff-7a3f541a8ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:30.126880 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253a2f3-5d98-4801-aeff-7a3f541a8ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:30.127165 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253a2f3-5d98-4801-aeff-7a3f541a8ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:30.127727 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253a2f3-5d98-4801-aeff-7a3f541a8ee1 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:30.128232 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2253a2f3-5d98-4801-aeff-7a3f541a8ee1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:30.132460 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167b196-6bf0-4750-8c9a-a1ba13fce416 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:30.132888 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2253a2f3-5d98-4801-aeff-7a3f541a8ee1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:30.138692 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55c8b6a-8363-480f-87e1-98181c558d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:30.139578 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c8b6a-8363-480f-87e1-98181c558d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:30.139995 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c8b6a-8363-480f-87e1-98181c558d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:30.140416 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c8b6a-8363-480f-87e1-98181c558d48 admin admin] PATH_INFO: `/v3/projects/7f32d978507e45589d06fcc5a8516636` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:30.141623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55c8b6a-8363-480f-87e1-98181c558d48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f32d978507e45589d06fcc5a8516636)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:30.145004 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55c8b6a-8363-480f-87e1-98181c558d48 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:30.307099 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 845/1700] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:48:30 2022] POST /identity/v3/users => generated 293 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:30.308741 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253a2f3-5d98-4801-aeff-7a3f541a8ee1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:30.324324 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c55c8b6a-8363-480f-87e1-98181c558d48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f32d978507e45589d06fcc5a8516636', 'request_id': 'req-c55c8b6a-8363-480f-87e1-98181c558d48'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:30.344352 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253a2f3-5d98-4801-aeff-7a3f541a8ee1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:30.414968 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54453ae-934c-4464-9c64-defde226e571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:30.415598 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54453ae-934c-4464-9c64-defde226e571 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:30.415892 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54453ae-934c-4464-9c64-defde226e571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:30.416153 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54453ae-934c-4464-9c64-defde226e571 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:30.416819 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54453ae-934c-4464-9c64-defde226e571 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:30.418803 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54453ae-934c-4464-9c64-defde226e571 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:30.427644 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c55c8b6a-8363-480f-87e1-98181c558d48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f32d978507e45589d06fcc5a8516636', 'request_id': 'req-c55c8b6a-8363-480f-87e1-98181c558d48'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:30.438933 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c55c8b6a-8363-480f-87e1-98181c558d48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f32d978507e45589d06fcc5a8516636', 'request_id': 'req-c55c8b6a-8363-480f-87e1-98181c558d48'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:30.451922 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c55c8b6a-8363-480f-87e1-98181c558d48 admin admin] The token cache is being invalidate because project 7f32d978507e45589d06fcc5a8516636 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:48:30.452214 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c55c8b6a-8363-480f-87e1-98181c558d48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:30.452897 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c55c8b6a-8363-480f-87e1-98181c558d48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:30.454951 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 856/1701] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:48:30 2022] DELETE /identity/v3/projects/7f32d978507e45589d06fcc5a8516636 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:30.458966 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55c8b6a-8363-480f-87e1-98181c558d48 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:30.460901 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c55c8b6a-8363-480f-87e1-98181c558d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:30.474256 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55c8b6a-8363-480f-87e1-98181c558d48 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:30.479476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b30bba-5067-4747-9ea6-4cf56fde4460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:30.480166 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b30bba-5067-4747-9ea6-4cf56fde4460 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:30.480448 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b30bba-5067-4747-9ea6-4cf56fde4460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:30.481165 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b30bba-5067-4747-9ea6-4cf56fde4460 admin admin] PATH_INFO: `/v3/projects/b97a702c9f3e495683dc141011f14862/users/1d5a1310a54846299b58c025893bd907/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:30.500615 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b30bba-5067-4747-9ea6-4cf56fde4460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b97a702c9f3e495683dc141011f14862, user_id=1d5a1310a54846299b58c025893bd907, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:30.504462 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b30bba-5067-4747-9ea6-4cf56fde4460 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:30.525447 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 846/1702] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:48:30 2022] POST /identity/v3/projects => generated 373 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:30.525447 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12856707-5a43-40ed-a285-47a1ee407f62 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:30.525447 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12856707-5a43-40ed-a285-47a1ee407f62 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:30.525447 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12856707-5a43-40ed-a285-47a1ee407f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:30.587365 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-12856707-5a43-40ed-a285-47a1ee407f62 None None] MFA Rules not processed for user `ae04099495a24a04801563cf18dc5626`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:30.588454 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-12856707-5a43-40ed-a285-47a1ee407f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:30.593190 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 857/1703] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:48:30 2022] PUT /identity/v3/projects/b97a702c9f3e495683dc141011f14862/users/1d5a1310a54846299b58c025893bd907/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:30.604681 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b30bba-5067-4747-9ea6-4cf56fde4460 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:30.604681 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-35b30bba-5067-4747-9ea6-4cf56fde4460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:30.676695 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 847/1704] 10.222.0.33 () {58 vars in 1009 bytes} [Fri Sep 16 03:48:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:30.677475 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12856707-5a43-40ed-a285-47a1ee407f62 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:30.683944 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-12856707-5a43-40ed-a285-47a1ee407f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:30.737729 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b30bba-5067-4747-9ea6-4cf56fde4460 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:30.743245 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61962c2d-49be-48bd-9fc6-7597f09f0653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:30.743887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61962c2d-49be-48bd-9fc6-7597f09f0653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:30.744164 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61962c2d-49be-48bd-9fc6-7597f09f0653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:30.748582 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61962c2d-49be-48bd-9fc6-7597f09f0653 admin admin] PATH_INFO: `/v3/users/ed51c458e66d45d88fc5db8744a9c2e3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:30.749903 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61962c2d-49be-48bd-9fc6-7597f09f0653 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed51c458e66d45d88fc5db8744a9c2e3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:30.751981 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61962c2d-49be-48bd-9fc6-7597f09f0653 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:30.766438 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12856707-5a43-40ed-a285-47a1ee407f62 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:30.771111 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d367c-d31d-41dd-b783-c1960c401f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:30.772487 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d367c-d31d-41dd-b783-c1960c401f7d admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:30.772789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d367c-d31d-41dd-b783-c1960c401f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:30.773064 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d367c-d31d-41dd-b783-c1960c401f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:30.773788 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d367c-d31d-41dd-b783-c1960c401f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:30.775549 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d367c-d31d-41dd-b783-c1960c401f7d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:30.786053 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 848/1705] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:30.787516 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a7486-3f95-47c9-a156-7bd2d86d56b7 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:30.787803 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a7486-3f95-47c9-a156-7bd2d86d56b7 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:30.788084 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a7486-3f95-47c9-a156-7bd2d86d56b7 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:30.789708 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 849/1706] 10.222.0.33 () {54 vars in 912 bytes} [Fri Sep 16 03:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:48:30.791006 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74535d0-aceb-4ca1-a316-b0c27f884d44 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:30.791384 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74535d0-aceb-4ca1-a316-b0c27f884d44 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:30.791927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74535d0-aceb-4ca1-a316-b0c27f884d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:30.813020 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a74535d0-aceb-4ca1-a316-b0c27f884d44 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:30.814267 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a74535d0-aceb-4ca1-a316-b0c27f884d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:30.823203 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 850/1707] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:30.824514 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74535d0-aceb-4ca1-a316-b0c27f884d44 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:30.825390 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a74535d0-aceb-4ca1-a316-b0c27f884d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:30.838742 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74535d0-aceb-4ca1-a316-b0c27f884d44 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:30.845261 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1b609-554b-4669-a910-5c2dc3c209cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:30.845954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1b609-554b-4669-a910-5c2dc3c209cf admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:30.846293 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1b609-554b-4669-a910-5c2dc3c209cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:30.846653 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1b609-554b-4669-a910-5c2dc3c209cf admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:30.847355 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1b609-554b-4669-a910-5c2dc3c209cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:30.849433 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1b609-554b-4669-a910-5c2dc3c209cf admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:30.942333 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 851/1708] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:48:30 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:30.943645 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09a628-c0eb-482d-9d6f-c3717bae6b14 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:30.944476 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09a628-c0eb-482d-9d6f-c3717bae6b14 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:30.944754 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09a628-c0eb-482d-9d6f-c3717bae6b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:30.976677 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-da09a628-c0eb-482d-9d6f-c3717bae6b14 None None] MFA Rules not processed for user `1d5a1310a54846299b58c025893bd907`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:30.978194 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-da09a628-c0eb-482d-9d6f-c3717bae6b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:31.030668 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-61962c2d-49be-48bd-9fc6-7597f09f0653 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed51c458e66d45d88fc5db8744a9c2e3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:31.031750 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-61962c2d-49be-48bd-9fc6-7597f09f0653 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed51c458e66d45d88fc5db8744a9c2e3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:31.039182 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-61962c2d-49be-48bd-9fc6-7597f09f0653 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed51c458e66d45d88fc5db8744a9c2e3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:31.056786 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-61962c2d-49be-48bd-9fc6-7597f09f0653 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed51c458e66d45d88fc5db8744a9c2e3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:31.061470 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 852/1709] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:31.061470 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09a628-c0eb-482d-9d6f-c3717bae6b14 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:31.061470 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-da09a628-c0eb-482d-9d6f-c3717bae6b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:31.062861 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-61962c2d-49be-48bd-9fc6-7597f09f0653 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed51c458e66d45d88fc5db8744a9c2e3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:31.074243 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09a628-c0eb-482d-9d6f-c3717bae6b14 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:31.078848 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0acbccd-6cde-4447-9b86-8887c4ef5df7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:31.079669 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0acbccd-6cde-4447-9b86-8887c4ef5df7 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:31.080232 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0acbccd-6cde-4447-9b86-8887c4ef5df7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:31.080714 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0acbccd-6cde-4447-9b86-8887c4ef5df7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:31.083079 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a0acbccd-6cde-4447-9b86-8887c4ef5df7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:31.093668 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0acbccd-6cde-4447-9b86-8887c4ef5df7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:31.095427 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0acbccd-6cde-4447-9b86-8887c4ef5df7 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:31.104228 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 853/1710] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:31.105157 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0acbccd-6cde-4447-9b86-8887c4ef5df7 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:31.106606 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a0acbccd-6cde-4447-9b86-8887c4ef5df7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:31.125312 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0acbccd-6cde-4447-9b86-8887c4ef5df7 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:31.131329 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bfe432-8f0a-4ee7-8dd0-21824ea9bf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:31.131960 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfe432-8f0a-4ee7-8dd0-21824ea9bf9b admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:31.132948 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfe432-8f0a-4ee7-8dd0-21824ea9bf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:31.132948 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfe432-8f0a-4ee7-8dd0-21824ea9bf9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:31.134044 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bfe432-8f0a-4ee7-8dd0-21824ea9bf9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:31.135771 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bfe432-8f0a-4ee7-8dd0-21824ea9bf9b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:31.152066 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 854/1711] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:31.152066 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7de1fe-8476-4149-9440-0631373d7e23 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:31.152066 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7de1fe-8476-4149-9440-0631373d7e23 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:31.152066 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7de1fe-8476-4149-9440-0631373d7e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:31.173010 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0a7de1fe-8476-4149-9440-0631373d7e23 None None] MFA Rules not processed for user `ae04099495a24a04801563cf18dc5626`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:31.174526 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0a7de1fe-8476-4149-9440-0631373d7e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:31.184034 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 855/1712] 10.222.0.33 () {58 vars in 1009 bytes} [Fri Sep 16 03:48:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:31.185278 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfec8d-4506-434e-8abd-d2a884ad379c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:31.186992 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfec8d-4506-434e-8abd-d2a884ad379c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:31.186992 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfec8d-4506-434e-8abd-d2a884ad379c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:31.210715 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d4cfec8d-4506-434e-8abd-d2a884ad379c None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:31.211971 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d4cfec8d-4506-434e-8abd-d2a884ad379c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:31.228880 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 856/1713] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:31.229866 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfec8d-4506-434e-8abd-d2a884ad379c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:31.231406 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d4cfec8d-4506-434e-8abd-d2a884ad379c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:31.233713 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 858/1714] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:48:30 2022] DELETE /identity/v3/users/ed51c458e66d45d88fc5db8744a9c2e3 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:31.235711 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61962c2d-49be-48bd-9fc6-7597f09f0653 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:31.245939 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfec8d-4506-434e-8abd-d2a884ad379c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:31.335014 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c811e-8768-474e-9776-863e700a4948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:31.335888 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c811e-8768-474e-9776-863e700a4948 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:31.336298 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c811e-8768-474e-9776-863e700a4948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:31.336641 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c811e-8768-474e-9776-863e700a4948 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:31.337830 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4c811e-8768-474e-9776-863e700a4948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:31.339593 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4c811e-8768-474e-9776-863e700a4948 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:31.340076 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61962c2d-49be-48bd-9fc6-7597f09f0653 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:31.346422 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f2d5a6-4a82-4a3b-8214-c892f3d73488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:31.346724 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2d5a6-4a82-4a3b-8214-c892f3d73488 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:31.347010 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2d5a6-4a82-4a3b-8214-c892f3d73488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:31.347284 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2d5a6-4a82-4a3b-8214-c892f3d73488 admin admin] PATH_INFO: `/v3/projects/e11fc8e6afc34286a0d19347b10aba33/users/d3d08f03d0ac4ea092fb0372a77d922b/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:31.356511 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 857/1715] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:31.356511 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c811e-8768-474e-9776-863e700a4948 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:31.358588 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4a4c811e-8768-474e-9776-863e700a4948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:31.369775 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f2d5a6-4a82-4a3b-8214-c892f3d73488 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e11fc8e6afc34286a0d19347b10aba33, user_id=d3d08f03d0ac4ea092fb0372a77d922b, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:31.372454 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f2d5a6-4a82-4a3b-8214-c892f3d73488 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:31.429615 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c811e-8768-474e-9776-863e700a4948 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:31.434084 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce849f1-71b1-47a9-b5c6-a01d93a3eb20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:31.434774 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce849f1-71b1-47a9-b5c6-a01d93a3eb20 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:31.435061 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce849f1-71b1-47a9-b5c6-a01d93a3eb20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:31.435337 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce849f1-71b1-47a9-b5c6-a01d93a3eb20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:31.444575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce849f1-71b1-47a9-b5c6-a01d93a3eb20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:31.446157 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce849f1-71b1-47a9-b5c6-a01d93a3eb20 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:31.456058 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 858/1716] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:31.457003 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce849f1-71b1-47a9-b5c6-a01d93a3eb20 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:31.469141 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce849f1-71b1-47a9-b5c6-a01d93a3eb20 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:31.474572 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7c926-1302-48a7-beb1-0c6b983a446f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:31.476052 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7c926-1302-48a7-beb1-0c6b983a446f admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:31.476560 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7c926-1302-48a7-beb1-0c6b983a446f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:31.477137 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7c926-1302-48a7-beb1-0c6b983a446f admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:31.478001 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a7c926-1302-48a7-beb1-0c6b983a446f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:48:31.495647 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a7c926-1302-48a7-beb1-0c6b983a446f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:31.495647 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a7c926-1302-48a7-beb1-0c6b983a446f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:31.495934 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 859/1717] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:48:31 2022] PUT /identity/v3/projects/e11fc8e6afc34286a0d19347b10aba33/users/d3d08f03d0ac4ea092fb0372a77d922b/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:31.495934 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c76363-939f-4313-a75e-d20f333fd5cf None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:31.495934 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c76363-939f-4313-a75e-d20f333fd5cf None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:31.495934 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c76363-939f-4313-a75e-d20f333fd5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:31.507109 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 859/1718] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:48:31.507109 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7c926-1302-48a7-beb1-0c6b983a446f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:31.521425 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-90c76363-939f-4313-a75e-d20f333fd5cf None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:31.523045 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-90c76363-939f-4313-a75e-d20f333fd5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:31.524349 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7c926-1302-48a7-beb1-0c6b983a446f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:31.639199 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 860/1719] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:31.640994 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3f969-e415-4ea7-ae85-29d359d8968b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:31.641293 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3f969-e415-4ea7-ae85-29d359d8968b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:31.641570 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3f969-e415-4ea7-ae85-29d359d8968b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:31.660621 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9864b04-84ea-4643-a952-2de025e69a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:31.661613 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9864b04-84ea-4643-a952-2de025e69a52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:31.666496 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9864b04-84ea-4643-a952-2de025e69a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:31.666496 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9864b04-84ea-4643-a952-2de025e69a52 admin admin] PATH_INFO: `/v3/projects/5c50b5a210394d9f982b15728aa9b9d2/users/59f0a40dde074fe099276dc3fc78466b/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:31.677621 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-03d3f969-e415-4ea7-ae85-29d359d8968b None None] MFA Rules not processed for user `d3d08f03d0ac4ea092fb0372a77d922b`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:31.679657 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-03d3f969-e415-4ea7-ae85-29d359d8968b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:31.699697 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9864b04-84ea-4643-a952-2de025e69a52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c50b5a210394d9f982b15728aa9b9d2, user_id=59f0a40dde074fe099276dc3fc78466b, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:31.702964 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9864b04-84ea-4643-a952-2de025e69a52 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:31.794347 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 861/1720] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:31.794816 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3f969-e415-4ea7-ae85-29d359d8968b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:31.808599 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3f969-e415-4ea7-ae85-29d359d8968b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:31.813038 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f6d6b-6fb7-4526-b6ee-1022a5d56638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:31.813679 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f6d6b-6fb7-4526-b6ee-1022a5d56638 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:31.814107 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f6d6b-6fb7-4526-b6ee-1022a5d56638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:31.814389 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f6d6b-6fb7-4526-b6ee-1022a5d56638 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:31.815427 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f6d6b-6fb7-4526-b6ee-1022a5d56638 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:31.817054 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f6d6b-6fb7-4526-b6ee-1022a5d56638 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:31.841610 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 860/1721] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:48:31 2022] PUT /identity/v3/projects/5c50b5a210394d9f982b15728aa9b9d2/users/59f0a40dde074fe099276dc3fc78466b/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:31.843630 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a598f-1b7d-48cb-8050-2df697a5a01a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:31.843919 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a598f-1b7d-48cb-8050-2df697a5a01a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:31.844191 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a598f-1b7d-48cb-8050-2df697a5a01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:31.864486 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0f7a598f-1b7d-48cb-8050-2df697a5a01a None None] MFA Rules not processed for user `c04a0f9a09a24473a9377ca68fc638b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:31.878145 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0f7a598f-1b7d-48cb-8050-2df697a5a01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:31.964692 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 861/1722] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:31.964692 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a598f-1b7d-48cb-8050-2df697a5a01a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:32.029712 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a598f-1b7d-48cb-8050-2df697a5a01a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:32.038843 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b77226-8495-49ec-bf92-bcc676e387c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:32.039861 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b77226-8495-49ec-bf92-bcc676e387c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:32.040652 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b77226-8495-49ec-bf92-bcc676e387c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:32.041000 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b77226-8495-49ec-bf92-bcc676e387c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:32.049206 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 862/1723] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:48:31 2022] POST /identity/v3/projects => generated 381 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:32.050107 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f6d6b-6fb7-4526-b6ee-1022a5d56638 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:32.135459 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b77226-8495-49ec-bf92-bcc676e387c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:32.137147 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b77226-8495-49ec-bf92-bcc676e387c2 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:32.150692 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f6d6b-6fb7-4526-b6ee-1022a5d56638 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:32.151494 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 862/1724] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:32.152369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b77226-8495-49ec-bf92-bcc676e387c2 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:32.157120 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c921b58-50a2-47b8-9ea7-63d4a1643a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:32.157834 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c921b58-50a2-47b8-9ea7-63d4a1643a3b admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:32.158117 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c921b58-50a2-47b8-9ea7-63d4a1643a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:32.158388 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c921b58-50a2-47b8-9ea7-63d4a1643a3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:32.159268 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c921b58-50a2-47b8-9ea7-63d4a1643a3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:32.162279 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c921b58-50a2-47b8-9ea7-63d4a1643a3b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:32.174275 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b77226-8495-49ec-bf92-bcc676e387c2 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:32.192167 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cbc9fc-693d-4f7d-a21c-acf20acad749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:32.193366 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cbc9fc-693d-4f7d-a21c-acf20acad749 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:32.194270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cbc9fc-693d-4f7d-a21c-acf20acad749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:32.195238 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cbc9fc-693d-4f7d-a21c-acf20acad749 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:32.196286 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cbc9fc-693d-4f7d-a21c-acf20acad749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:32.198408 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cbc9fc-693d-4f7d-a21c-acf20acad749 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:32.212407 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 863/1725] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:32.213486 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cbc9fc-693d-4f7d-a21c-acf20acad749 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:32.216627 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e3cbc9fc-693d-4f7d-a21c-acf20acad749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:32.264466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:32.267162 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 863/1726] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:48:32 2022] POST /identity/v3/projects => generated 385 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:32.268399 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c921b58-50a2-47b8-9ea7-63d4a1643a3b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:32.270153 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6c921b58-50a2-47b8-9ea7-63d4a1643a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:32.351030 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cbc9fc-693d-4f7d-a21c-acf20acad749 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:32.411432 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c921b58-50a2-47b8-9ea7-63d4a1643a3b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:32.423998 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54116b73-0d4f-479b-9e35-2aa3290b84d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c39fd09bea1a40babc5f629612c6702b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:32.424781 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54116b73-0d4f-479b-9e35-2aa3290b84d6 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:32.425117 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54116b73-0d4f-479b-9e35-2aa3290b84d6 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:32.425460 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54116b73-0d4f-479b-9e35-2aa3290b84d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:32.427575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-54116b73-0d4f-479b-9e35-2aa3290b84d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:32.447162 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54116b73-0d4f-479b-9e35-2aa3290b84d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:32.449124 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54116b73-0d4f-479b-9e35-2aa3290b84d6 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:32.462656 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 864/1727] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:32.463810 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54116b73-0d4f-479b-9e35-2aa3290b84d6 service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:32.470025 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb683d2e-6ced-4590-8217-aba881b1162b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:32.473044 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb683d2e-6ced-4590-8217-aba881b1162b service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:32.484737 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb683d2e-6ced-4590-8217-aba881b1162b service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:32.487396 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb683d2e-6ced-4590-8217-aba881b1162b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:32.595646 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54116b73-0d4f-479b-9e35-2aa3290b84d6 service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:32.610544 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d85a66-c1d4-4c8d-8a35-39f85f816072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:32.611330 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d85a66-c1d4-4c8d-8a35-39f85f816072 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:32.612356 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d85a66-c1d4-4c8d-8a35-39f85f816072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:32.612356 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d85a66-c1d4-4c8d-8a35-39f85f816072 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:32.612605 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d85a66-c1d4-4c8d-8a35-39f85f816072 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:32.616346 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d85a66-c1d4-4c8d-8a35-39f85f816072 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:32.711493 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb683d2e-6ced-4590-8217-aba881b1162b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:32.720467 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb683d2e-6ced-4590-8217-aba881b1162b service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:32.746321 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 864/1728] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:32.747261 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb683d2e-6ced-4590-8217-aba881b1162b service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:32.779960 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb683d2e-6ced-4590-8217-aba881b1162b service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:32.790012 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55750e7c-37b0-43f3-9b2c-8f532eded025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:32.792095 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55750e7c-37b0-43f3-9b2c-8f532eded025 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:32.792385 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55750e7c-37b0-43f3-9b2c-8f532eded025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:32.792662 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55750e7c-37b0-43f3-9b2c-8f532eded025 admin admin] PATH_INFO: `/v3/projects/5c50b5a210394d9f982b15728aa9b9d2/users/59f0a40dde074fe099276dc3fc78466b/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:32.799375 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55750e7c-37b0-43f3-9b2c-8f532eded025 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c50b5a210394d9f982b15728aa9b9d2, user_id=59f0a40dde074fe099276dc3fc78466b, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:32.807338 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55750e7c-37b0-43f3-9b2c-8f532eded025 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:32.810723 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 865/1729] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:48:32 2022] POST /identity/v3/users => generated 291 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:32.811574 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d85a66-c1d4-4c8d-8a35-39f85f816072 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:32.844720 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 865/1730] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:48:32 2022] PUT /identity/v3/projects/5c50b5a210394d9f982b15728aa9b9d2/users/59f0a40dde074fe099276dc3fc78466b/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:32.850430 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d85a66-c1d4-4c8d-8a35-39f85f816072 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:32.851148 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117592d-4f31-4b01-9f64-d5699b7bdcce None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:32.851470 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117592d-4f31-4b01-9f64-d5699b7bdcce None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:32.851760 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117592d-4f31-4b01-9f64-d5699b7bdcce None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:32.853478 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 866/1731] 10.222.0.33 () {54 vars in 961 bytes} [Fri Sep 16 03:48:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:48:32.855988 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117592d-4f31-4b01-9f64-d5699b7bdcce None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:32.932647 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:33.047222 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117592d-4f31-4b01-9f64-d5699b7bdcce None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:33.048875 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf5490-a699-4572-a993-38ef68247754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:33.049752 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf5490-a699-4572-a993-38ef68247754 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:33.050121 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf5490-a699-4572-a993-38ef68247754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:33.050509 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf5490-a699-4572-a993-38ef68247754 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:33.051698 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf5490-a699-4572-a993-38ef68247754 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:33.054917 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf5490-a699-4572-a993-38ef68247754 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:33.060930 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213032cd-fcd1-40ad-8a3a-4b2d2e018683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:33.060930 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213032cd-fcd1-40ad-8a3a-4b2d2e018683 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:33.060930 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213032cd-fcd1-40ad-8a3a-4b2d2e018683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:33.060930 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213032cd-fcd1-40ad-8a3a-4b2d2e018683 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:33.061446 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213032cd-fcd1-40ad-8a3a-4b2d2e018683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:33.063465 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213032cd-fcd1-40ad-8a3a-4b2d2e018683 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:33.085959 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 867/1732] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:33.090238 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964a2de-36c8-4fab-82f9-e7e719f5ebd3 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:33.090725 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964a2de-36c8-4fab-82f9-e7e719f5ebd3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:33.091169 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964a2de-36c8-4fab-82f9-e7e719f5ebd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:33.155994 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7964a2de-36c8-4fab-82f9-e7e719f5ebd3 None None] MFA Rules not processed for user `59f0a40dde074fe099276dc3fc78466b`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:33.159233 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7964a2de-36c8-4fab-82f9-e7e719f5ebd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:33.160194 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 866/1733] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:48:32 2022] POST /identity/v3/users => generated 299 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:33.163843 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3229f4-03bc-462f-8e78-145f527604f8 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:33.164618 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3229f4-03bc-462f-8e78-145f527604f8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:33.166013 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3229f4-03bc-462f-8e78-145f527604f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:33.194381 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-5c3229f4-03bc-462f-8e78-145f527604f8 None None] MFA Rules not processed for user `c39fd09bea1a40babc5f629612c6702b`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:33.195992 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5c3229f4-03bc-462f-8e78-145f527604f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:33.293667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 868/1734] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:33.294518 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7964a2de-36c8-4fab-82f9-e7e719f5ebd3 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:33.309661 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7964a2de-36c8-4fab-82f9-e7e719f5ebd3 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:33.323048 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc568a-4eb0-4d6f-9b3d-87cf893f94d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:33.324300 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc568a-4eb0-4d6f-9b3d-87cf893f94d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:33.324300 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc568a-4eb0-4d6f-9b3d-87cf893f94d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:33.325143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc568a-4eb0-4d6f-9b3d-87cf893f94d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:33.325818 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc568a-4eb0-4d6f-9b3d-87cf893f94d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:33.327482 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc568a-4eb0-4d6f-9b3d-87cf893f94d0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:33.360994 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 867/1735] 10.222.0.33 () {58 vars in 1058 bytes} [Fri Sep 16 03:48:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:33.361923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3229f4-03bc-462f-8e78-145f527604f8 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:33.366298 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 869/1736] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:33.366298 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc568a-4eb0-4d6f-9b3d-87cf893f94d0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:33.369303 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e2fc568a-4eb0-4d6f-9b3d-87cf893f94d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:33.390366 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3229f4-03bc-462f-8e78-145f527604f8 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:33.405687 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68751d4-ed20-40c2-be8d-148f9bd270cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:33.406494 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68751d4-ed20-40c2-be8d-148f9bd270cb admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:33.407146 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68751d4-ed20-40c2-be8d-148f9bd270cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:33.407270 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68751d4-ed20-40c2-be8d-148f9bd270cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:33.408193 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68751d4-ed20-40c2-be8d-148f9bd270cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:33.410317 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68751d4-ed20-40c2-be8d-148f9bd270cb admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:33.459051 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 868/1737] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:33.460942 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68751d4-ed20-40c2-be8d-148f9bd270cb admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:33.475689 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68751d4-ed20-40c2-be8d-148f9bd270cb admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:33.481543 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4cdc3-34d5-42b7-a6f6-3f712418b4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:33.483088 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4cdc3-34d5-42b7-a6f6-3f712418b4aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:33.483451 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4cdc3-34d5-42b7-a6f6-3f712418b4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:33.483811 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4cdc3-34d5-42b7-a6f6-3f712418b4aa admin admin] PATH_INFO: `/v3/projects/cf4f8bde33a7408bae4eac8d46a0fdff/users/b30b55bd848247cda037361407509235/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:33.511663 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e4cdc3-34d5-42b7-a6f6-3f712418b4aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf4f8bde33a7408bae4eac8d46a0fdff, user_id=b30b55bd848247cda037361407509235, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:33.512437 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e4cdc3-34d5-42b7-a6f6-3f712418b4aa admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:33.542977 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc568a-4eb0-4d6f-9b3d-87cf893f94d0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:33.548605 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bad50f-dcff-4faf-84ae-02015f9eada9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:33.551855 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bad50f-dcff-4faf-84ae-02015f9eada9 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:33.551855 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bad50f-dcff-4faf-84ae-02015f9eada9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:33.551855 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bad50f-dcff-4faf-84ae-02015f9eada9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:33.564129 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bad50f-dcff-4faf-84ae-02015f9eada9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:33.566115 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bad50f-dcff-4faf-84ae-02015f9eada9 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:33.580563 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 870/1738] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:33.582197 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bad50f-dcff-4faf-84ae-02015f9eada9 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:33.583908 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-56bad50f-dcff-4faf-84ae-02015f9eada9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:33.629518 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bad50f-dcff-4faf-84ae-02015f9eada9 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:33.636568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feedf4f7-33ae-4f50-985d-b51025603c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:33.641266 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedf4f7-33ae-4f50-985d-b51025603c74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:33.641590 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedf4f7-33ae-4f50-985d-b51025603c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:33.641933 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedf4f7-33ae-4f50-985d-b51025603c74 admin admin] PATH_INFO: `/v3/projects/a4edae41e06847e6ad0d814390dc0def` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:33.643346 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feedf4f7-33ae-4f50-985d-b51025603c74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4edae41e06847e6ad0d814390dc0def)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:33.645935 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feedf4f7-33ae-4f50-985d-b51025603c74 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:33.666200 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 869/1739] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:48:33 2022] PUT /identity/v3/projects/cf4f8bde33a7408bae4eac8d46a0fdff/users/b30b55bd848247cda037361407509235/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:33.666200 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4cdc3-34d5-42b7-a6f6-3f712418b4aa admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:33.805284 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4cdc3-34d5-42b7-a6f6-3f712418b4aa admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:33.814367 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf682334-7d25-43c8-b1a6-ff270bc70e6f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c39fd09bea1a40babc5f629612c6702b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:33.815046 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf682334-7d25-43c8-b1a6-ff270bc70e6f service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:33.815288 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf682334-7d25-43c8-b1a6-ff270bc70e6f service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:33.815561 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf682334-7d25-43c8-b1a6-ff270bc70e6f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:33.826799 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf682334-7d25-43c8-b1a6-ff270bc70e6f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:33.828730 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf682334-7d25-43c8-b1a6-ff270bc70e6f service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:33.843479 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 870/1740] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:33.844445 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf682334-7d25-43c8-b1a6-ff270bc70e6f service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:33.857547 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-feedf4f7-33ae-4f50-985d-b51025603c74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4edae41e06847e6ad0d814390dc0def', 'request_id': 'req-feedf4f7-33ae-4f50-985d-b51025603c74'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:33.959777 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf682334-7d25-43c8-b1a6-ff270bc70e6f service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:33.999093 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-feedf4f7-33ae-4f50-985d-b51025603c74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4edae41e06847e6ad0d814390dc0def', 'request_id': 'req-feedf4f7-33ae-4f50-985d-b51025603c74'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:34.013785 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-feedf4f7-33ae-4f50-985d-b51025603c74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4edae41e06847e6ad0d814390dc0def', 'request_id': 'req-feedf4f7-33ae-4f50-985d-b51025603c74'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:34.036211 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-feedf4f7-33ae-4f50-985d-b51025603c74 admin admin] The token cache is being invalidate because project a4edae41e06847e6ad0d814390dc0def was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:48:34.037048 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-feedf4f7-33ae-4f50-985d-b51025603c74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:34.039742 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-feedf4f7-33ae-4f50-985d-b51025603c74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:34.046324 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 871/1741] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:48:33 2022] DELETE /identity/v3/projects/a4edae41e06847e6ad0d814390dc0def => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:34.048025 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef48cbc-23c4-4f5d-b5ce-603daeca65ec None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:34.048331 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef48cbc-23c4-4f5d-b5ce-603daeca65ec None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:34.050171 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef48cbc-23c4-4f5d-b5ce-603daeca65ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:34.118411 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f731c-4d52-43ea-ba8a-3c31ee1f1f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:34.119024 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f731c-4d52-43ea-ba8a-3c31ee1f1f52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:34.119375 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f731c-4d52-43ea-ba8a-3c31ee1f1f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:34.120187 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f731c-4d52-43ea-ba8a-3c31ee1f1f52 admin admin] PATH_INFO: `/v3/projects/3b2118ee8d2246a09a300fe9f06a1cab/users/c9cc46e2a4884a898a127a6d196018dd/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:34.136531 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4ef48cbc-23c4-4f5d-b5ce-603daeca65ec None None] MFA Rules not processed for user `b30b55bd848247cda037361407509235`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:34.137842 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4ef48cbc-23c4-4f5d-b5ce-603daeca65ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:34.157833 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3f731c-4d52-43ea-ba8a-3c31ee1f1f52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b2118ee8d2246a09a300fe9f06a1cab, user_id=c9cc46e2a4884a898a127a6d196018dd, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:34.160158 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3f731c-4d52-43ea-ba8a-3c31ee1f1f52 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:34.244957 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 872/1742] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:34.246095 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef48cbc-23c4-4f5d-b5ce-603daeca65ec None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:34.247614 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4ef48cbc-23c4-4f5d-b5ce-603daeca65ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:34.268026 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 871/1743] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:48:33 2022] PUT /identity/v3/projects/3b2118ee8d2246a09a300fe9f06a1cab/users/c9cc46e2a4884a898a127a6d196018dd/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:34.269083 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f731c-4d52-43ea-ba8a-3c31ee1f1f52 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:34.271952 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-da3f731c-4d52-43ea-ba8a-3c31ee1f1f52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:34.284959 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef48cbc-23c4-4f5d-b5ce-603daeca65ec None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:34.372035 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f731c-4d52-43ea-ba8a-3c31ee1f1f52 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:34.386850 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d421c-100d-459a-b20a-1c4fefca4c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:34.386850 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d421c-100d-459a-b20a-1c4fefca4c48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:34.386850 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d421c-100d-459a-b20a-1c4fefca4c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:34.386850 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d421c-100d-459a-b20a-1c4fefca4c48 admin admin] PATH_INFO: `/v3/users/2c45ecf98d2340239c745dea29fcebfa` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:34.387354 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d421c-100d-459a-b20a-1c4fefca4c48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c45ecf98d2340239c745dea29fcebfa)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:34.387354 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d421c-100d-459a-b20a-1c4fefca4c48 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:34.480820 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0acc3b-a2f7-4f53-b3bd-17eb501a45f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:34.482134 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0acc3b-a2f7-4f53-b3bd-17eb501a45f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:34.482724 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0acc3b-a2f7-4f53-b3bd-17eb501a45f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:34.487324 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0acc3b-a2f7-4f53-b3bd-17eb501a45f3 admin admin] PATH_INFO: `/v3/users/1d5a1310a54846299b58c025893bd907` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:34.487324 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0acc3b-a2f7-4f53-b3bd-17eb501a45f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d5a1310a54846299b58c025893bd907)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:34.491031 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0acc3b-a2f7-4f53-b3bd-17eb501a45f3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:34.604162 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:34.808629 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e55d421c-100d-459a-b20a-1c4fefca4c48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c45ecf98d2340239c745dea29fcebfa'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:34.809310 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e55d421c-100d-459a-b20a-1c4fefca4c48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c45ecf98d2340239c745dea29fcebfa'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:34.816777 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e55d421c-100d-459a-b20a-1c4fefca4c48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c45ecf98d2340239c745dea29fcebfa'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:34.855317 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e55d421c-100d-459a-b20a-1c4fefca4c48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c45ecf98d2340239c745dea29fcebfa'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:34.856271 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e55d421c-100d-459a-b20a-1c4fefca4c48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c45ecf98d2340239c745dea29fcebfa'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:34.871758 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7e0acc3b-a2f7-4f53-b3bd-17eb501a45f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d5a1310a54846299b58c025893bd907'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:34.872960 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7e0acc3b-a2f7-4f53-b3bd-17eb501a45f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d5a1310a54846299b58c025893bd907'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:34.882835 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7e0acc3b-a2f7-4f53-b3bd-17eb501a45f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d5a1310a54846299b58c025893bd907'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:34.897459 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7e0acc3b-a2f7-4f53-b3bd-17eb501a45f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d5a1310a54846299b58c025893bd907'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:34.898415 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7e0acc3b-a2f7-4f53-b3bd-17eb501a45f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d5a1310a54846299b58c025893bd907'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:35.067831 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 872/1744] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:48:34 2022] DELETE /identity/v3/users/2c45ecf98d2340239c745dea29fcebfa => generated 0 bytes in 799 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:35.069613 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d421c-100d-459a-b20a-1c4fefca4c48 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:35.091761 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e55d421c-100d-459a-b20a-1c4fefca4c48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:35.169967 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 873/1745] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:48:34 2022] DELETE /identity/v3/users/1d5a1310a54846299b58c025893bd907 => generated 0 bytes in 924 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:35.170853 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0acc3b-a2f7-4f53-b3bd-17eb501a45f3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:35.172239 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7e0acc3b-a2f7-4f53-b3bd-17eb501a45f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:35.228055 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d421c-100d-459a-b20a-1c4fefca4c48 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:35.259249 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0acc3b-a2f7-4f53-b3bd-17eb501a45f3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:35.272078 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff2165-127c-48e4-8dbe-ee7d74e30cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:35.272929 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff2165-127c-48e4-8dbe-ee7d74e30cef admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:35.273495 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff2165-127c-48e4-8dbe-ee7d74e30cef admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:35.274018 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff2165-127c-48e4-8dbe-ee7d74e30cef admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:35.274812 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff2165-127c-48e4-8dbe-ee7d74e30cef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:35.278618 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff2165-127c-48e4-8dbe-ee7d74e30cef admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:35.294879 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 874/1746] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:35.296333 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ed707-af11-4716-bf02-05e9d4413b55 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:35.296759 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ed707-af11-4716-bf02-05e9d4413b55 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:35.297284 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ed707-af11-4716-bf02-05e9d4413b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:35.314561 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85b3fe-5006-42d1-b851-a7a1beb2bc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:35.315300 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85b3fe-5006-42d1-b851-a7a1beb2bc39 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:35.316365 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85b3fe-5006-42d1-b851-a7a1beb2bc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:35.316943 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85b3fe-5006-42d1-b851-a7a1beb2bc39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:35.322365 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85b3fe-5006-42d1-b851-a7a1beb2bc39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:35.326441 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85b3fe-5006-42d1-b851-a7a1beb2bc39 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:35.340977 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-924ed707-af11-4716-bf02-05e9d4413b55 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:35.342409 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-924ed707-af11-4716-bf02-05e9d4413b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:35.351892 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 875/1747] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:35.352992 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ed707-af11-4716-bf02-05e9d4413b55 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:35.367050 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ed707-af11-4716-bf02-05e9d4413b55 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:35.373495 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32eedf-1557-43cc-8dff-f4f42e65f29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:35.374378 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32eedf-1557-43cc-8dff-f4f42e65f29a admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:35.374648 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32eedf-1557-43cc-8dff-f4f42e65f29a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:35.374815 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32eedf-1557-43cc-8dff-f4f42e65f29a admin admin] PATH_INFO: `/v3/projects/3b2118ee8d2246a09a300fe9f06a1cab/users/c9cc46e2a4884a898a127a6d196018dd/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:35.376809 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe32eedf-1557-43cc-8dff-f4f42e65f29a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b2118ee8d2246a09a300fe9f06a1cab, user_id=c9cc46e2a4884a898a127a6d196018dd, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:35.379550 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe32eedf-1557-43cc-8dff-f4f42e65f29a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:35.390889 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 876/1748] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:48:35 2022] PUT /identity/v3/projects/3b2118ee8d2246a09a300fe9f06a1cab/users/c9cc46e2a4884a898a127a6d196018dd/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:35.393676 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32eedf-1557-43cc-8dff-f4f42e65f29a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:35.398863 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fe32eedf-1557-43cc-8dff-f4f42e65f29a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:35.471288 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32eedf-1557-43cc-8dff-f4f42e65f29a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:35.477565 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a613cb4-f85f-402b-99b0-9c6f77709c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:35.478311 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a613cb4-f85f-402b-99b0-9c6f77709c2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:35.478530 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a613cb4-f85f-402b-99b0-9c6f77709c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:35.478808 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a613cb4-f85f-402b-99b0-9c6f77709c2c admin admin] PATH_INFO: `/v3/users/44a65f9bb5f54e65b9b8bd3bdc9565c0` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:35.480010 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a613cb4-f85f-402b-99b0-9c6f77709c2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=44a65f9bb5f54e65b9b8bd3bdc9565c0)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:35.481980 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a613cb4-f85f-402b-99b0-9c6f77709c2c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:35.518990 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 873/1749] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:48:35 2022] POST /identity/v3/projects => generated 379 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:35.520031 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85b3fe-5006-42d1-b851-a7a1beb2bc39 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:35.522626 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8d85b3fe-5006-42d1-b851-a7a1beb2bc39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:35.636437 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:35.670063 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85b3fe-5006-42d1-b851-a7a1beb2bc39 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:35.676612 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb3f19-eed8-461e-bb6b-8c1295126468 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:35.677846 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb3f19-eed8-461e-bb6b-8c1295126468 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:35.679333 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb3f19-eed8-461e-bb6b-8c1295126468 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:35.679333 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb3f19-eed8-461e-bb6b-8c1295126468 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:35.771951 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9a613cb4-f85f-402b-99b0-9c6f77709c2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44a65f9bb5f54e65b9b8bd3bdc9565c0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:35.776279 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9a613cb4-f85f-402b-99b0-9c6f77709c2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44a65f9bb5f54e65b9b8bd3bdc9565c0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:35.797319 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9a613cb4-f85f-402b-99b0-9c6f77709c2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44a65f9bb5f54e65b9b8bd3bdc9565c0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:35.831357 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9a613cb4-f85f-402b-99b0-9c6f77709c2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44a65f9bb5f54e65b9b8bd3bdc9565c0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:35.832121 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9a613cb4-f85f-402b-99b0-9c6f77709c2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44a65f9bb5f54e65b9b8bd3bdc9565c0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:35.861280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb3f19-eed8-461e-bb6b-8c1295126468 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:35.862875 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb3f19-eed8-461e-bb6b-8c1295126468 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:35.887103 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 874/1750] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:35.890438 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3953553-9cb6-4ee5-af3d-3bf61efe8e5e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:35.890968 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3953553-9cb6-4ee5-af3d-3bf61efe8e5e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:35.892267 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3953553-9cb6-4ee5-af3d-3bf61efe8e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:35.932950 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 877/1751] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:48:35 2022] DELETE /identity/v3/users/44a65f9bb5f54e65b9b8bd3bdc9565c0 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:35.941944 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a613cb4-f85f-402b-99b0-9c6f77709c2c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:35.948982 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9a613cb4-f85f-402b-99b0-9c6f77709c2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:35.988950 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a3953553-9cb6-4ee5-af3d-3bf61efe8e5e None None] MFA Rules not processed for user `c9cc46e2a4884a898a127a6d196018dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:35.991064 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a3953553-9cb6-4ee5-af3d-3bf61efe8e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:36.086652 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a613cb4-f85f-402b-99b0-9c6f77709c2c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:36.092205 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b75966-6d44-4c38-aeba-99d71f487f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:36.093069 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b75966-6d44-4c38-aeba-99d71f487f1d admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:36.093559 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b75966-6d44-4c38-aeba-99d71f487f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:36.094059 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b75966-6d44-4c38-aeba-99d71f487f1d admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:36.095031 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b75966-6d44-4c38-aeba-99d71f487f1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:36.097347 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b75966-6d44-4c38-aeba-99d71f487f1d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:36.104857 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 875/1752] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:35 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:36.106139 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3953553-9cb6-4ee5-af3d-3bf61efe8e5e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:36.110365 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a3953553-9cb6-4ee5-af3d-3bf61efe8e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:36.128181 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3953553-9cb6-4ee5-af3d-3bf61efe8e5e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:36.135402 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b9b58-5166-4e62-b35d-2e5d2020663e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:36.136832 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b9b58-5166-4e62-b35d-2e5d2020663e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:36.137123 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b9b58-5166-4e62-b35d-2e5d2020663e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:36.137399 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b9b58-5166-4e62-b35d-2e5d2020663e admin admin] PATH_INFO: `/v3/projects/3361c1a8f6f64aae8eb1ae0ca6d7e50a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:36.138681 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b9b58-5166-4e62-b35d-2e5d2020663e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3361c1a8f6f64aae8eb1ae0ca6d7e50a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:36.142539 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b9b58-5166-4e62-b35d-2e5d2020663e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:36.202613 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 878/1753] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:48:35 2022] POST /identity/v3/users => generated 296 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:36.205012 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa61e39-7455-4e81-a594-6a97bbd076da None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:36.205665 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa61e39-7455-4e81-a594-6a97bbd076da None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:36.206086 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa61e39-7455-4e81-a594-6a97bbd076da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:36.254888 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1aa61e39-7455-4e81-a594-6a97bbd076da None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:36.256766 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1aa61e39-7455-4e81-a594-6a97bbd076da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:36.267671 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 879/1754] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:36.273761 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa61e39-7455-4e81-a594-6a97bbd076da None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:36.275403 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1aa61e39-7455-4e81-a594-6a97bbd076da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:36.340691 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8c4b9b58-5166-4e62-b35d-2e5d2020663e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3361c1a8f6f64aae8eb1ae0ca6d7e50a', 'request_id': 'req-8c4b9b58-5166-4e62-b35d-2e5d2020663e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:36.350932 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa61e39-7455-4e81-a594-6a97bbd076da None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:36.403399 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6e047-063c-4250-96c9-27bf408d0af2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:36.404013 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6e047-063c-4250-96c9-27bf408d0af2 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:36.404418 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6e047-063c-4250-96c9-27bf408d0af2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:36.404731 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6e047-063c-4250-96c9-27bf408d0af2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:36.427699 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8c4b9b58-5166-4e62-b35d-2e5d2020663e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3361c1a8f6f64aae8eb1ae0ca6d7e50a', 'request_id': 'req-8c4b9b58-5166-4e62-b35d-2e5d2020663e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:36.452813 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8c4b9b58-5166-4e62-b35d-2e5d2020663e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3361c1a8f6f64aae8eb1ae0ca6d7e50a', 'request_id': 'req-8c4b9b58-5166-4e62-b35d-2e5d2020663e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:36.466703 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8c4b9b58-5166-4e62-b35d-2e5d2020663e admin admin] The token cache is being invalidate because project 3361c1a8f6f64aae8eb1ae0ca6d7e50a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:48:36.466988 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8c4b9b58-5166-4e62-b35d-2e5d2020663e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:36.467822 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8c4b9b58-5166-4e62-b35d-2e5d2020663e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:36.469473 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 876/1755] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:48:36 2022] DELETE /identity/v3/projects/3361c1a8f6f64aae8eb1ae0ca6d7e50a => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:36.470402 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b9b58-5166-4e62-b35d-2e5d2020663e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:36.471877 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8c4b9b58-5166-4e62-b35d-2e5d2020663e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:36.481512 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f6e047-063c-4250-96c9-27bf408d0af2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:36.483222 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f6e047-063c-4250-96c9-27bf408d0af2 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:36.494835 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 880/1756] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:36 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:36.495711 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6e047-063c-4250-96c9-27bf408d0af2 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:36.503204 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-64f6e047-063c-4250-96c9-27bf408d0af2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:36.574856 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b9b58-5166-4e62-b35d-2e5d2020663e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:36.577519 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6e047-063c-4250-96c9-27bf408d0af2 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:36.579665 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24f76b-6f8f-47e4-807d-0344e9d87fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:36.580280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24f76b-6f8f-47e4-807d-0344e9d87fbd admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:36.580563 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24f76b-6f8f-47e4-807d-0344e9d87fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:36.580966 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24f76b-6f8f-47e4-807d-0344e9d87fbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:36.581181 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6659c5-db6d-4cbf-9756-83aaebbb9cfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:36.581625 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b24f76b-6f8f-47e4-807d-0344e9d87fbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:36.581825 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6659c5-db6d-4cbf-9756-83aaebbb9cfa service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:36.582105 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6659c5-db6d-4cbf-9756-83aaebbb9cfa service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:36.582378 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6659c5-db6d-4cbf-9756-83aaebbb9cfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:36.583251 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b24f76b-6f8f-47e4-807d-0344e9d87fbd admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:36.585247 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1b6659c5-db6d-4cbf-9756-83aaebbb9cfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:36.594196 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 877/1757] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:36.598141 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6659c5-db6d-4cbf-9756-83aaebbb9cfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:36.598515 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4240a22-3bcc-41ed-94d4-4784b5523bae None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:36.598867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4240a22-3bcc-41ed-94d4-4784b5523bae None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:36.599205 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4240a22-3bcc-41ed-94d4-4784b5523bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:36.600588 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6659c5-db6d-4cbf-9756-83aaebbb9cfa service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:36.618663 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 881/1758] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:36.618888 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6659c5-db6d-4cbf-9756-83aaebbb9cfa service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:36.620505 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1b6659c5-db6d-4cbf-9756-83aaebbb9cfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:36.622438 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d4240a22-3bcc-41ed-94d4-4784b5523bae None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:36.623715 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d4240a22-3bcc-41ed-94d4-4784b5523bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:36.632140 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 878/1759] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:36.633022 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4240a22-3bcc-41ed-94d4-4784b5523bae None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:36.633982 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6659c5-db6d-4cbf-9756-83aaebbb9cfa service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:36.634405 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d4240a22-3bcc-41ed-94d4-4784b5523bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:36.647483 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4240a22-3bcc-41ed-94d4-4784b5523bae None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:36.648193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811fc4c-77e6-4291-ae77-78a9a28b2cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:36.649281 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811fc4c-77e6-4291-ae77-78a9a28b2cc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:36.650594 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811fc4c-77e6-4291-ae77-78a9a28b2cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:36.651045 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811fc4c-77e6-4291-ae77-78a9a28b2cc0 admin admin] PATH_INFO: `/v3/projects/b97a702c9f3e495683dc141011f14862` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:36.652412 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f811fc4c-77e6-4291-ae77-78a9a28b2cc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b97a702c9f3e495683dc141011f14862)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:36.654784 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f811fc4c-77e6-4291-ae77-78a9a28b2cc0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:36.659522 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8791ea21-c58f-44cd-aa1f-e4cf1d82b308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:36.660918 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791ea21-c58f-44cd-aa1f-e4cf1d82b308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:36.661347 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791ea21-c58f-44cd-aa1f-e4cf1d82b308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:36.663313 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791ea21-c58f-44cd-aa1f-e4cf1d82b308 admin admin] PATH_INFO: `/v3/users/d3d08f03d0ac4ea092fb0372a77d922b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:36.663936 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8791ea21-c58f-44cd-aa1f-e4cf1d82b308 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3d08f03d0ac4ea092fb0372a77d922b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:36.667477 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8791ea21-c58f-44cd-aa1f-e4cf1d82b308 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:36.851634 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:36.898814 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8791ea21-c58f-44cd-aa1f-e4cf1d82b308 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3d08f03d0ac4ea092fb0372a77d922b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:36.902945 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8791ea21-c58f-44cd-aa1f-e4cf1d82b308 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3d08f03d0ac4ea092fb0372a77d922b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:36.918691 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8791ea21-c58f-44cd-aa1f-e4cf1d82b308 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3d08f03d0ac4ea092fb0372a77d922b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:36.929248 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f811fc4c-77e6-4291-ae77-78a9a28b2cc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b97a702c9f3e495683dc141011f14862', 'request_id': 'req-f811fc4c-77e6-4291-ae77-78a9a28b2cc0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:36.932356 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8791ea21-c58f-44cd-aa1f-e4cf1d82b308 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3d08f03d0ac4ea092fb0372a77d922b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:36.933141 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8791ea21-c58f-44cd-aa1f-e4cf1d82b308 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3d08f03d0ac4ea092fb0372a77d922b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:37.038895 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f811fc4c-77e6-4291-ae77-78a9a28b2cc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b97a702c9f3e495683dc141011f14862', 'request_id': 'req-f811fc4c-77e6-4291-ae77-78a9a28b2cc0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:37.047068 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f811fc4c-77e6-4291-ae77-78a9a28b2cc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b97a702c9f3e495683dc141011f14862', 'request_id': 'req-f811fc4c-77e6-4291-ae77-78a9a28b2cc0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:37.067863 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f811fc4c-77e6-4291-ae77-78a9a28b2cc0 admin admin] The token cache is being invalidate because project b97a702c9f3e495683dc141011f14862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:48:37.068159 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f811fc4c-77e6-4291-ae77-78a9a28b2cc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:37.069383 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f811fc4c-77e6-4291-ae77-78a9a28b2cc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:37.070957 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 882/1760] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:48:36 2022] DELETE /identity/v3/projects/b97a702c9f3e495683dc141011f14862 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:37.075196 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811fc4c-77e6-4291-ae77-78a9a28b2cc0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:37.076642 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f811fc4c-77e6-4291-ae77-78a9a28b2cc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:37.149219 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811fc4c-77e6-4291-ae77-78a9a28b2cc0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:37.154409 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3db1bb-bf1b-41b3-b459-469bf92835b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:37.155080 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3db1bb-bf1b-41b3-b459-469bf92835b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:37.157779 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3db1bb-bf1b-41b3-b459-469bf92835b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:37.157779 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3db1bb-bf1b-41b3-b459-469bf92835b5 admin admin] PATH_INFO: `/v3/projects/6209bfdce0a8407094e9c5758e41e4a9/users/47699f94d53143e997a1b53f62c1ea56/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:37.176263 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3db1bb-bf1b-41b3-b459-469bf92835b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6209bfdce0a8407094e9c5758e41e4a9, user_id=47699f94d53143e997a1b53f62c1ea56, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:37.179254 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 879/1761] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:48:36 2022] DELETE /identity/v3/users/d3d08f03d0ac4ea092fb0372a77d922b => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:37.180909 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c401c-cd1f-4902-974f-f37e522c1e49 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:37.181263 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3db1bb-bf1b-41b3-b459-469bf92835b5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:37.181702 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c401c-cd1f-4902-974f-f37e522c1e49 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:37.182063 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c401c-cd1f-4902-974f-f37e522c1e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:37.208861 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f45c401c-cd1f-4902-974f-f37e522c1e49 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:37.211277 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f45c401c-cd1f-4902-974f-f37e522c1e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:37.297450 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 880/1762] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:37.297450 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb722878-5ba7-4e6e-bea6-9c623fdd930b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:37.297450 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb722878-5ba7-4e6e-bea6-9c623fdd930b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:37.297450 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb722878-5ba7-4e6e-bea6-9c623fdd930b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:37.310857 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 883/1763] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:48:37 2022] PUT /identity/v3/projects/6209bfdce0a8407094e9c5758e41e4a9/users/47699f94d53143e997a1b53f62c1ea56/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:37.312313 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d92f54-247c-4984-af70-86dd5a5e77ba None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:37.314199 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d92f54-247c-4984-af70-86dd5a5e77ba None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:37.314199 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d92f54-247c-4984-af70-86dd5a5e77ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:37.320636 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-cb722878-5ba7-4e6e-bea6-9c623fdd930b None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:37.322159 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cb722878-5ba7-4e6e-bea6-9c623fdd930b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:37.332936 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-41d92f54-247c-4984-af70-86dd5a5e77ba None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:37.334444 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-41d92f54-247c-4984-af70-86dd5a5e77ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:37.395847 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 881/1764] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:37.397011 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb722878-5ba7-4e6e-bea6-9c623fdd930b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:37.398977 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cb722878-5ba7-4e6e-bea6-9c623fdd930b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:37.411586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 884/1765] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:37.414589 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d92f54-247c-4984-af70-86dd5a5e77ba None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:37.414715 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb722878-5ba7-4e6e-bea6-9c623fdd930b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:37.421015 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d97331-eb41-4a61-b207-a8608e978aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:37.421967 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d97331-eb41-4a61-b207-a8608e978aa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:37.422455 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d97331-eb41-4a61-b207-a8608e978aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:37.422967 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d97331-eb41-4a61-b207-a8608e978aa2 admin admin] PATH_INFO: `/v3/projects/b406efc4a4f746f0bcc9d0013cf73d70` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:37.424222 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d97331-eb41-4a61-b207-a8608e978aa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b406efc4a4f746f0bcc9d0013cf73d70)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:37.426290 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d97331-eb41-4a61-b207-a8608e978aa2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:37.435334 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d92f54-247c-4984-af70-86dd5a5e77ba None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:37.441666 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f423cc-b86a-4135-9289-db89617c415a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:37.442341 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f423cc-b86a-4135-9289-db89617c415a admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:37.446985 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f423cc-b86a-4135-9289-db89617c415a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:37.446985 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f423cc-b86a-4135-9289-db89617c415a admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:37.446985 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f423cc-b86a-4135-9289-db89617c415a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:48:37.446985 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f423cc-b86a-4135-9289-db89617c415a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:37.446985 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f423cc-b86a-4135-9289-db89617c415a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:37.466293 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 885/1766] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:48:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:48:37.467314 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f423cc-b86a-4135-9289-db89617c415a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:37.479355 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f423cc-b86a-4135-9289-db89617c415a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:37.484863 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea6fcd-2a34-48e0-b948-a7084db67de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:37.485760 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea6fcd-2a34-48e0-b948-a7084db67de6 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:37.485979 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea6fcd-2a34-48e0-b948-a7084db67de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:37.486388 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea6fcd-2a34-48e0-b948-a7084db67de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:37.487209 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea6fcd-2a34-48e0-b948-a7084db67de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:37.488735 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea6fcd-2a34-48e0-b948-a7084db67de6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:37.515528 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 886/1767] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:37.517136 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e97c2-59c2-410f-9539-25a360597658 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:37.517432 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e97c2-59c2-410f-9539-25a360597658 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:37.517738 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e97c2-59c2-410f-9539-25a360597658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:37.541471 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-829e97c2-59c2-410f-9539-25a360597658 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:37.542771 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-829e97c2-59c2-410f-9539-25a360597658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:37.551769 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 887/1768] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:37.552553 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e97c2-59c2-410f-9539-25a360597658 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:37.554744 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-829e97c2-59c2-410f-9539-25a360597658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:37.578453 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-90d97331-eb41-4a61-b207-a8608e978aa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b406efc4a4f746f0bcc9d0013cf73d70', 'request_id': 'req-90d97331-eb41-4a61-b207-a8608e978aa2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:37.621343 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e97c2-59c2-410f-9539-25a360597658 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:37.673506 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c6c1b-f9b3-4be3-9533-75ad7f06cd14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:37.674167 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c6c1b-f9b3-4be3-9533-75ad7f06cd14 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:37.674594 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c6c1b-f9b3-4be3-9533-75ad7f06cd14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:37.674866 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c6c1b-f9b3-4be3-9533-75ad7f06cd14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:37.758071 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c6c1b-f9b3-4be3-9533-75ad7f06cd14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:37.759539 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c6c1b-f9b3-4be3-9533-75ad7f06cd14 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:37.764915 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-90d97331-eb41-4a61-b207-a8608e978aa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b406efc4a4f746f0bcc9d0013cf73d70', 'request_id': 'req-90d97331-eb41-4a61-b207-a8608e978aa2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:37.778319 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-90d97331-eb41-4a61-b207-a8608e978aa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b406efc4a4f746f0bcc9d0013cf73d70', 'request_id': 'req-90d97331-eb41-4a61-b207-a8608e978aa2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:37.805282 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 888/1769] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:37.807736 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c6c1b-f9b3-4be3-9533-75ad7f06cd14 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:37.812141 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-90d97331-eb41-4a61-b207-a8608e978aa2 admin admin] The token cache is being invalidate because project b406efc4a4f746f0bcc9d0013cf73d70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:48:37.814597 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-90d97331-eb41-4a61-b207-a8608e978aa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:37.814597 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-90d97331-eb41-4a61-b207-a8608e978aa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:37.816712 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 882/1770] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:48:37 2022] DELETE /identity/v3/projects/b406efc4a4f746f0bcc9d0013cf73d70 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:37.819184 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d97331-eb41-4a61-b207-a8608e978aa2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:37.822103 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c6c1b-f9b3-4be3-9533-75ad7f06cd14 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:37.822396 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-90d97331-eb41-4a61-b207-a8608e978aa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:37.827722 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599cef8-ddf8-44ea-9532-0c18416c018f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:37.828354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599cef8-ddf8-44ea-9532-0c18416c018f admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:37.828692 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599cef8-ddf8-44ea-9532-0c18416c018f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:37.829007 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599cef8-ddf8-44ea-9532-0c18416c018f admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:37.829681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0599cef8-ddf8-44ea-9532-0c18416c018f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:37.831721 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0599cef8-ddf8-44ea-9532-0c18416c018f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:37.840968 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d97331-eb41-4a61-b207-a8608e978aa2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:37.847848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229450c-ac93-4d9a-952e-754a4f185e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:37.849148 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229450c-ac93-4d9a-952e-754a4f185e69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:37.849754 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229450c-ac93-4d9a-952e-754a4f185e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:37.862719 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229450c-ac93-4d9a-952e-754a4f185e69 admin admin] PATH_INFO: `/v3/projects/6209bfdce0a8407094e9c5758e41e4a9/users/47699f94d53143e997a1b53f62c1ea56/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:37.862719 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7229450c-ac93-4d9a-952e-754a4f185e69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6209bfdce0a8407094e9c5758e41e4a9, user_id=47699f94d53143e997a1b53f62c1ea56, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:37.862719 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7229450c-ac93-4d9a-952e-754a4f185e69 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:37.882576 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 883/1771] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:48:37 2022] PUT /identity/v3/projects/6209bfdce0a8407094e9c5758e41e4a9/users/47699f94d53143e997a1b53f62c1ea56/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:37.883366 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229450c-ac93-4d9a-952e-754a4f185e69 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:37.888142 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7229450c-ac93-4d9a-952e-754a4f185e69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:37.978084 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229450c-ac93-4d9a-952e-754a4f185e69 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:37.982871 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e843fc-7925-4621-b6a3-36ee9f5bc4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:37.983490 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e843fc-7925-4621-b6a3-36ee9f5bc4b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:37.983767 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e843fc-7925-4621-b6a3-36ee9f5bc4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:37.984036 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e843fc-7925-4621-b6a3-36ee9f5bc4b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:37.984878 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e843fc-7925-4621-b6a3-36ee9f5bc4b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:48:37.984991 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e843fc-7925-4621-b6a3-36ee9f5bc4b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:37.986623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e843fc-7925-4621-b6a3-36ee9f5bc4b7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:37.999514 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 884/1772] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:48:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:48:38.000383 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e843fc-7925-4621-b6a3-36ee9f5bc4b7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:38.002444 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-22e843fc-7925-4621-b6a3-36ee9f5bc4b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:38.018100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 889/1773] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:48:37 2022] POST /identity/v3/projects => generated 363 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:38.018100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8fe5cc-874f-4e22-9ddc-310e666549c6 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:38.018100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8fe5cc-874f-4e22-9ddc-310e666549c6 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:38.018100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8fe5cc-874f-4e22-9ddc-310e666549c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:38.018437 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e843fc-7925-4621-b6a3-36ee9f5bc4b7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:38.051007 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5a8fe5cc-874f-4e22-9ddc-310e666549c6 None None] MFA Rules not processed for user `47699f94d53143e997a1b53f62c1ea56`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:38.052125 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5a8fe5cc-874f-4e22-9ddc-310e666549c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:38.098345 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedcbc52-6add-4bd5-b6b4-00fbff262c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:38.098911 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcbc52-6add-4bd5-b6b4-00fbff262c08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:38.099193 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcbc52-6add-4bd5-b6b4-00fbff262c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:38.099468 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcbc52-6add-4bd5-b6b4-00fbff262c08 admin admin] PATH_INFO: `/v3/users/59f0a40dde074fe099276dc3fc78466b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:38.102201 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedcbc52-6add-4bd5-b6b4-00fbff262c08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59f0a40dde074fe099276dc3fc78466b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:38.106980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedcbc52-6add-4bd5-b6b4-00fbff262c08 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:38.128245 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 890/1774] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:38 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:38.129893 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b960538-de71-4976-a51b-f06fcda6b6c5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:38.130290 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b960538-de71-4976-a51b-f06fcda6b6c5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:38.130669 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b960538-de71-4976-a51b-f06fcda6b6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:38.189665 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7b960538-de71-4976-a51b-f06fcda6b6c5 None None] MFA Rules not processed for user `b0812002d7b14bcb81a42eb380231feb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:38.190865 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7b960538-de71-4976-a51b-f06fcda6b6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:38.267620 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 891/1775] 10.222.0.33 () {58 vars in 1009 bytes} [Fri Sep 16 03:48:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:38.268886 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b960538-de71-4976-a51b-f06fcda6b6c5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:38.289523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b960538-de71-4976-a51b-f06fcda6b6c5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:38.294509 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40037ad5-c96f-4f15-bb3b-76a30a2b2e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:38.295127 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40037ad5-c96f-4f15-bb3b-76a30a2b2e21 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:38.295408 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40037ad5-c96f-4f15-bb3b-76a30a2b2e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:38.295674 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40037ad5-c96f-4f15-bb3b-76a30a2b2e21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:38.296313 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40037ad5-c96f-4f15-bb3b-76a30a2b2e21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:38.298256 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40037ad5-c96f-4f15-bb3b-76a30a2b2e21 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:38.386258 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dedcbc52-6add-4bd5-b6b4-00fbff262c08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59f0a40dde074fe099276dc3fc78466b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:38.386914 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dedcbc52-6add-4bd5-b6b4-00fbff262c08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59f0a40dde074fe099276dc3fc78466b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:38.394938 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dedcbc52-6add-4bd5-b6b4-00fbff262c08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59f0a40dde074fe099276dc3fc78466b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:38.407931 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dedcbc52-6add-4bd5-b6b4-00fbff262c08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59f0a40dde074fe099276dc3fc78466b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:38.408680 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dedcbc52-6add-4bd5-b6b4-00fbff262c08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59f0a40dde074fe099276dc3fc78466b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:38.425702 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 892/1776] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:48:38 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:38.425702 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40037ad5-c96f-4f15-bb3b-76a30a2b2e21 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:38.427180 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-40037ad5-c96f-4f15-bb3b-76a30a2b2e21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:38.505343 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 885/1777] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:48:37 2022] DELETE /identity/v3/users/59f0a40dde074fe099276dc3fc78466b => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:38.506447 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedcbc52-6add-4bd5-b6b4-00fbff262c08 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:38.510123 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dedcbc52-6add-4bd5-b6b4-00fbff262c08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:38.528184 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40037ad5-c96f-4f15-bb3b-76a30a2b2e21 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:38.689565 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb4114-7fcf-4cdd-8b28-bbe2f21a6624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:38.690403 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedcbc52-6add-4bd5-b6b4-00fbff262c08 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:38.691033 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb4114-7fcf-4cdd-8b28-bbe2f21a6624 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:38.691496 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb4114-7fcf-4cdd-8b28-bbe2f21a6624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:38.691871 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb4114-7fcf-4cdd-8b28-bbe2f21a6624 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:38.692623 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fb4114-7fcf-4cdd-8b28-bbe2f21a6624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:38.695652 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fb4114-7fcf-4cdd-8b28-bbe2f21a6624 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:38.706281 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5052365-fb05-4ee1-ae5f-843c535ee060 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:38.706281 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5052365-fb05-4ee1-ae5f-843c535ee060 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:38.706281 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5052365-fb05-4ee1-ae5f-843c535ee060 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:38.706281 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5052365-fb05-4ee1-ae5f-843c535ee060 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:38.711188 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a5052365-fb05-4ee1-ae5f-843c535ee060 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:38.832443 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5052365-fb05-4ee1-ae5f-843c535ee060 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:38.834262 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5052365-fb05-4ee1-ae5f-843c535ee060 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:38.878767 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 886/1778] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:38 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:38.879671 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5052365-fb05-4ee1-ae5f-843c535ee060 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:38.882146 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a5052365-fb05-4ee1-ae5f-843c535ee060 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:38.890944 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 893/1779] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:48:38 2022] POST /identity/v3/users => generated 282 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:38.892458 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06645f39-374b-460a-9647-8f512dfae418 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:38.892747 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06645f39-374b-460a-9647-8f512dfae418 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:38.893054 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06645f39-374b-460a-9647-8f512dfae418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:38.909117 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5052365-fb05-4ee1-ae5f-843c535ee060 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:38.909963 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:38.916559 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c6705-0af7-4be9-9cf3-1826b4fbbcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:38.917565 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c6705-0af7-4be9-9cf3-1826b4fbbcbf admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:38.917884 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c6705-0af7-4be9-9cf3-1826b4fbbcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:38.918207 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c6705-0af7-4be9-9cf3-1826b4fbbcbf admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:38.918851 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c6705-0af7-4be9-9cf3-1826b4fbbcbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:38.920780 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c6705-0af7-4be9-9cf3-1826b4fbbcbf admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:38.935436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-06645f39-374b-460a-9647-8f512dfae418 None None] MFA Rules not processed for user `ae04099495a24a04801563cf18dc5626`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:38.937063 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-06645f39-374b-460a-9647-8f512dfae418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:39.006933 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 894/1780] 10.222.0.26 () {58 vars in 1015 bytes} [Fri Sep 16 03:48:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:39.007922 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06645f39-374b-460a-9647-8f512dfae418 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:39.017333 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-06645f39-374b-460a-9647-8f512dfae418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:39.072419 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 887/1781] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:48:38 2022] POST /identity/v3/users => generated 287 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:39.072419 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c6705-0af7-4be9-9cf3-1826b4fbbcbf admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:39.091657 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c6705-0af7-4be9-9cf3-1826b4fbbcbf admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:39.106343 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854192e-5034-45c5-a299-8b760540568a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:39.107562 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854192e-5034-45c5-a299-8b760540568a admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:39.108403 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854192e-5034-45c5-a299-8b760540568a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:39.108965 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854192e-5034-45c5-a299-8b760540568a admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:39.110025 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4854192e-5034-45c5-a299-8b760540568a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:39.112151 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4854192e-5034-45c5-a299-8b760540568a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:39.134555 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 888/1782] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:39.137033 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854192e-5034-45c5-a299-8b760540568a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:39.141585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4854192e-5034-45c5-a299-8b760540568a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:39.162347 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06645f39-374b-460a-9647-8f512dfae418 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:39.165622 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854192e-5034-45c5-a299-8b760540568a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:39.168648 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d85383-acf7-4b13-bc24-08b173a362bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f784d98d5f440c681f53ae70f6d1cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:39.169459 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d85383-acf7-4b13-bc24-08b173a362bf service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:39.169778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d85383-acf7-4b13-bc24-08b173a362bf service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:39.170056 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d85383-acf7-4b13-bc24-08b173a362bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:39.171337 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7225a6-6322-4add-aff1-aee056106c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:39.172022 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7225a6-6322-4add-aff1-aee056106c76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:39.172170 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-94d85383-acf7-4b13-bc24-08b173a362bf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:39.172482 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7225a6-6322-4add-aff1-aee056106c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:39.172855 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7225a6-6322-4add-aff1-aee056106c76 admin admin] PATH_INFO: `/v3/projects/e11fc8e6afc34286a0d19347b10aba33` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:39.174324 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7225a6-6322-4add-aff1-aee056106c76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e11fc8e6afc34286a0d19347b10aba33)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:39.177124 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7225a6-6322-4add-aff1-aee056106c76 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:39.220333 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:39.244200 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d85383-acf7-4b13-bc24-08b173a362bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:39.246103 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d85383-acf7-4b13-bc24-08b173a362bf service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:39.266545 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 895/1783] 10.222.0.33 () {60 vars in 1384 bytes} [Fri Sep 16 03:48:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 03:48:39.267600 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d85383-acf7-4b13-bc24-08b173a362bf service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:39.280819 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d85383-acf7-4b13-bc24-08b173a362bf service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:39.287779 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5a824-3e3b-4014-8cc8-ef4ec8b7eba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:39.288629 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5a824-3e3b-4014-8cc8-ef4ec8b7eba6 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:39.288922 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5a824-3e3b-4014-8cc8-ef4ec8b7eba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:39.289193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5a824-3e3b-4014-8cc8-ef4ec8b7eba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:39.290403 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5a824-3e3b-4014-8cc8-ef4ec8b7eba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:39.292012 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5a824-3e3b-4014-8cc8-ef4ec8b7eba6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:39.338045 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 896/1784] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:39.339613 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5a824-3e3b-4014-8cc8-ef4ec8b7eba6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:39.341859 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-dcf5a824-3e3b-4014-8cc8-ef4ec8b7eba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:39.344204 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8b7225a6-6322-4add-aff1-aee056106c76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e11fc8e6afc34286a0d19347b10aba33', 'request_id': 'req-8b7225a6-6322-4add-aff1-aee056106c76'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:39.361327 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5a824-3e3b-4014-8cc8-ef4ec8b7eba6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:39.445919 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8b7225a6-6322-4add-aff1-aee056106c76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e11fc8e6afc34286a0d19347b10aba33', 'request_id': 'req-8b7225a6-6322-4add-aff1-aee056106c76'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:39.457398 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8b7225a6-6322-4add-aff1-aee056106c76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e11fc8e6afc34286a0d19347b10aba33', 'request_id': 'req-8b7225a6-6322-4add-aff1-aee056106c76'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:39.469526 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868dba0c-850c-4f14-b508-5f25d97f1ded service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:39.470228 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868dba0c-850c-4f14-b508-5f25d97f1ded service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:39.470699 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868dba0c-850c-4f14-b508-5f25d97f1ded service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:39.471007 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868dba0c-850c-4f14-b508-5f25d97f1ded service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:39.477572 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8b7225a6-6322-4add-aff1-aee056106c76 admin admin] The token cache is being invalidate because project e11fc8e6afc34286a0d19347b10aba33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:48:39.478155 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8b7225a6-6322-4add-aff1-aee056106c76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:39.480826 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8b7225a6-6322-4add-aff1-aee056106c76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:39.481114 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 889/1785] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:48:39 2022] DELETE /identity/v3/projects/e11fc8e6afc34286a0d19347b10aba33 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:39.492618 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7225a6-6322-4add-aff1-aee056106c76 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:39.494886 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8b7225a6-6322-4add-aff1-aee056106c76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:39.496925 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868dba0c-850c-4f14-b508-5f25d97f1ded service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:39.498655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868dba0c-850c-4f14-b508-5f25d97f1ded service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:39.517748 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 897/1786] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:39.519509 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868dba0c-850c-4f14-b508-5f25d97f1ded service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:39.521258 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-868dba0c-850c-4f14-b508-5f25d97f1ded service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:39.636945 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7225a6-6322-4add-aff1-aee056106c76 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:39.641999 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c356b5-b262-4399-b2f8-747ab6c0450d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:39.642688 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c356b5-b262-4399-b2f8-747ab6c0450d admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:39.643131 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c356b5-b262-4399-b2f8-747ab6c0450d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:39.643510 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c356b5-b262-4399-b2f8-747ab6c0450d admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:39.644741 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c356b5-b262-4399-b2f8-747ab6c0450d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:39.646767 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c356b5-b262-4399-b2f8-747ab6c0450d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:39.687009 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 890/1787] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:39.687684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868dba0c-850c-4f14-b508-5f25d97f1ded service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:39.689321 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c356b5-b262-4399-b2f8-747ab6c0450d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:39.697095 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-49c356b5-b262-4399-b2f8-747ab6c0450d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:39.727156 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3e182-a9ce-4d6b-b194-f134fb2639db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:39.727905 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c356b5-b262-4399-b2f8-747ab6c0450d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:39.729825 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3e182-a9ce-4d6b-b194-f134fb2639db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:39.730614 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3e182-a9ce-4d6b-b194-f134fb2639db admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:39.731141 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3e182-a9ce-4d6b-b194-f134fb2639db admin admin] PATH_INFO: `/v3/projects/5c50b5a210394d9f982b15728aa9b9d2` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:39.732859 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3e182-a9ce-4d6b-b194-f134fb2639db admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c50b5a210394d9f982b15728aa9b9d2)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:39.734877 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ab72e-b9d0-4304-880c-ec03ba0ce3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:39.735575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ab72e-b9d0-4304-880c-ec03ba0ce3ae admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:39.735925 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ab72e-b9d0-4304-880c-ec03ba0ce3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:39.736069 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3e182-a9ce-4d6b-b194-f134fb2639db admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:39.736316 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ab72e-b9d0-4304-880c-ec03ba0ce3ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:39.737045 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586ab72e-b9d0-4304-880c-ec03ba0ce3ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:39.739909 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586ab72e-b9d0-4304-880c-ec03ba0ce3ae admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:39.766584 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 891/1788] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:39.768161 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ab72e-b9d0-4304-880c-ec03ba0ce3ae admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:39.773594 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-586ab72e-b9d0-4304-880c-ec03ba0ce3ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:39.801580 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ab72e-b9d0-4304-880c-ec03ba0ce3ae admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:39.806773 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c93424-64e8-40de-9dcd-4f4161eae0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:39.807563 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c93424-64e8-40de-9dcd-4f4161eae0ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:39.807850 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c93424-64e8-40de-9dcd-4f4161eae0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:39.808126 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c93424-64e8-40de-9dcd-4f4161eae0ce admin admin] PATH_INFO: `/v3/users/c9cc46e2a4884a898a127a6d196018dd` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:39.810040 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c93424-64e8-40de-9dcd-4f4161eae0ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9cc46e2a4884a898a127a6d196018dd)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:39.812147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c93424-64e8-40de-9dcd-4f4161eae0ce admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:39.952180 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-47b3e182-a9ce-4d6b-b194-f134fb2639db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c50b5a210394d9f982b15728aa9b9d2', 'request_id': 'req-47b3e182-a9ce-4d6b-b194-f134fb2639db'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:40.081021 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-47b3e182-a9ce-4d6b-b194-f134fb2639db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c50b5a210394d9f982b15728aa9b9d2', 'request_id': 'req-47b3e182-a9ce-4d6b-b194-f134fb2639db'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:40.102250 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-47b3e182-a9ce-4d6b-b194-f134fb2639db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c50b5a210394d9f982b15728aa9b9d2', 'request_id': 'req-47b3e182-a9ce-4d6b-b194-f134fb2639db'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:40.119471 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-75c93424-64e8-40de-9dcd-4f4161eae0ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9cc46e2a4884a898a127a6d196018dd'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:40.120691 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-75c93424-64e8-40de-9dcd-4f4161eae0ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9cc46e2a4884a898a127a6d196018dd'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:40.132335 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-75c93424-64e8-40de-9dcd-4f4161eae0ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9cc46e2a4884a898a127a6d196018dd'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:40.132542 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-47b3e182-a9ce-4d6b-b194-f134fb2639db admin admin] The token cache is being invalidate because project 5c50b5a210394d9f982b15728aa9b9d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:48:40.132744 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-47b3e182-a9ce-4d6b-b194-f134fb2639db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:40.134568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-47b3e182-a9ce-4d6b-b194-f134fb2639db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:40.142994 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 898/1789] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:48:39 2022] DELETE /identity/v3/projects/5c50b5a210394d9f982b15728aa9b9d2 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:40.142994 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3e182-a9ce-4d6b-b194-f134fb2639db admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:40.143242 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-47b3e182-a9ce-4d6b-b194-f134fb2639db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:40.170126 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-75c93424-64e8-40de-9dcd-4f4161eae0ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9cc46e2a4884a898a127a6d196018dd'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:40.174658 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-75c93424-64e8-40de-9dcd-4f4161eae0ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9cc46e2a4884a898a127a6d196018dd'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:40.298131 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 892/1790] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:48:39 2022] DELETE /identity/v3/users/c9cc46e2a4884a898a127a6d196018dd => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:40.299153 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c93424-64e8-40de-9dcd-4f4161eae0ce admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:40.303702 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-75c93424-64e8-40de-9dcd-4f4161eae0ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:40.471450 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3e182-a9ce-4d6b-b194-f134fb2639db admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:40.471969 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c93424-64e8-40de-9dcd-4f4161eae0ce admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:40.471969 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e77b3-fea6-4937-bd1a-2888c323ab4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:40.471969 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e77b3-fea6-4937-bd1a-2888c323ab4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:40.471969 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e77b3-fea6-4937-bd1a-2888c323ab4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:40.473489 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e77b3-fea6-4937-bd1a-2888c323ab4e admin admin] PATH_INFO: `/v3/projects/371621ca79c54e10b67fa637098476a5/users/87a044269d684270a0808ff76ea31f11/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:40.473594 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ee2ac-99c7-466f-a26a-f7cca6ac2267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:40.473594 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ee2ac-99c7-466f-a26a-f7cca6ac2267 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:40.473594 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ee2ac-99c7-466f-a26a-f7cca6ac2267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:40.473594 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ee2ac-99c7-466f-a26a-f7cca6ac2267 admin admin] PATH_INFO: `/v3/projects/30b6b880cdc44ce99371a6cf70a24d01/users/394cf89a5f0449e386a8c853275168b2/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:40.474086 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e77b3-fea6-4937-bd1a-2888c323ab4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=371621ca79c54e10b67fa637098476a5, user_id=87a044269d684270a0808ff76ea31f11, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:40.474206 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ee2ac-99c7-466f-a26a-f7cca6ac2267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30b6b880cdc44ce99371a6cf70a24d01, user_id=394cf89a5f0449e386a8c853275168b2, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:40.474632 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e77b3-fea6-4937-bd1a-2888c323ab4e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:40.474734 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ee2ac-99c7-466f-a26a-f7cca6ac2267 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:41.062922 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 893/1791] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:48:40 2022] PUT /identity/v3/projects/371621ca79c54e10b67fa637098476a5/users/87a044269d684270a0808ff76ea31f11/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:41.062922 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a819028-2029-4014-bb75-66fb63fc50c0 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:41.062922 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a819028-2029-4014-bb75-66fb63fc50c0 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:41.062922 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a819028-2029-4014-bb75-66fb63fc50c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:41.064143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 899/1792] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:48:40 2022] PUT /identity/v3/projects/30b6b880cdc44ce99371a6cf70a24d01/users/394cf89a5f0449e386a8c853275168b2/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 915 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:41.065437 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ee2ac-99c7-466f-a26a-f7cca6ac2267 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:41.067348 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ba1ee2ac-99c7-466f-a26a-f7cca6ac2267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:41.115906 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-7a819028-2029-4014-bb75-66fb63fc50c0 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:41.117929 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7a819028-2029-4014-bb75-66fb63fc50c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:41.221815 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 894/1793] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:41.224137 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5e020-f8ab-4f8f-b2a3-caf717d5b0af None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:41.224426 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5e020-f8ab-4f8f-b2a3-caf717d5b0af None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:41.225257 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5e020-f8ab-4f8f-b2a3-caf717d5b0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:41.232181 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ee2ac-99c7-466f-a26a-f7cca6ac2267 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:41.240800 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b7493-f81c-425b-877a-2148492da3e9 tempest-VolumeQuotaClassesTest-968926747 tempest-VolumeQuotaClassesTest-968926747-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47699f94d53143e997a1b53f62c1ea56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6209bfdce0a8407094e9c5758e41e4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:41.240800 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b7493-f81c-425b-877a-2148492da3e9 tempest-VolumeQuotaClassesTest-968926747 tempest-VolumeQuotaClassesTest-968926747-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:41.240800 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b7493-f81c-425b-877a-2148492da3e9 tempest-VolumeQuotaClassesTest-968926747 tempest-VolumeQuotaClassesTest-968926747-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:41.241175 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b7493-f81c-425b-877a-2148492da3e9 tempest-VolumeQuotaClassesTest-968926747 tempest-VolumeQuotaClassesTest-968926747-project-admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:41.241175 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b7493-f81c-425b-877a-2148492da3e9 tempest-VolumeQuotaClassesTest-968926747 tempest-VolumeQuotaClassesTest-968926747-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:48:41.241175 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b7493-f81c-425b-877a-2148492da3e9 tempest-VolumeQuotaClassesTest-968926747 tempest-VolumeQuotaClassesTest-968926747-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:41.243685 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b7493-f81c-425b-877a-2148492da3e9 tempest-VolumeQuotaClassesTest-968926747 tempest-VolumeQuotaClassesTest-968926747-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:41.262713 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 900/1794] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:48:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:48:41.264390 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5e1f8-93dc-426e-b383-ee0d5b882da8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:41.265042 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5e1f8-93dc-426e-b383-ee0d5b882da8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:41.265405 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5e1f8-93dc-426e-b383-ee0d5b882da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:41.314627 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:41.325905 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-77f5e1f8-93dc-426e-b383-ee0d5b882da8 None None] MFA Rules not processed for user `394cf89a5f0449e386a8c853275168b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:41.328648 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-77f5e1f8-93dc-426e-b383-ee0d5b882da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:41.337691 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-39a5e020-f8ab-4f8f-b2a3-caf717d5b0af None None] MFA Rules not processed for user `87a044269d684270a0808ff76ea31f11`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:41.342255 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-39a5e020-f8ab-4f8f-b2a3-caf717d5b0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:41.399833 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:41.466965 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 901/1795] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:41.466965 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939de49-7ad0-48bb-9a31-39d93593d282 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:41.466965 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939de49-7ad0-48bb-9a31-39d93593d282 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:41.466965 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939de49-7ad0-48bb-9a31-39d93593d282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:41.498151 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 895/1796] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:41.499069 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5e020-f8ab-4f8f-b2a3-caf717d5b0af None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:41.510438 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4939de49-7ad0-48bb-9a31-39d93593d282 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:41.512197 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4939de49-7ad0-48bb-9a31-39d93593d282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:41.524834 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5e020-f8ab-4f8f-b2a3-caf717d5b0af None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:41.538898 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 902/1797] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:41.541079 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a1d98-a3e4-4d09-8e70-952779610e09 tempest-VolumeQuotaClassesTest-968926747 tempest-VolumeQuotaClassesTest-968926747-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47699f94d53143e997a1b53f62c1ea56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6209bfdce0a8407094e9c5758e41e4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:41.541779 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a1d98-a3e4-4d09-8e70-952779610e09 tempest-VolumeQuotaClassesTest-968926747 tempest-VolumeQuotaClassesTest-968926747-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:41.543516 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a1d98-a3e4-4d09-8e70-952779610e09 tempest-VolumeQuotaClassesTest-968926747 tempest-VolumeQuotaClassesTest-968926747-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:41.543645 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939de49-7ad0-48bb-9a31-39d93593d282 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:41.543847 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a1d98-a3e4-4d09-8e70-952779610e09 tempest-VolumeQuotaClassesTest-968926747 tempest-VolumeQuotaClassesTest-968926747-project-admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:41.544592 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a1d98-a3e4-4d09-8e70-952779610e09 tempest-VolumeQuotaClassesTest-968926747 tempest-VolumeQuotaClassesTest-968926747-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:41.546016 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4939de49-7ad0-48bb-9a31-39d93593d282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:41.556544 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a1d98-a3e4-4d09-8e70-952779610e09 tempest-VolumeQuotaClassesTest-968926747 tempest-VolumeQuotaClassesTest-968926747-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:41.566214 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939de49-7ad0-48bb-9a31-39d93593d282 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:41.585942 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4eb3f3-e1f4-4874-8fe4-02503ee4da51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:41.587414 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4eb3f3-e1f4-4874-8fe4-02503ee4da51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:41.587731 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4eb3f3-e1f4-4874-8fe4-02503ee4da51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:41.587990 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4eb3f3-e1f4-4874-8fe4-02503ee4da51 admin admin] PATH_INFO: `/v3/projects/3b2118ee8d2246a09a300fe9f06a1cab` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:41.591686 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4eb3f3-e1f4-4874-8fe4-02503ee4da51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b2118ee8d2246a09a300fe9f06a1cab)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:41.594587 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4eb3f3-e1f4-4874-8fe4-02503ee4da51 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:41.650040 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 896/1798] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:48:41 2022] POST /identity/v3/projects => generated 355 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:41.651288 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a1d98-a3e4-4d09-8e70-952779610e09 tempest-VolumeQuotaClassesTest-968926747 tempest-VolumeQuotaClassesTest-968926747-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:41.782849 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a1d98-a3e4-4d09-8e70-952779610e09 tempest-VolumeQuotaClassesTest-968926747 tempest-VolumeQuotaClassesTest-968926747-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:41.810643 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ff4eb3f3-e1f4-4874-8fe4-02503ee4da51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b2118ee8d2246a09a300fe9f06a1cab', 'request_id': 'req-ff4eb3f3-e1f4-4874-8fe4-02503ee4da51'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:41.907580 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ff4eb3f3-e1f4-4874-8fe4-02503ee4da51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b2118ee8d2246a09a300fe9f06a1cab', 'request_id': 'req-ff4eb3f3-e1f4-4874-8fe4-02503ee4da51'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:41.917256 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ff4eb3f3-e1f4-4874-8fe4-02503ee4da51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b2118ee8d2246a09a300fe9f06a1cab', 'request_id': 'req-ff4eb3f3-e1f4-4874-8fe4-02503ee4da51'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:41.931715 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ff4eb3f3-e1f4-4874-8fe4-02503ee4da51 admin admin] The token cache is being invalidate because project 3b2118ee8d2246a09a300fe9f06a1cab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:48:41.931968 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ff4eb3f3-e1f4-4874-8fe4-02503ee4da51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:41.932765 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ff4eb3f3-e1f4-4874-8fe4-02503ee4da51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:41.934701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 903/1799] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:48:41 2022] DELETE /identity/v3/projects/3b2118ee8d2246a09a300fe9f06a1cab => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:41.936554 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4eb3f3-e1f4-4874-8fe4-02503ee4da51 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:41.940106 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ff4eb3f3-e1f4-4874-8fe4-02503ee4da51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:41.981299 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e316af3-de8c-4ec9-aa06-e4b653f33b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:41.982008 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e316af3-de8c-4ec9-aa06-e4b653f33b1c admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:41.982292 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e316af3-de8c-4ec9-aa06-e4b653f33b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:41.982577 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e316af3-de8c-4ec9-aa06-e4b653f33b1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:41.983272 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e316af3-de8c-4ec9-aa06-e4b653f33b1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:41.993668 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e316af3-de8c-4ec9-aa06-e4b653f33b1c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:42.058518 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4eb3f3-e1f4-4874-8fe4-02503ee4da51 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:42.066374 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339a67b-f1a8-442b-a03f-d5af24346193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:42.066374 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339a67b-f1a8-442b-a03f-d5af24346193 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:42.066374 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339a67b-f1a8-442b-a03f-d5af24346193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:42.066374 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339a67b-f1a8-442b-a03f-d5af24346193 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:42.067186 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0339a67b-f1a8-442b-a03f-d5af24346193 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:42.067940 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0339a67b-f1a8-442b-a03f-d5af24346193 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:42.124341 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 897/1800] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:48:41 2022] POST /identity/v3/projects => generated 363 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:42.125334 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e316af3-de8c-4ec9-aa06-e4b653f33b1c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:42.128208 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0e316af3-de8c-4ec9-aa06-e4b653f33b1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:42.201514 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 904/1801] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:48:41 2022] POST /identity/v3/projects => generated 371 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:42.201514 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339a67b-f1a8-442b-a03f-d5af24346193 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:42.203828 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0339a67b-f1a8-442b-a03f-d5af24346193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:42.271914 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e316af3-de8c-4ec9-aa06-e4b653f33b1c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:42.326491 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339a67b-f1a8-442b-a03f-d5af24346193 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:42.331970 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b617e-e7ce-4ba6-b305-c132d60d0bee tempest-VolumeQuotaClassesTest-968926747 tempest-VolumeQuotaClassesTest-968926747-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47699f94d53143e997a1b53f62c1ea56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6209bfdce0a8407094e9c5758e41e4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:42.335388 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b617e-e7ce-4ba6-b305-c132d60d0bee tempest-VolumeQuotaClassesTest-968926747 tempest-VolumeQuotaClassesTest-968926747-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:42.335388 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b617e-e7ce-4ba6-b305-c132d60d0bee tempest-VolumeQuotaClassesTest-968926747 tempest-VolumeQuotaClassesTest-968926747-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:42.335388 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b617e-e7ce-4ba6-b305-c132d60d0bee tempest-VolumeQuotaClassesTest-968926747 tempest-VolumeQuotaClassesTest-968926747-project-admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:42.335388 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b617e-e7ce-4ba6-b305-c132d60d0bee tempest-VolumeQuotaClassesTest-968926747 tempest-VolumeQuotaClassesTest-968926747-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:48:42.335388 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b617e-e7ce-4ba6-b305-c132d60d0bee tempest-VolumeQuotaClassesTest-968926747 tempest-VolumeQuotaClassesTest-968926747-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:42.337062 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b617e-e7ce-4ba6-b305-c132d60d0bee tempest-VolumeQuotaClassesTest-968926747 tempest-VolumeQuotaClassesTest-968926747-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:42.374507 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 905/1802] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:48:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:48:42.387878 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a5e24-5c31-46d3-b89f-d1e6ea66fb5c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:42.389080 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a5e24-5c31-46d3-b89f-d1e6ea66fb5c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:42.389575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a5e24-5c31-46d3-b89f-d1e6ea66fb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:42.415741 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60de78b-9bd4-46e2-9a85-81ceb7a0d92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:42.416753 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60de78b-9bd4-46e2-9a85-81ceb7a0d92e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:42.417042 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60de78b-9bd4-46e2-9a85-81ceb7a0d92e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:42.417316 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60de78b-9bd4-46e2-9a85-81ceb7a0d92e admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:42.418022 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60de78b-9bd4-46e2-9a85-81ceb7a0d92e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:48:42.418466 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60de78b-9bd4-46e2-9a85-81ceb7a0d92e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:42.428401 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:42.429879 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60de78b-9bd4-46e2-9a85-81ceb7a0d92e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:42.449990 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 898/1803] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:48:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:48:42.449990 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60de78b-9bd4-46e2-9a85-81ceb7a0d92e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:42.453414 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e64a5e24-5c31-46d3-b89f-d1e6ea66fb5c None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:42.454996 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e64a5e24-5c31-46d3-b89f-d1e6ea66fb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:42.456342 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a60de78b-9bd4-46e2-9a85-81ceb7a0d92e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:42.470377 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 906/1804] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:42.470578 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60de78b-9bd4-46e2-9a85-81ceb7a0d92e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:42.472102 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a5e24-5c31-46d3-b89f-d1e6ea66fb5c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:42.489175 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af934d2-1b8a-44ff-ab51-ad32911c2ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:42.496815 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af934d2-1b8a-44ff-ab51-ad32911c2ce2 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:42.496815 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af934d2-1b8a-44ff-ab51-ad32911c2ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:42.496815 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af934d2-1b8a-44ff-ab51-ad32911c2ce2 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:42.496815 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af934d2-1b8a-44ff-ab51-ad32911c2ce2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:42.496815 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af934d2-1b8a-44ff-ab51-ad32911c2ce2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:42.499121 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a5e24-5c31-46d3-b89f-d1e6ea66fb5c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:42.517429 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d36309-7e1a-410b-b5eb-0b9598b0ad7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:42.518399 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d36309-7e1a-410b-b5eb-0b9598b0ad7b admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:42.518868 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d36309-7e1a-410b-b5eb-0b9598b0ad7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:42.519144 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d36309-7e1a-410b-b5eb-0b9598b0ad7b admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:42.519830 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d36309-7e1a-410b-b5eb-0b9598b0ad7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:42.522156 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d36309-7e1a-410b-b5eb-0b9598b0ad7b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:42.607669 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 899/1805] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:48:42 2022] POST /identity/v3/users => generated 288 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:42.608588 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af934d2-1b8a-44ff-ab51-ad32911c2ce2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:42.619977 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af934d2-1b8a-44ff-ab51-ad32911c2ce2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:42.625135 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a380b-6d8d-4c1d-82b5-74307f1f4704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:42.625800 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a380b-6d8d-4c1d-82b5-74307f1f4704 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:42.626082 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a380b-6d8d-4c1d-82b5-74307f1f4704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:42.626360 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a380b-6d8d-4c1d-82b5-74307f1f4704 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:42.627029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a380b-6d8d-4c1d-82b5-74307f1f4704 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:42.629170 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a380b-6d8d-4c1d-82b5-74307f1f4704 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:42.649010 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 907/1806] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:48:42 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:42.649985 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d36309-7e1a-410b-b5eb-0b9598b0ad7b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:42.666153 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d36309-7e1a-410b-b5eb-0b9598b0ad7b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:42.672052 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f6294-afa3-474d-94d1-4030e87a03b2 tempest-VolumeQuotaClassesTest-968926747 tempest-VolumeQuotaClassesTest-968926747-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47699f94d53143e997a1b53f62c1ea56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6209bfdce0a8407094e9c5758e41e4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:42.672565 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f6294-afa3-474d-94d1-4030e87a03b2 tempest-VolumeQuotaClassesTest-968926747 tempest-VolumeQuotaClassesTest-968926747-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:42.672849 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f6294-afa3-474d-94d1-4030e87a03b2 tempest-VolumeQuotaClassesTest-968926747 tempest-VolumeQuotaClassesTest-968926747-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:42.673126 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f6294-afa3-474d-94d1-4030e87a03b2 tempest-VolumeQuotaClassesTest-968926747 tempest-VolumeQuotaClassesTest-968926747-project-admin] PATH_INFO: `/v3/projects/20bb42a648e746ca8740d49b44775e5c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:42.674574 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4f6294-afa3-474d-94d1-4030e87a03b2 tempest-VolumeQuotaClassesTest-968926747 tempest-VolumeQuotaClassesTest-968926747-project-admin] RBAC: Authorizing `identity:delete_project(project_id=20bb42a648e746ca8740d49b44775e5c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:42.676780 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4f6294-afa3-474d-94d1-4030e87a03b2 tempest-VolumeQuotaClassesTest-968926747 tempest-VolumeQuotaClassesTest-968926747-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:42.867109 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 900/1807] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:48:42 2022] POST /identity/v3/projects => generated 357 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:42.869539 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efec8a1-68b8-48c1-b9d0-cc51fabe27e4 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:42.871590 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efec8a1-68b8-48c1-b9d0-cc51fabe27e4 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:42.872354 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efec8a1-68b8-48c1-b9d0-cc51fabe27e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:42.897896 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:42.933780 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8f4f6294-afa3-474d-94d1-4030e87a03b2 tempest-VolumeQuotaClassesTest-968926747 tempest-VolumeQuotaClassesTest-968926747-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20bb42a648e746ca8740d49b44775e5c', 'request_id': 'req-8f4f6294-afa3-474d-94d1-4030e87a03b2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:42.961526 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4efec8a1-68b8-48c1-b9d0-cc51fabe27e4 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:42.968598 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4efec8a1-68b8-48c1-b9d0-cc51fabe27e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:43.028659 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:43.069399 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8f4f6294-afa3-474d-94d1-4030e87a03b2 tempest-VolumeQuotaClassesTest-968926747 tempest-VolumeQuotaClassesTest-968926747-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20bb42a648e746ca8740d49b44775e5c', 'request_id': 'req-8f4f6294-afa3-474d-94d1-4030e87a03b2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:43.081431 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8f4f6294-afa3-474d-94d1-4030e87a03b2 tempest-VolumeQuotaClassesTest-968926747 tempest-VolumeQuotaClassesTest-968926747-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20bb42a648e746ca8740d49b44775e5c', 'request_id': 'req-8f4f6294-afa3-474d-94d1-4030e87a03b2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:43.112565 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8f4f6294-afa3-474d-94d1-4030e87a03b2 tempest-VolumeQuotaClassesTest-968926747 tempest-VolumeQuotaClassesTest-968926747-project-admin] The token cache is being invalidate because project 20bb42a648e746ca8740d49b44775e5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:48:43.113057 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8f4f6294-afa3-474d-94d1-4030e87a03b2 tempest-VolumeQuotaClassesTest-968926747 tempest-VolumeQuotaClassesTest-968926747-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:43.113878 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8f4f6294-afa3-474d-94d1-4030e87a03b2 tempest-VolumeQuotaClassesTest-968926747 tempest-VolumeQuotaClassesTest-968926747-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:43.120988 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 908/1808] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:48:42 2022] DELETE /identity/v3/projects/20bb42a648e746ca8740d49b44775e5c => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:43.120988 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f6294-afa3-474d-94d1-4030e87a03b2 tempest-VolumeQuotaClassesTest-968926747 tempest-VolumeQuotaClassesTest-968926747-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:43.123055 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8f4f6294-afa3-474d-94d1-4030e87a03b2 tempest-VolumeQuotaClassesTest-968926747 tempest-VolumeQuotaClassesTest-968926747-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:43.142423 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 901/1809] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:43.143614 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efec8a1-68b8-48c1-b9d0-cc51fabe27e4 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:43.150132 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4efec8a1-68b8-48c1-b9d0-cc51fabe27e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:43.178509 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efec8a1-68b8-48c1-b9d0-cc51fabe27e4 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:43.195960 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b61a6a-c53d-4388-a6ac-13cfdec68e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:43.197215 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b61a6a-c53d-4388-a6ac-13cfdec68e29 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:43.199345 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b61a6a-c53d-4388-a6ac-13cfdec68e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:43.199728 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b61a6a-c53d-4388-a6ac-13cfdec68e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:43.200937 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b61a6a-c53d-4388-a6ac-13cfdec68e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:43.205498 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b61a6a-c53d-4388-a6ac-13cfdec68e29 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:43.236756 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 902/1810] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:43 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:43.238721 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c04ef3-677c-44dc-b5b3-4f48e2577f95 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:43.244229 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c04ef3-677c-44dc-b5b3-4f48e2577f95 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:43.244742 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c04ef3-677c-44dc-b5b3-4f48e2577f95 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:43.246415 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 903/1811] 10.222.0.33 () {54 vars in 921 bytes} [Fri Sep 16 03:48:43 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:48:43.247261 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c04ef3-677c-44dc-b5b3-4f48e2577f95 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:43.253046 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c5c04ef3-677c-44dc-b5b3-4f48e2577f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:43.290130 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c04ef3-677c-44dc-b5b3-4f48e2577f95 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:43.304734 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16e3e8-2295-4840-b74f-e967ef8683ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:43.311947 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16e3e8-2295-4840-b74f-e967ef8683ea admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:43.311947 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16e3e8-2295-4840-b74f-e967ef8683ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:43.311947 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16e3e8-2295-4840-b74f-e967ef8683ea admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:43.311947 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16e3e8-2295-4840-b74f-e967ef8683ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:43.311947 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16e3e8-2295-4840-b74f-e967ef8683ea admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:43.337899 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f6294-afa3-474d-94d1-4030e87a03b2 tempest-VolumeQuotaClassesTest-968926747 tempest-VolumeQuotaClassesTest-968926747-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:43.346061 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec6aae8-2ab4-40f3-b832-4762845e743f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:43.346928 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6aae8-2ab4-40f3-b832-4762845e743f admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:43.347372 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6aae8-2ab4-40f3-b832-4762845e743f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:43.348385 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6aae8-2ab4-40f3-b832-4762845e743f admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:43.349235 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec6aae8-2ab4-40f3-b832-4762845e743f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:43.351160 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec6aae8-2ab4-40f3-b832-4762845e743f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:43.365106 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 909/1812] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:43 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:43.366659 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec6aae8-2ab4-40f3-b832-4762845e743f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:43.379112 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec6aae8-2ab4-40f3-b832-4762845e743f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:43.386047 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f495eac-4b9e-4540-9cdc-a10743d2cfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:43.386912 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f495eac-4b9e-4540-9cdc-a10743d2cfd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:43.387349 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f495eac-4b9e-4540-9cdc-a10743d2cfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:43.387786 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f495eac-4b9e-4540-9cdc-a10743d2cfd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:43.388807 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f495eac-4b9e-4540-9cdc-a10743d2cfd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:48:43.389264 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f495eac-4b9e-4540-9cdc-a10743d2cfd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:43.391311 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f495eac-4b9e-4540-9cdc-a10743d2cfd4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:43.412546 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 910/1813] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:48:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:48:43.416311 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f495eac-4b9e-4540-9cdc-a10743d2cfd4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:43.430712 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f495eac-4b9e-4540-9cdc-a10743d2cfd4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:43.436209 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 904/1814] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:48:43 2022] POST /identity/v3/users => generated 279 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:43.437437 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a258a89-782e-47c4-b0cd-6749b81b35f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:43.440069 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28f95f-59c6-45a1-8d8b-92a2573fa794 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:43.440069 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28f95f-59c6-45a1-8d8b-92a2573fa794 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:43.440247 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a258a89-782e-47c4-b0cd-6749b81b35f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:43.440315 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28f95f-59c6-45a1-8d8b-92a2573fa794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:43.440393 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a258a89-782e-47c4-b0cd-6749b81b35f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:43.440393 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a258a89-782e-47c4-b0cd-6749b81b35f2 admin admin] PATH_INFO: `/v3/projects/e8781927dfa043f49638ef71b5ef9f82/users/5d65a89df7a04da3b574a757759ed16a/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:43.464060 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a258a89-782e-47c4-b0cd-6749b81b35f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8781927dfa043f49638ef71b5ef9f82, user_id=5d65a89df7a04da3b574a757759ed16a, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:43.467360 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a258a89-782e-47c4-b0cd-6749b81b35f2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:43.479420 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ad28f95f-59c6-45a1-8d8b-92a2573fa794 None None] MFA Rules not processed for user `c09d1a4ac8b64921a6b05fcd567bb770`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:43.481255 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ad28f95f-59c6-45a1-8d8b-92a2573fa794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:43.608844 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 911/1815] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:48:43 2022] PUT /identity/v3/projects/e8781927dfa043f49638ef71b5ef9f82/users/5d65a89df7a04da3b574a757759ed16a/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:43.610445 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a258a89-782e-47c4-b0cd-6749b81b35f2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:43.618338 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 905/1816] 10.222.0.33 () {58 vars in 1018 bytes} [Fri Sep 16 03:48:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:43.619360 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28f95f-59c6-45a1-8d8b-92a2573fa794 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:43.633619 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28f95f-59c6-45a1-8d8b-92a2573fa794 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:43.721219 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13bda5-7ef0-4862-b50e-e92c81108ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:43.725831 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13bda5-7ef0-4862-b50e-e92c81108ad4 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:43.725831 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13bda5-7ef0-4862-b50e-e92c81108ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:43.725831 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13bda5-7ef0-4862-b50e-e92c81108ad4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:43.725831 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e13bda5-7ef0-4862-b50e-e92c81108ad4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:43.727960 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e13bda5-7ef0-4862-b50e-e92c81108ad4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:43.757075 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a258a89-782e-47c4-b0cd-6749b81b35f2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:43.762572 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410be0ca-0749-493b-80d3-4aa2712008f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:43.763672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410be0ca-0749-493b-80d3-4aa2712008f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:43.764222 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410be0ca-0749-493b-80d3-4aa2712008f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:43.765349 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410be0ca-0749-493b-80d3-4aa2712008f0 admin admin] PATH_INFO: `/v3/projects/4023c1075bf64a2e8ba7d910c1eb16be/users/1b6de43feeac4b54aadc8f511cab0d39/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:43.800902 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410be0ca-0749-493b-80d3-4aa2712008f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4023c1075bf64a2e8ba7d910c1eb16be, user_id=1b6de43feeac4b54aadc8f511cab0d39, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:43.811740 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410be0ca-0749-493b-80d3-4aa2712008f0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:43.853744 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 906/1817] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:48:43 2022] POST /identity/v3/projects => generated 391 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:43.854739 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13bda5-7ef0-4862-b50e-e92c81108ad4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:43.922386 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 912/1818] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:48:43 2022] PUT /identity/v3/projects/4023c1075bf64a2e8ba7d910c1eb16be/users/1b6de43feeac4b54aadc8f511cab0d39/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:43.924892 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410be0ca-0749-493b-80d3-4aa2712008f0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:43.954342 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:43.981303 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13bda5-7ef0-4862-b50e-e92c81108ad4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:44.048351 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410be0ca-0749-493b-80d3-4aa2712008f0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:44.056566 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa2ca7-9b57-40f2-b1fb-b471f383ca52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:44.057216 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa2ca7-9b57-40f2-b1fb-b471f383ca52 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:44.057511 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa2ca7-9b57-40f2-b1fb-b471f383ca52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:44.058003 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa2ca7-9b57-40f2-b1fb-b471f383ca52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:44.058682 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa2ca7-9b57-40f2-b1fb-b471f383ca52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:44.060466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa2ca7-9b57-40f2-b1fb-b471f383ca52 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:44.075000 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f601fd-fc84-4b9c-8728-f2eeaa594b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:44.076036 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f601fd-fc84-4b9c-8728-f2eeaa594b69 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:44.082491 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 913/1819] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:43 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:44.082491 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa2ca7-9b57-40f2-b1fb-b471f383ca52 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:44.092012 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f601fd-fc84-4b9c-8728-f2eeaa594b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:44.092012 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f601fd-fc84-4b9c-8728-f2eeaa594b69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:44.092176 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a0fa2ca7-9b57-40f2-b1fb-b471f383ca52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:44.092267 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f601fd-fc84-4b9c-8728-f2eeaa594b69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:44.092267 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f601fd-fc84-4b9c-8728-f2eeaa594b69 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:44.126340 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 907/1820] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:43 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:44.130243 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f601fd-fc84-4b9c-8728-f2eeaa594b69 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:44.147159 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f601fd-fc84-4b9c-8728-f2eeaa594b69 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:44.155706 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7aefe-7bee-4b86-80ad-15a9e1e4796b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:44.156459 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7aefe-7bee-4b86-80ad-15a9e1e4796b admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:44.156782 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7aefe-7bee-4b86-80ad-15a9e1e4796b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:44.157185 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7aefe-7bee-4b86-80ad-15a9e1e4796b admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:44.159303 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea7aefe-7bee-4b86-80ad-15a9e1e4796b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:44.163086 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea7aefe-7bee-4b86-80ad-15a9e1e4796b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:44.252963 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa2ca7-9b57-40f2-b1fb-b471f383ca52 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:44.263434 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1f977-b9e4-45f9-b5d1-e5dde0384ed8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:44.264505 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1f977-b9e4-45f9-b5d1-e5dde0384ed8 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:44.265064 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1f977-b9e4-45f9-b5d1-e5dde0384ed8 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:44.265685 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1f977-b9e4-45f9-b5d1-e5dde0384ed8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:44.289182 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1f977-b9e4-45f9-b5d1-e5dde0384ed8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:44.291008 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1f977-b9e4-45f9-b5d1-e5dde0384ed8 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:44.309595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 908/1821] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:48:44 2022] POST /identity/v3/users => generated 296 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:44.311910 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 914/1822] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:44.312146 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7aefe-7bee-4b86-80ad-15a9e1e4796b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:44.314037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1f977-b9e4-45f9-b5d1-e5dde0384ed8 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:44.328382 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1f977-b9e4-45f9-b5d1-e5dde0384ed8 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:44.336479 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7367139-bc31-40df-b91b-5428ddff3911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:44.337479 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7367139-bc31-40df-b91b-5428ddff3911 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:44.337797 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7367139-bc31-40df-b91b-5428ddff3911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:44.338142 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7367139-bc31-40df-b91b-5428ddff3911 admin admin] PATH_INFO: `/v3/projects/e8781927dfa043f49638ef71b5ef9f82/users/5d65a89df7a04da3b574a757759ed16a/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:44.341042 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7367139-bc31-40df-b91b-5428ddff3911 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8781927dfa043f49638ef71b5ef9f82, user_id=5d65a89df7a04da3b574a757759ed16a, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:44.343770 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7aefe-7bee-4b86-80ad-15a9e1e4796b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:44.344657 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7367139-bc31-40df-b91b-5428ddff3911 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:44.359130 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a368f75-1cd0-4ed3-8185-5563a35a504b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:44.363582 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a368f75-1cd0-4ed3-8185-5563a35a504b admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:44.363582 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a368f75-1cd0-4ed3-8185-5563a35a504b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:44.363582 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a368f75-1cd0-4ed3-8185-5563a35a504b admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:44.363582 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a368f75-1cd0-4ed3-8185-5563a35a504b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:44.364853 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a368f75-1cd0-4ed3-8185-5563a35a504b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:44.365518 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 915/1823] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:48:44 2022] PUT /identity/v3/projects/e8781927dfa043f49638ef71b5ef9f82/users/5d65a89df7a04da3b574a757759ed16a/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:44.368086 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7367139-bc31-40df-b91b-5428ddff3911 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:44.416351 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 909/1824] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:44.424314 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a368f75-1cd0-4ed3-8185-5563a35a504b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:44.424314 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3a368f75-1cd0-4ed3-8185-5563a35a504b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:44.476881 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a368f75-1cd0-4ed3-8185-5563a35a504b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:44.504409 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:44.532181 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7367139-bc31-40df-b91b-5428ddff3911 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:44.544312 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb7b8b-4518-4f38-829c-7d87e82b2001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:44.547095 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb7b8b-4518-4f38-829c-7d87e82b2001 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:44.548280 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb7b8b-4518-4f38-829c-7d87e82b2001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:44.553533 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb7b8b-4518-4f38-829c-7d87e82b2001 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:44.554667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb7b8b-4518-4f38-829c-7d87e82b2001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:44.558346 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb7b8b-4518-4f38-829c-7d87e82b2001 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:44.583139 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 916/1825] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:44.583139 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb7b8b-4518-4f38-829c-7d87e82b2001 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:44.603634 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb7b8b-4518-4f38-829c-7d87e82b2001 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:44.618944 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ef992-4508-436b-9371-ad91f5168659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:44.621395 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ef992-4508-436b-9371-ad91f5168659 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:44.621395 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ef992-4508-436b-9371-ad91f5168659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:44.621395 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ef992-4508-436b-9371-ad91f5168659 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:44.621395 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ef992-4508-436b-9371-ad91f5168659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:44.622992 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ef992-4508-436b-9371-ad91f5168659 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:44.658266 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 917/1826] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:44.662157 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c5243-224f-4bb9-bb3b-c8165abf006c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:44.662829 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c5243-224f-4bb9-bb3b-c8165abf006c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:44.663295 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c5243-224f-4bb9-bb3b-c8165abf006c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:44.703698 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7632415-1c7d-4292-896a-038413bae330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:44.704362 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7632415-1c7d-4292-896a-038413bae330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:44.704642 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7632415-1c7d-4292-896a-038413bae330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:44.704905 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7632415-1c7d-4292-896a-038413bae330 admin admin] PATH_INFO: `/v3/users/b30b55bd848247cda037361407509235` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:44.706357 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7632415-1c7d-4292-896a-038413bae330 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b30b55bd848247cda037361407509235)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:44.708603 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7632415-1c7d-4292-896a-038413bae330 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:44.740296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-699c5243-224f-4bb9-bb3b-c8165abf006c None None] MFA Rules not processed for user `5d65a89df7a04da3b574a757759ed16a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:44.759627 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-699c5243-224f-4bb9-bb3b-c8165abf006c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:44.937963 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 918/1827] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:44.939311 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c5243-224f-4bb9-bb3b-c8165abf006c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:44.988259 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c5243-224f-4bb9-bb3b-c8165abf006c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:44.998966 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa3581-4ff9-4af2-a9fb-f4edb3306dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:45.000824 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa3581-4ff9-4af2-a9fb-f4edb3306dd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:45.001699 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa3581-4ff9-4af2-a9fb-f4edb3306dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:45.002261 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa3581-4ff9-4af2-a9fb-f4edb3306dd6 admin admin] PATH_INFO: `/v3/projects/4023c1075bf64a2e8ba7d910c1eb16be/users/1b6de43feeac4b54aadc8f511cab0d39/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:45.007438 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa3581-4ff9-4af2-a9fb-f4edb3306dd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4023c1075bf64a2e8ba7d910c1eb16be, user_id=1b6de43feeac4b54aadc8f511cab0d39, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:45.015683 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa3581-4ff9-4af2-a9fb-f4edb3306dd6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:45.049740 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 919/1828] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:48:44 2022] PUT /identity/v3/projects/4023c1075bf64a2e8ba7d910c1eb16be/users/1b6de43feeac4b54aadc8f511cab0d39/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:45.049740 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa3581-4ff9-4af2-a9fb-f4edb3306dd6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:45.138897 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa3581-4ff9-4af2-a9fb-f4edb3306dd6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:45.151935 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654b53b-3d22-4ae0-af93-2bcaee1d11a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:45.153129 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654b53b-3d22-4ae0-af93-2bcaee1d11a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:45.153485 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654b53b-3d22-4ae0-af93-2bcaee1d11a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:45.153965 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654b53b-3d22-4ae0-af93-2bcaee1d11a8 admin admin] PATH_INFO: `/v3/projects/216d25f9b11b4c97bebefbd061993292/users/961d0da5168949169227d7afe8f07cca/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:45.179846 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f654b53b-3d22-4ae0-af93-2bcaee1d11a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=216d25f9b11b4c97bebefbd061993292, user_id=961d0da5168949169227d7afe8f07cca, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:45.181254 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f654b53b-3d22-4ae0-af93-2bcaee1d11a8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:45.949713 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f7632415-1c7d-4292-896a-038413bae330 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b30b55bd848247cda037361407509235'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:45.950944 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f7632415-1c7d-4292-896a-038413bae330 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b30b55bd848247cda037361407509235'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:45.960522 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f7632415-1c7d-4292-896a-038413bae330 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b30b55bd848247cda037361407509235'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:45.991413 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f7632415-1c7d-4292-896a-038413bae330 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b30b55bd848247cda037361407509235'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:45.993029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f7632415-1c7d-4292-896a-038413bae330 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b30b55bd848247cda037361407509235'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:45.993611 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 920/1829] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:48:45 2022] PUT /identity/v3/projects/216d25f9b11b4c97bebefbd061993292/users/961d0da5168949169227d7afe8f07cca/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 945 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:45.994808 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654b53b-3d22-4ae0-af93-2bcaee1d11a8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:45.996719 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f654b53b-3d22-4ae0-af93-2bcaee1d11a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:46.083405 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654b53b-3d22-4ae0-af93-2bcaee1d11a8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:46.089480 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cbdbd5-7ee0-4c6c-98c4-b82b733cdd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:46.090248 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbdbd5-7ee0-4c6c-98c4-b82b733cdd5d admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:46.090520 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbdbd5-7ee0-4c6c-98c4-b82b733cdd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:46.090796 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbdbd5-7ee0-4c6c-98c4-b82b733cdd5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:46.091452 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cbdbd5-7ee0-4c6c-98c4-b82b733cdd5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:46.093112 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cbdbd5-7ee0-4c6c-98c4-b82b733cdd5d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:46.098852 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 910/1830] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:48:44 2022] DELETE /identity/v3/users/b30b55bd848247cda037361407509235 => generated 0 bytes in 1679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:46.098852 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7632415-1c7d-4292-896a-038413bae330 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:46.100119 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f7632415-1c7d-4292-896a-038413bae330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:46.114278 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 921/1831] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:46.116229 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d7f32-c1b8-4e1a-ad35-697b6cc32862 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:46.116543 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d7f32-c1b8-4e1a-ad35-697b6cc32862 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:46.116863 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d7f32-c1b8-4e1a-ad35-697b6cc32862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:46.168866 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5f5d7f32-c1b8-4e1a-ad35-697b6cc32862 None None] MFA Rules not processed for user `1b6de43feeac4b54aadc8f511cab0d39`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:46.168866 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5f5d7f32-c1b8-4e1a-ad35-697b6cc32862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:46.228638 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7632415-1c7d-4292-896a-038413bae330 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:46.233400 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b75a5-6152-4a1e-8277-0a5d482f3d37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:46.234101 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b75a5-6152-4a1e-8277-0a5d482f3d37 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:46.234405 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b75a5-6152-4a1e-8277-0a5d482f3d37 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:46.234705 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b75a5-6152-4a1e-8277-0a5d482f3d37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:46.236790 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e10b75a5-6152-4a1e-8277-0a5d482f3d37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:46.290408 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 922/1832] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:46 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:46.291975 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841774b-f938-41fe-84d5-40524cbcdcf1 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:46.292435 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841774b-f938-41fe-84d5-40524cbcdcf1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:46.293053 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841774b-f938-41fe-84d5-40524cbcdcf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:46.362792 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d841774b-f938-41fe-84d5-40524cbcdcf1 None None] MFA Rules not processed for user `961d0da5168949169227d7afe8f07cca`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:46.364349 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d841774b-f938-41fe-84d5-40524cbcdcf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:46.372230 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b75a5-6152-4a1e-8277-0a5d482f3d37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:46.374062 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b75a5-6152-4a1e-8277-0a5d482f3d37 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:46.387180 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 911/1833] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:46.388691 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3d42d-6b88-489f-b03b-b4bcc64b591c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:46.389478 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3d42d-6b88-489f-b03b-b4bcc64b591c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:46.390131 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3d42d-6b88-489f-b03b-b4bcc64b591c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:46.421893 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c3e3d42d-6b88-489f-b03b-b4bcc64b591c None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:46.423387 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c3e3d42d-6b88-489f-b03b-b4bcc64b591c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:46.453353 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 923/1834] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:46 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:46.457562 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841774b-f938-41fe-84d5-40524cbcdcf1 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:46.521408 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 912/1835] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:46.522213 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3d42d-6b88-489f-b03b-b4bcc64b591c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:46.525594 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c3e3d42d-6b88-489f-b03b-b4bcc64b591c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:46.551178 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3d42d-6b88-489f-b03b-b4bcc64b591c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:46.555817 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1814ce-31ca-441d-a181-24ad73498e43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:46.556463 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1814ce-31ca-441d-a181-24ad73498e43 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:46.556784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1814ce-31ca-441d-a181-24ad73498e43 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:46.557113 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1814ce-31ca-441d-a181-24ad73498e43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:46.580530 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1814ce-31ca-441d-a181-24ad73498e43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:46.584133 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1814ce-31ca-441d-a181-24ad73498e43 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:46.593217 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841774b-f938-41fe-84d5-40524cbcdcf1 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:46.594581 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 913/1836] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:46 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:46.595466 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1814ce-31ca-441d-a181-24ad73498e43 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:46.597144 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cc1814ce-31ca-441d-a181-24ad73498e43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:46.603970 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f809c6-4bcb-439b-9f15-347dc0e98319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:46.608632 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f809c6-4bcb-439b-9f15-347dc0e98319 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:46.612861 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f809c6-4bcb-439b-9f15-347dc0e98319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:46.612861 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f809c6-4bcb-439b-9f15-347dc0e98319 admin admin] PATH_INFO: `/v3/projects/e7aa154d73ce4aeba1cb778a5555ec49/users/7446ea0675ce461b80c8755e56e808fb/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:46.635317 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1814ce-31ca-441d-a181-24ad73498e43 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:46.636520 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f809c6-4bcb-439b-9f15-347dc0e98319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7aa154d73ce4aeba1cb778a5555ec49, user_id=7446ea0675ce461b80c8755e56e808fb, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:46.639369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f809c6-4bcb-439b-9f15-347dc0e98319 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:46.644953 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05d2c0-d10b-449f-a0cd-fa6ee26a17e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:46.645604 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05d2c0-d10b-449f-a0cd-fa6ee26a17e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:46.645941 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05d2c0-d10b-449f-a0cd-fa6ee26a17e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:46.646768 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05d2c0-d10b-449f-a0cd-fa6ee26a17e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:46.647490 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05d2c0-d10b-449f-a0cd-fa6ee26a17e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:46.649531 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05d2c0-d10b-449f-a0cd-fa6ee26a17e7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:47.116597 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 924/1837] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:48:46 2022] PUT /identity/v3/projects/e7aa154d73ce4aeba1cb778a5555ec49/users/7446ea0675ce461b80c8755e56e808fb/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:47.116597 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f809c6-4bcb-439b-9f15-347dc0e98319 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:47.117190 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e8f809c6-4bcb-439b-9f15-347dc0e98319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:47.118764 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 914/1838] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:48:46 2022] POST /identity/v3/projects => generated 357 bytes in 521 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:47.119713 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05d2c0-d10b-449f-a0cd-fa6ee26a17e7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:47.213805 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05d2c0-d10b-449f-a0cd-fa6ee26a17e7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:47.220338 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c893c13-8311-4c44-893a-a7925e157086 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:47.221537 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c893c13-8311-4c44-893a-a7925e157086 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:47.222157 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c893c13-8311-4c44-893a-a7925e157086 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:47.222817 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c893c13-8311-4c44-893a-a7925e157086 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:47.226387 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4c893c13-8311-4c44-893a-a7925e157086 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:47.229448 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f809c6-4bcb-439b-9f15-347dc0e98319 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:47.286356 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48449256-6e5b-4947-b47f-0d9944aac2e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:47.287965 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48449256-6e5b-4947-b47f-0d9944aac2e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:47.288245 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48449256-6e5b-4947-b47f-0d9944aac2e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:47.288604 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48449256-6e5b-4947-b47f-0d9944aac2e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:47.325978 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c893c13-8311-4c44-893a-a7925e157086 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:47.325978 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c893c13-8311-4c44-893a-a7925e157086 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:47.353945 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 915/1839] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:47.359154 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c893c13-8311-4c44-893a-a7925e157086 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:47.416621 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48449256-6e5b-4947-b47f-0d9944aac2e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:47.418119 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48449256-6e5b-4947-b47f-0d9944aac2e4 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:47.439549 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 925/1840] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:47.440710 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da46c2a-1ce2-44b3-bc0f-c6ee800815d9 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:47.441053 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da46c2a-1ce2-44b3-bc0f-c6ee800815d9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:47.441272 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da46c2a-1ce2-44b3-bc0f-c6ee800815d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:47.478762 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c893c13-8311-4c44-893a-a7925e157086 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:47.492739 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa4890-b6e7-4972-89bd-5b0b313797df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:47.493811 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa4890-b6e7-4972-89bd-5b0b313797df admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:47.494109 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8da46c2a-1ce2-44b3-bc0f-c6ee800815d9 None None] MFA Rules not processed for user `7446ea0675ce461b80c8755e56e808fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:47.494429 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa4890-b6e7-4972-89bd-5b0b313797df admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:47.494899 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa4890-b6e7-4972-89bd-5b0b313797df admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:47.495344 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8da46c2a-1ce2-44b3-bc0f-c6ee800815d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:47.495855 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa4890-b6e7-4972-89bd-5b0b313797df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:47.498395 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa4890-b6e7-4972-89bd-5b0b313797df admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:47.589480 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:47.598315 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 916/1841] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:48:47 2022] POST /identity/v3/users => generated 285 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:47.599440 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa4890-b6e7-4972-89bd-5b0b313797df admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:47.606203 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 926/1842] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:47 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:47.606203 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da46c2a-1ce2-44b3-bc0f-c6ee800815d9 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:47.616485 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da46c2a-1ce2-44b3-bc0f-c6ee800815d9 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:47.621911 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b981c-ba3d-412c-a9b6-15242e7df8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:47.622597 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b981c-ba3d-412c-a9b6-15242e7df8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:47.627188 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b981c-ba3d-412c-a9b6-15242e7df8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:47.627188 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b981c-ba3d-412c-a9b6-15242e7df8d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:47.627188 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b981c-ba3d-412c-a9b6-15242e7df8d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:47.627188 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b981c-ba3d-412c-a9b6-15242e7df8d7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:47.627807 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa4890-b6e7-4972-89bd-5b0b313797df admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:47.634895 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fca2fb-8620-4510-8061-41038d3778db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:47.635606 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fca2fb-8620-4510-8061-41038d3778db service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:47.636260 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fca2fb-8620-4510-8061-41038d3778db service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:47.636701 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fca2fb-8620-4510-8061-41038d3778db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:47.639782 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 927/1843] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:47.643584 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b981c-ba3d-412c-a9b6-15242e7df8d7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:47.648619 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a3fca2fb-8620-4510-8061-41038d3778db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:47.655481 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b981c-ba3d-412c-a9b6-15242e7df8d7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:47.661474 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72dab4-c33e-4f10-bbe5-977f13e3175f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:47.662222 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72dab4-c33e-4f10-bbe5-977f13e3175f admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:47.662571 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72dab4-c33e-4f10-bbe5-977f13e3175f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:47.662932 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72dab4-c33e-4f10-bbe5-977f13e3175f admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:47.663704 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72dab4-c33e-4f10-bbe5-977f13e3175f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:47.665806 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72dab4-c33e-4f10-bbe5-977f13e3175f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:47.742559 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:47.778949 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fca2fb-8620-4510-8061-41038d3778db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:47.781340 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fca2fb-8620-4510-8061-41038d3778db service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:47.808324 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 917/1844] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:47.809951 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fca2fb-8620-4510-8061-41038d3778db service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:47.827521 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fca2fb-8620-4510-8061-41038d3778db service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:47.830671 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 928/1845] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:48:47 2022] POST /identity/v3/projects => generated 393 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:47.830809 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd72080-9e40-4389-a605-6d671f326319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:47.831069 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd72080-9e40-4389-a605-6d671f326319 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:47.831452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd72080-9e40-4389-a605-6d671f326319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:47.831829 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd72080-9e40-4389-a605-6d671f326319 admin admin] PATH_INFO: `/v3/projects/449151af186240e49a77189165ca441c/users/6b60c613897c47988b9971680dd54066/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:47.832082 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72dab4-c33e-4f10-bbe5-977f13e3175f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:47.855049 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd72080-9e40-4389-a605-6d671f326319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=449151af186240e49a77189165ca441c, user_id=6b60c613897c47988b9971680dd54066, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:47.858822 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd72080-9e40-4389-a605-6d671f326319 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:47.967963 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72dab4-c33e-4f10-bbe5-977f13e3175f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:47.975068 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce1037-3f4d-4d31-9fa7-2f9ee0a2b2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:47.975816 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce1037-3f4d-4d31-9fa7-2f9ee0a2b2c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:47.976282 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce1037-3f4d-4d31-9fa7-2f9ee0a2b2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:47.976595 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce1037-3f4d-4d31-9fa7-2f9ee0a2b2c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:47.977372 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce1037-3f4d-4d31-9fa7-2f9ee0a2b2c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:47.979967 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce1037-3f4d-4d31-9fa7-2f9ee0a2b2c4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:48.014799 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 918/1846] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:48:47 2022] PUT /identity/v3/projects/449151af186240e49a77189165ca441c/users/6b60c613897c47988b9971680dd54066/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:48.014799 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd72080-9e40-4389-a605-6d671f326319 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:48.017325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-edd72080-9e40-4389-a605-6d671f326319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:48.126819 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd72080-9e40-4389-a605-6d671f326319 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:48.137435 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd381e-bf40-4572-af3d-0a587e9c8d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:48.138507 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd381e-bf40-4572-af3d-0a587e9c8d44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:48.138875 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd381e-bf40-4572-af3d-0a587e9c8d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:48.139165 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd381e-bf40-4572-af3d-0a587e9c8d44 admin admin] PATH_INFO: `/v3/projects/cf4f8bde33a7408bae4eac8d46a0fdff` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:48.140889 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd381e-bf40-4572-af3d-0a587e9c8d44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf4f8bde33a7408bae4eac8d46a0fdff)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:48.146409 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd381e-bf40-4572-af3d-0a587e9c8d44 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:48.196830 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 929/1847] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:48:47 2022] POST /identity/v3/users => generated 303 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:48.197705 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce1037-3f4d-4d31-9fa7-2f9ee0a2b2c4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:48.210382 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce1037-3f4d-4d31-9fa7-2f9ee0a2b2c4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:48.216228 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917c788-bf25-4497-8eb9-9fa9185527f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:48.216870 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917c788-bf25-4497-8eb9-9fa9185527f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:48.222211 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917c788-bf25-4497-8eb9-9fa9185527f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:48.222211 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917c788-bf25-4497-8eb9-9fa9185527f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:48.222211 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917c788-bf25-4497-8eb9-9fa9185527f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:48.222211 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917c788-bf25-4497-8eb9-9fa9185527f5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:48.230802 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 930/1848] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:48.232321 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917c788-bf25-4497-8eb9-9fa9185527f5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:48.245022 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917c788-bf25-4497-8eb9-9fa9185527f5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:48.250905 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f7e06-79da-4835-8527-0044c6c02b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:48.250905 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f7e06-79da-4835-8527-0044c6c02b0a admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:48.251167 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f7e06-79da-4835-8527-0044c6c02b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:48.251439 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f7e06-79da-4835-8527-0044c6c02b0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:48.252081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f7e06-79da-4835-8527-0044c6c02b0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:48.253702 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f7e06-79da-4835-8527-0044c6c02b0a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:48.266642 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 931/1849] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:48.267758 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f7e06-79da-4835-8527-0044c6c02b0a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:48.279632 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f7e06-79da-4835-8527-0044c6c02b0a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:48.284805 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461609a-3917-418b-b00c-8c38704b1289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:48.285601 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461609a-3917-418b-b00c-8c38704b1289 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:48.286008 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461609a-3917-418b-b00c-8c38704b1289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:48.286371 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461609a-3917-418b-b00c-8c38704b1289 admin admin] PATH_INFO: `/v3/projects/449151af186240e49a77189165ca441c/users/6b60c613897c47988b9971680dd54066/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:48.307808 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461609a-3917-418b-b00c-8c38704b1289 admin admin] RBAC: Authorizing `identity:create_grant(project_id=449151af186240e49a77189165ca441c, user_id=6b60c613897c47988b9971680dd54066, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:48.310952 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461609a-3917-418b-b00c-8c38704b1289 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:48.330527 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-96cd381e-bf40-4572-af3d-0a587e9c8d44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf4f8bde33a7408bae4eac8d46a0fdff', 'request_id': 'req-96cd381e-bf40-4572-af3d-0a587e9c8d44'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:48.333841 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 932/1850] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:48:48 2022] PUT /identity/v3/projects/449151af186240e49a77189165ca441c/users/6b60c613897c47988b9971680dd54066/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:48.334802 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461609a-3917-418b-b00c-8c38704b1289 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:48.393612 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-96cd381e-bf40-4572-af3d-0a587e9c8d44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf4f8bde33a7408bae4eac8d46a0fdff', 'request_id': 'req-96cd381e-bf40-4572-af3d-0a587e9c8d44'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:48.410063 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-96cd381e-bf40-4572-af3d-0a587e9c8d44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf4f8bde33a7408bae4eac8d46a0fdff', 'request_id': 'req-96cd381e-bf40-4572-af3d-0a587e9c8d44'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:48.443685 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-96cd381e-bf40-4572-af3d-0a587e9c8d44 admin admin] The token cache is being invalidate because project cf4f8bde33a7408bae4eac8d46a0fdff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:48:48.446295 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-96cd381e-bf40-4572-af3d-0a587e9c8d44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:48.446295 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-96cd381e-bf40-4572-af3d-0a587e9c8d44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:48.448224 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 919/1851] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:48:48 2022] DELETE /identity/v3/projects/cf4f8bde33a7408bae4eac8d46a0fdff => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:48.450234 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ee3f9-81da-4292-ab35-e3bcbd8466f2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:48.450818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ee3f9-81da-4292-ab35-e3bcbd8466f2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:48.451228 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ee3f9-81da-4292-ab35-e3bcbd8466f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:48.457817 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461609a-3917-418b-b00c-8c38704b1289 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:48.466776 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801558e-3899-4d8d-b429-f308400153a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:48.467892 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801558e-3899-4d8d-b429-f308400153a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:48.468511 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801558e-3899-4d8d-b429-f308400153a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:48.470278 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801558e-3899-4d8d-b429-f308400153a4 admin admin] PATH_INFO: `/v3/projects/4bc56fd4e70a402385efecc38bd14658/users/e0d121900659407e983beff854372e1c/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:48.511854 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801558e-3899-4d8d-b429-f308400153a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bc56fd4e70a402385efecc38bd14658, user_id=e0d121900659407e983beff854372e1c, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:48.512187 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a40ee3f9-81da-4292-ab35-e3bcbd8466f2 None None] MFA Rules not processed for user `6b60c613897c47988b9971680dd54066`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:48.515174 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a40ee3f9-81da-4292-ab35-e3bcbd8466f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:48.518614 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801558e-3899-4d8d-b429-f308400153a4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:48.638585 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 933/1852] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:48:48 2022] PUT /identity/v3/projects/4bc56fd4e70a402385efecc38bd14658/users/e0d121900659407e983beff854372e1c/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:48.639362 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801558e-3899-4d8d-b429-f308400153a4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:48.644837 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6801558e-3899-4d8d-b429-f308400153a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:48.702596 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 920/1853] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:48 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:48.702596 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ee3f9-81da-4292-ab35-e3bcbd8466f2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:48.702888 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a40ee3f9-81da-4292-ab35-e3bcbd8466f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:48.752901 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ee3f9-81da-4292-ab35-e3bcbd8466f2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:48.863818 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801558e-3899-4d8d-b429-f308400153a4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:48.869822 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bfe91f-7131-4002-8f09-39cfaa0b3ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:48.871327 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfe91f-7131-4002-8f09-39cfaa0b3ee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:48.871327 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfe91f-7131-4002-8f09-39cfaa0b3ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:48.871327 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfe91f-7131-4002-8f09-39cfaa0b3ee8 admin admin] PATH_INFO: `/v3/users/47699f94d53143e997a1b53f62c1ea56` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:48.871657 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a8d2b6-a0ee-46b3-8ec4-552ee68eea4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:48.871770 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8d2b6-a0ee-46b3-8ec4-552ee68eea4f admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:48.872056 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8d2b6-a0ee-46b3-8ec4-552ee68eea4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:48.872311 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8d2b6-a0ee-46b3-8ec4-552ee68eea4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:48.872968 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a8d2b6-a0ee-46b3-8ec4-552ee68eea4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:48.873076 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bfe91f-7131-4002-8f09-39cfaa0b3ee8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47699f94d53143e997a1b53f62c1ea56)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:48.874751 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a8d2b6-a0ee-46b3-8ec4-552ee68eea4f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:48.875357 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bfe91f-7131-4002-8f09-39cfaa0b3ee8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:48.889972 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 921/1854] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:48.890836 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a8d2b6-a0ee-46b3-8ec4-552ee68eea4f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:48.892692 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-88a8d2b6-a0ee-46b3-8ec4-552ee68eea4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:48.981119 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a8d2b6-a0ee-46b3-8ec4-552ee68eea4f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:48.985091 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b8208-92ab-4d1f-af8e-e417de1929e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:48.986099 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b8208-92ab-4d1f-af8e-e417de1929e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:48.986099 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b8208-92ab-4d1f-af8e-e417de1929e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:48.986289 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b8208-92ab-4d1f-af8e-e417de1929e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:49.058512 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b8208-92ab-4d1f-af8e-e417de1929e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:49.060286 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b8208-92ab-4d1f-af8e-e417de1929e1 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:49.071177 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 922/1855] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:48 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:49.077961 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b8208-92ab-4d1f-af8e-e417de1929e1 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:49.084307 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b8208-92ab-4d1f-af8e-e417de1929e1 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:49.089385 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05efca3d-4990-48e8-896a-e09649bd8bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:49.090255 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efca3d-4990-48e8-896a-e09649bd8bdb admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:49.090596 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efca3d-4990-48e8-896a-e09649bd8bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:49.090880 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efca3d-4990-48e8-896a-e09649bd8bdb admin admin] PATH_INFO: `/v3/projects/4bc56fd4e70a402385efecc38bd14658/users/e0d121900659407e983beff854372e1c/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:49.093653 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05efca3d-4990-48e8-896a-e09649bd8bdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bc56fd4e70a402385efecc38bd14658, user_id=e0d121900659407e983beff854372e1c, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:49.096922 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05efca3d-4990-48e8-896a-e09649bd8bdb admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:49.112782 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 923/1856] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:48:49 2022] PUT /identity/v3/projects/4bc56fd4e70a402385efecc38bd14658/users/e0d121900659407e983beff854372e1c/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:49.124132 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9c894-a47f-4b7f-acaa-ff4ba8ad3cbd None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:49.124447 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9c894-a47f-4b7f-acaa-ff4ba8ad3cbd None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:49.124751 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9c894-a47f-4b7f-acaa-ff4ba8ad3cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:49.157088 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-91c9c894-a47f-4b7f-acaa-ff4ba8ad3cbd None None] MFA Rules not processed for user `e0d121900659407e983beff854372e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:49.158519 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-91c9c894-a47f-4b7f-acaa-ff4ba8ad3cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:49.254805 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 924/1857] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:49 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:49.259491 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c7bfe91f-7131-4002-8f09-39cfaa0b3ee8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47699f94d53143e997a1b53f62c1ea56'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:49.260322 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c7bfe91f-7131-4002-8f09-39cfaa0b3ee8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47699f94d53143e997a1b53f62c1ea56'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:49.267523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c7bfe91f-7131-4002-8f09-39cfaa0b3ee8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47699f94d53143e997a1b53f62c1ea56'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:49.280634 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c7bfe91f-7131-4002-8f09-39cfaa0b3ee8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47699f94d53143e997a1b53f62c1ea56'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:49.281471 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c7bfe91f-7131-4002-8f09-39cfaa0b3ee8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47699f94d53143e997a1b53f62c1ea56'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:49.386806 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 934/1858] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:48:48 2022] DELETE /identity/v3/users/47699f94d53143e997a1b53f62c1ea56 => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:49.398039 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9c894-a47f-4b7f-acaa-ff4ba8ad3cbd None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:49.454988 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9c894-a47f-4b7f-acaa-ff4ba8ad3cbd None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:49.508155 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3628d729-b526-4f6d-966a-459c8c470da5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:49.508775 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628d729-b526-4f6d-966a-459c8c470da5 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:49.509053 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628d729-b526-4f6d-966a-459c8c470da5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:49.509323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628d729-b526-4f6d-966a-459c8c470da5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:49.511362 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3628d729-b526-4f6d-966a-459c8c470da5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:49.577869 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3628d729-b526-4f6d-966a-459c8c470da5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:49.579508 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3628d729-b526-4f6d-966a-459c8c470da5 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:49.594439 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 925/1859] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:49 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:49.656655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bfe91f-7131-4002-8f09-39cfaa0b3ee8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:49.658146 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c7bfe91f-7131-4002-8f09-39cfaa0b3ee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:49.671366 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bfe91f-7131-4002-8f09-39cfaa0b3ee8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:49.675286 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a91dc-9ce5-4a97-9f60-a627a6ccd36e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:49.676111 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a91dc-9ce5-4a97-9f60-a627a6ccd36e service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:49.676254 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a91dc-9ce5-4a97-9f60-a627a6ccd36e service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:49.676568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a91dc-9ce5-4a97-9f60-a627a6ccd36e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:49.678956 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-383a91dc-9ce5-4a97-9f60-a627a6ccd36e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:49.751900 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a91dc-9ce5-4a97-9f60-a627a6ccd36e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:49.751900 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a91dc-9ce5-4a97-9f60-a627a6ccd36e service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:49.763709 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 935/1860] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:49 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:49.930890 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3628d729-b526-4f6d-966a-459c8c470da5 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:49.933349 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3628d729-b526-4f6d-966a-459c8c470da5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:49.966446 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a91dc-9ce5-4a97-9f60-a627a6ccd36e service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:49.968198 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-383a91dc-9ce5-4a97-9f60-a627a6ccd36e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:49.980131 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a91dc-9ce5-4a97-9f60-a627a6ccd36e service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:49.984197 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0a623-799b-4266-9703-1dacc04cfe9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:49.984814 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0a623-799b-4266-9703-1dacc04cfe9a service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:49.985102 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0a623-799b-4266-9703-1dacc04cfe9a service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:49.985406 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0a623-799b-4266-9703-1dacc04cfe9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:49.987491 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8ab0a623-799b-4266-9703-1dacc04cfe9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:50.029170 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3628d729-b526-4f6d-966a-459c8c470da5 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:50.034602 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0689cd-dc1e-43ea-9ffc-d5f12e0c3aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:50.036325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0689cd-dc1e-43ea-9ffc-d5f12e0c3aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:50.036325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0689cd-dc1e-43ea-9ffc-d5f12e0c3aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:50.036325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0689cd-dc1e-43ea-9ffc-d5f12e0c3aee admin admin] PATH_INFO: `/v3/projects/6209bfdce0a8407094e9c5758e41e4a9` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:50.037802 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0689cd-dc1e-43ea-9ffc-d5f12e0c3aee admin admin] RBAC: Authorizing `identity:delete_project(project_id=6209bfdce0a8407094e9c5758e41e4a9)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:50.040019 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0689cd-dc1e-43ea-9ffc-d5f12e0c3aee admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:50.063966 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab0a623-799b-4266-9703-1dacc04cfe9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:50.065428 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab0a623-799b-4266-9703-1dacc04cfe9a service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:50.076749 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 936/1861] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:49 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 03:48:50.189279 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bf0689cd-dc1e-43ea-9ffc-d5f12e0c3aee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6209bfdce0a8407094e9c5758e41e4a9', 'request_id': 'req-bf0689cd-dc1e-43ea-9ffc-d5f12e0c3aee'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:50.359856 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bf0689cd-dc1e-43ea-9ffc-d5f12e0c3aee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6209bfdce0a8407094e9c5758e41e4a9', 'request_id': 'req-bf0689cd-dc1e-43ea-9ffc-d5f12e0c3aee'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:50.370133 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bf0689cd-dc1e-43ea-9ffc-d5f12e0c3aee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6209bfdce0a8407094e9c5758e41e4a9', 'request_id': 'req-bf0689cd-dc1e-43ea-9ffc-d5f12e0c3aee'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:50.383426 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bf0689cd-dc1e-43ea-9ffc-d5f12e0c3aee admin admin] The token cache is being invalidate because project 6209bfdce0a8407094e9c5758e41e4a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:48:50.383816 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bf0689cd-dc1e-43ea-9ffc-d5f12e0c3aee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:50.384739 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bf0689cd-dc1e-43ea-9ffc-d5f12e0c3aee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:50.389898 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 926/1862] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:48:49 2022] DELETE /identity/v3/projects/6209bfdce0a8407094e9c5758e41e4a9 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:50.396719 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d092e-8933-4539-b89a-87290767b127 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:50.397196 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d092e-8933-4539-b89a-87290767b127 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:50.397414 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d092e-8933-4539-b89a-87290767b127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:50.420438 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-202d092e-8933-4539-b89a-87290767b127 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:50.421669 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-202d092e-8933-4539-b89a-87290767b127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:50.480442 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 937/1863] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:50.488420 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04e7fc-555e-4a70-8469-7603207718d9 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:50.488815 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04e7fc-555e-4a70-8469-7603207718d9 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:50.489180 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04e7fc-555e-4a70-8469-7603207718d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:50.510228 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3f04e7fc-555e-4a70-8469-7603207718d9 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:50.511486 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3f04e7fc-555e-4a70-8469-7603207718d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:50.519519 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 927/1864] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:48:50.523763 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d092e-8933-4539-b89a-87290767b127 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:50.533498 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d092e-8933-4539-b89a-87290767b127 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:50.538128 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51fcb0-0d0f-40ef-ac9d-0a30f7611ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:50.538752 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51fcb0-0d0f-40ef-ac9d-0a30f7611ade admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:50.539048 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51fcb0-0d0f-40ef-ac9d-0a30f7611ade admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:50.539303 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51fcb0-0d0f-40ef-ac9d-0a30f7611ade admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:50.539949 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a51fcb0-0d0f-40ef-ac9d-0a30f7611ade admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:48:50.540287 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a51fcb0-0d0f-40ef-ac9d-0a30f7611ade admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:50.541905 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a51fcb0-0d0f-40ef-ac9d-0a30f7611ade admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:50.554526 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 938/1865] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:48:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:48:50.558937 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04e7fc-555e-4a70-8469-7603207718d9 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:50.571597 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04e7fc-555e-4a70-8469-7603207718d9 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:50.575705 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:50.581569 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c61a7-66cb-4df9-aed3-fb7f815acd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:50.583341 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c61a7-66cb-4df9-aed3-fb7f815acd2c admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:50.583341 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c61a7-66cb-4df9-aed3-fb7f815acd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:50.583341 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c61a7-66cb-4df9-aed3-fb7f815acd2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:50.584178 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c61a7-66cb-4df9-aed3-fb7f815acd2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:50.585598 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c61a7-66cb-4df9-aed3-fb7f815acd2c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:50.698916 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 928/1866] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:48:50 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:50.700125 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51fcb0-0d0f-40ef-ac9d-0a30f7611ade admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:50.710279 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51fcb0-0d0f-40ef-ac9d-0a30f7611ade admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:50.765916 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebaf7b6-8049-49da-affa-8c8d4969a074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:50.766524 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebaf7b6-8049-49da-affa-8c8d4969a074 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:50.766800 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebaf7b6-8049-49da-affa-8c8d4969a074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:50.767070 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebaf7b6-8049-49da-affa-8c8d4969a074 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:50.767704 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebaf7b6-8049-49da-affa-8c8d4969a074 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:50.769597 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebaf7b6-8049-49da-affa-8c8d4969a074 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:50.862294 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 939/1867] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:48:50 2022] POST /identity/v3/users => generated 292 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:48:50.870772 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c61a7-66cb-4df9-aed3-fb7f815acd2c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:50.881906 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c61a7-66cb-4df9-aed3-fb7f815acd2c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:50.886448 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab64ec-a497-4328-bd48-9f253e401ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:50.887049 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab64ec-a497-4328-bd48-9f253e401ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:50.887327 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab64ec-a497-4328-bd48-9f253e401ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:50.887594 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab64ec-a497-4328-bd48-9f253e401ee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:50.888238 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab64ec-a497-4328-bd48-9f253e401ee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:50.889849 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab64ec-a497-4328-bd48-9f253e401ee0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:50.905850 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 929/1868] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:50.907674 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebaf7b6-8049-49da-affa-8c8d4969a074 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:50.919543 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebaf7b6-8049-49da-affa-8c8d4969a074 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:50.924931 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53abdea2-e033-45d9-a32b-6e80dc06ef80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:50.926160 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abdea2-e033-45d9-a32b-6e80dc06ef80 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:50.926160 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abdea2-e033-45d9-a32b-6e80dc06ef80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:50.926365 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abdea2-e033-45d9-a32b-6e80dc06ef80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:50.927283 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53abdea2-e033-45d9-a32b-6e80dc06ef80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:50.929246 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53abdea2-e033-45d9-a32b-6e80dc06ef80 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:50.943632 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 940/1869] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:50.950530 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab64ec-a497-4328-bd48-9f253e401ee0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:50.964329 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab64ec-a497-4328-bd48-9f253e401ee0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:50.971970 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d250a6b-c776-4ffe-a36e-7ff8bdf021d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:50.972958 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d250a6b-c776-4ffe-a36e-7ff8bdf021d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:50.973328 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d250a6b-c776-4ffe-a36e-7ff8bdf021d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:50.973756 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d250a6b-c776-4ffe-a36e-7ff8bdf021d2 admin admin] PATH_INFO: `/v3/projects/a147edb486e043d89e7f098926b73f6d/users/3a867eca442c4bb78f0a780b32db8b31/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:50.994113 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d250a6b-c776-4ffe-a36e-7ff8bdf021d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a147edb486e043d89e7f098926b73f6d, user_id=3a867eca442c4bb78f0a780b32db8b31, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:50.998085 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d250a6b-c776-4ffe-a36e-7ff8bdf021d2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:51.109734 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 930/1870] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:48:50 2022] PUT /identity/v3/projects/a147edb486e043d89e7f098926b73f6d/users/3a867eca442c4bb78f0a780b32db8b31/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:51.119874 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ed634-0b3b-4dfe-87cb-4526a6f38bfa None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:51.120170 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ed634-0b3b-4dfe-87cb-4526a6f38bfa None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:51.120438 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ed634-0b3b-4dfe-87cb-4526a6f38bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:51.151493 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b19ed634-0b3b-4dfe-87cb-4526a6f38bfa None None] MFA Rules not processed for user `3a867eca442c4bb78f0a780b32db8b31`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:51.153071 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b19ed634-0b3b-4dfe-87cb-4526a6f38bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:51.224704 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d250a6b-c776-4ffe-a36e-7ff8bdf021d2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:51.225293 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 941/1871] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:51.290166 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d250a6b-c776-4ffe-a36e-7ff8bdf021d2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:51.294839 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfae54-21b2-4757-af01-dc9fa599edf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:51.295451 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfae54-21b2-4757-af01-dc9fa599edf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:51.295730 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfae54-21b2-4757-af01-dc9fa599edf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:51.295999 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfae54-21b2-4757-af01-dc9fa599edf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:51.296623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccfae54-21b2-4757-af01-dc9fa599edf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:51.298533 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccfae54-21b2-4757-af01-dc9fa599edf2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:51.434932 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 931/1872] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:48:51 2022] POST /identity/v3/projects => generated 381 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:51.436006 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ed634-0b3b-4dfe-87cb-4526a6f38bfa None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:51.448041 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ed634-0b3b-4dfe-87cb-4526a6f38bfa None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:51.518990 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a872a8-636f-4c85-9d8b-2930096df9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:51.519639 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a872a8-636f-4c85-9d8b-2930096df9f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:51.519920 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a872a8-636f-4c85-9d8b-2930096df9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:51.520194 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a872a8-636f-4c85-9d8b-2930096df9f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:51.520840 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a872a8-636f-4c85-9d8b-2930096df9f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:51.523623 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a872a8-636f-4c85-9d8b-2930096df9f0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:51.645700 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 942/1873] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:48:51 2022] POST /identity/v3/users => generated 297 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:48:51.650885 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfae54-21b2-4757-af01-dc9fa599edf2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:51.663437 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfae54-21b2-4757-af01-dc9fa599edf2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:51.668232 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61285a07-73ac-4d00-804e-c40d649852fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:51.668843 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61285a07-73ac-4d00-804e-c40d649852fa admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:51.669121 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61285a07-73ac-4d00-804e-c40d649852fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:51.669420 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61285a07-73ac-4d00-804e-c40d649852fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:51.670106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61285a07-73ac-4d00-804e-c40d649852fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:51.671723 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61285a07-73ac-4d00-804e-c40d649852fa admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:51.682482 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 932/1874] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:51.686780 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a872a8-636f-4c85-9d8b-2930096df9f0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:51.697899 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a872a8-636f-4c85-9d8b-2930096df9f0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:51.703118 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff21c40-39ef-4cca-8489-2626910f128c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:51.703812 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff21c40-39ef-4cca-8489-2626910f128c admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:51.704550 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff21c40-39ef-4cca-8489-2626910f128c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:51.704550 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff21c40-39ef-4cca-8489-2626910f128c admin admin] PATH_INFO: `/v3/projects/56b95ddf8cc542bd9898d81ca9ff9f0b/users/f8ff35d985534eea950fe9e636c1ab61/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:51.721061 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff21c40-39ef-4cca-8489-2626910f128c admin admin] RBAC: Authorizing `identity:create_grant(project_id=56b95ddf8cc542bd9898d81ca9ff9f0b, user_id=f8ff35d985534eea950fe9e636c1ab61, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:51.723878 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff21c40-39ef-4cca-8489-2626910f128c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:51.834066 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 943/1875] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:48:51 2022] PUT /identity/v3/projects/56b95ddf8cc542bd9898d81ca9ff9f0b/users/f8ff35d985534eea950fe9e636c1ab61/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:51.838393 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61285a07-73ac-4d00-804e-c40d649852fa admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:51.848590 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61285a07-73ac-4d00-804e-c40d649852fa admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:51.908572 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ccd42-dcad-4e97-9116-372db35e509b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:51.909194 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ccd42-dcad-4e97-9116-372db35e509b admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:51.909477 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ccd42-dcad-4e97-9116-372db35e509b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:51.909783 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ccd42-dcad-4e97-9116-372db35e509b admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:51.910472 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ccd42-dcad-4e97-9116-372db35e509b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:51.912144 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ccd42-dcad-4e97-9116-372db35e509b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:51.922665 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 933/1876] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:51 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:51.926667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff21c40-39ef-4cca-8489-2626910f128c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:51.938238 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff21c40-39ef-4cca-8489-2626910f128c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:51.944255 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91bfa3-5890-44fc-8cce-abf24197da75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:51.947535 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91bfa3-5890-44fc-8cce-abf24197da75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:51.947535 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91bfa3-5890-44fc-8cce-abf24197da75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:51.947535 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91bfa3-5890-44fc-8cce-abf24197da75 admin admin] PATH_INFO: `/v3/projects/56b95ddf8cc542bd9898d81ca9ff9f0b/users/f8ff35d985534eea950fe9e636c1ab61/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:51.947535 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b91bfa3-5890-44fc-8cce-abf24197da75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56b95ddf8cc542bd9898d81ca9ff9f0b, user_id=f8ff35d985534eea950fe9e636c1ab61, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:51.950343 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b91bfa3-5890-44fc-8cce-abf24197da75 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:51.962209 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 944/1877] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:48:51 2022] PUT /identity/v3/projects/56b95ddf8cc542bd9898d81ca9ff9f0b/users/f8ff35d985534eea950fe9e636c1ab61/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:51.974444 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a443db-eb1c-478b-91d3-c404041fef0a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:51.974763 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a443db-eb1c-478b-91d3-c404041fef0a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:51.975218 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a443db-eb1c-478b-91d3-c404041fef0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:52.006498 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-43a443db-eb1c-478b-91d3-c404041fef0a None None] MFA Rules not processed for user `f8ff35d985534eea950fe9e636c1ab61`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:52.007790 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-43a443db-eb1c-478b-91d3-c404041fef0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:52.090289 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 934/1878] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:51 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:48:52.202948 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91bfa3-5890-44fc-8cce-abf24197da75 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:52.204977 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9b91bfa3-5890-44fc-8cce-abf24197da75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:52.265164 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91bfa3-5890-44fc-8cce-abf24197da75 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:52.269044 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d2e56-1533-482e-9718-8039ff47e754 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:52.269800 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d2e56-1533-482e-9718-8039ff47e754 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:52.270176 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d2e56-1533-482e-9718-8039ff47e754 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:52.270562 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d2e56-1533-482e-9718-8039ff47e754 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:52.280840 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841d2e56-1533-482e-9718-8039ff47e754 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:52.282409 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841d2e56-1533-482e-9718-8039ff47e754 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:52.292601 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 945/1879] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:52 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:52.476432 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a443db-eb1c-478b-91d3-c404041fef0a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:52.478507 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-43a443db-eb1c-478b-91d3-c404041fef0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:52.495551 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a443db-eb1c-478b-91d3-c404041fef0a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:52.500523 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05757837-644f-4fdf-a539-a7c465b0601b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:52.501425 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05757837-644f-4fdf-a539-a7c465b0601b service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:52.508158 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05757837-644f-4fdf-a539-a7c465b0601b service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:52.508158 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05757837-644f-4fdf-a539-a7c465b0601b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:52.565356 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:52.586731 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05757837-644f-4fdf-a539-a7c465b0601b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:52.588345 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05757837-644f-4fdf-a539-a7c465b0601b service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:52.599968 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 935/1880] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:53.750479 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d2e56-1533-482e-9718-8039ff47e754 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:53.752185 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-841d2e56-1533-482e-9718-8039ff47e754 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:53.821655 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:53.844338 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d2e56-1533-482e-9718-8039ff47e754 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:53.849809 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9a75d-9c28-4370-be5e-794dd74f5d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:53.857385 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9a75d-9c28-4370-be5e-794dd74f5d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:53.857385 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9a75d-9c28-4370-be5e-794dd74f5d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:53.857385 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9a75d-9c28-4370-be5e-794dd74f5d64 admin admin] PATH_INFO: `/v3/users/394cf89a5f0449e386a8c853275168b2` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:53.857385 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9a75d-9c28-4370-be5e-794dd74f5d64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=394cf89a5f0449e386a8c853275168b2)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:53.857385 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9a75d-9c28-4370-be5e-794dd74f5d64 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:54.133658 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d3b9a75d-9c28-4370-be5e-794dd74f5d64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '394cf89a5f0449e386a8c853275168b2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:54.134343 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d3b9a75d-9c28-4370-be5e-794dd74f5d64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '394cf89a5f0449e386a8c853275168b2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:54.142887 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d3b9a75d-9c28-4370-be5e-794dd74f5d64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '394cf89a5f0449e386a8c853275168b2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:54.155247 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d3b9a75d-9c28-4370-be5e-794dd74f5d64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '394cf89a5f0449e386a8c853275168b2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:54.156013 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d3b9a75d-9c28-4370-be5e-794dd74f5d64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '394cf89a5f0449e386a8c853275168b2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:54.255804 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 946/1881] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:48:53 2022] DELETE /identity/v3/users/394cf89a5f0449e386a8c853275168b2 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:54.262615 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa6f27-8fcb-40d5-a7e9-d0bc183c1c73 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:54.262996 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa6f27-8fcb-40d5-a7e9-d0bc183c1c73 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:54.263332 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa6f27-8fcb-40d5-a7e9-d0bc183c1c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:54.284394 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-dfaa6f27-8fcb-40d5-a7e9-d0bc183c1c73 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:54.285605 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dfaa6f27-8fcb-40d5-a7e9-d0bc183c1c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:54.349835 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 936/1882] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:54.360502 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9a75d-9c28-4370-be5e-794dd74f5d64 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:54.361973 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d3b9a75d-9c28-4370-be5e-794dd74f5d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:54.424724 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9a75d-9c28-4370-be5e-794dd74f5d64 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:54.428976 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eddc9a-d819-45b8-9554-abcfad215d1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:54.429606 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eddc9a-d819-45b8-9554-abcfad215d1e service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:54.429935 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eddc9a-d819-45b8-9554-abcfad215d1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:54.430207 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eddc9a-d819-45b8-9554-abcfad215d1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:54.439480 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eddc9a-d819-45b8-9554-abcfad215d1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:54.440963 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eddc9a-d819-45b8-9554-abcfad215d1e service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:54.451304 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 947/1883] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:54.910062 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5cd57-0b5f-4c35-9591-320f9ca35773 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:54.910536 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5cd57-0b5f-4c35-9591-320f9ca35773 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:54.910634 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5cd57-0b5f-4c35-9591-320f9ca35773 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:54.912306 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 937/1884] 10.222.0.33 () {54 vars in 921 bytes} [Fri Sep 16 03:48:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:48:55.039229 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2165914-810a-4f46-b8bd-02864178203e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:55.040120 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2165914-810a-4f46-b8bd-02864178203e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:55.040727 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2165914-810a-4f46-b8bd-02864178203e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:55.090754 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a2165914-810a-4f46-b8bd-02864178203e None None] MFA Rules not processed for user `c09d1a4ac8b64921a6b05fcd567bb770`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:55.092138 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a2165914-810a-4f46-b8bd-02864178203e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:55.133019 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5cd57-0b5f-4c35-9591-320f9ca35773 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:55.134965 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cde5cd57-0b5f-4c35-9591-320f9ca35773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:55.161729 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5cd57-0b5f-4c35-9591-320f9ca35773 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:55.172250 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7383018-384f-4a6f-b474-7b0618f38a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:55.173884 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7383018-384f-4a6f-b474-7b0618f38a65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:55.175193 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7383018-384f-4a6f-b474-7b0618f38a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:55.175480 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7383018-384f-4a6f-b474-7b0618f38a65 admin admin] PATH_INFO: `/v3/projects/30b6b880cdc44ce99371a6cf70a24d01` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:55.179451 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7383018-384f-4a6f-b474-7b0618f38a65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30b6b880cdc44ce99371a6cf70a24d01)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:55.186066 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7383018-384f-4a6f-b474-7b0618f38a65 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:55.223445 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 948/1885] 10.222.0.33 () {58 vars in 1018 bytes} [Fri Sep 16 03:48:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:55.363153 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2165914-810a-4f46-b8bd-02864178203e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:55.364667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a2165914-810a-4f46-b8bd-02864178203e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:55.380010 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2165914-810a-4f46-b8bd-02864178203e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:55.395633 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a7383018-384f-4a6f-b474-7b0618f38a65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30b6b880cdc44ce99371a6cf70a24d01', 'request_id': 'req-a7383018-384f-4a6f-b474-7b0618f38a65'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:55.462228 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ebfd8-e41e-4a85-a7fd-32ffd48b9bfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:55.463029 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ebfd8-e41e-4a85-a7fd-32ffd48b9bfa service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:55.463359 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ebfd8-e41e-4a85-a7fd-32ffd48b9bfa service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:55.463676 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ebfd8-e41e-4a85-a7fd-32ffd48b9bfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:55.473976 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ebfd8-e41e-4a85-a7fd-32ffd48b9bfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:55.475625 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ebfd8-e41e-4a85-a7fd-32ffd48b9bfa service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:55.486348 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 949/1886] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:56.308355 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a7383018-384f-4a6f-b474-7b0618f38a65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30b6b880cdc44ce99371a6cf70a24d01', 'request_id': 'req-a7383018-384f-4a6f-b474-7b0618f38a65'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:56.323293 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a7383018-384f-4a6f-b474-7b0618f38a65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30b6b880cdc44ce99371a6cf70a24d01', 'request_id': 'req-a7383018-384f-4a6f-b474-7b0618f38a65'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:56.353613 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a7383018-384f-4a6f-b474-7b0618f38a65 admin admin] The token cache is being invalidate because project 30b6b880cdc44ce99371a6cf70a24d01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:48:56.354097 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a7383018-384f-4a6f-b474-7b0618f38a65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:56.357303 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a7383018-384f-4a6f-b474-7b0618f38a65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:56.359311 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 938/1887] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:48:55 2022] DELETE /identity/v3/projects/30b6b880cdc44ce99371a6cf70a24d01 => generated 0 bytes in 1227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:56.364156 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ebfd8-e41e-4a85-a7fd-32ffd48b9bfa service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:56.439423 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ebfd8-e41e-4a85-a7fd-32ffd48b9bfa service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:56.445413 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571a665-a650-4ed3-8385-29106c94b811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:56.446108 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571a665-a650-4ed3-8385-29106c94b811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:56.446368 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571a665-a650-4ed3-8385-29106c94b811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:56.446685 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571a665-a650-4ed3-8385-29106c94b811 admin admin] PATH_INFO: `/v3/users/1b6de43feeac4b54aadc8f511cab0d39` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:56.448003 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f571a665-a650-4ed3-8385-29106c94b811 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b6de43feeac4b54aadc8f511cab0d39)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:56.452067 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f571a665-a650-4ed3-8385-29106c94b811 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:56.717360 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f571a665-a650-4ed3-8385-29106c94b811 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b6de43feeac4b54aadc8f511cab0d39'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:56.719997 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f571a665-a650-4ed3-8385-29106c94b811 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b6de43feeac4b54aadc8f511cab0d39'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:56.728184 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f571a665-a650-4ed3-8385-29106c94b811 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b6de43feeac4b54aadc8f511cab0d39'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:56.750564 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f571a665-a650-4ed3-8385-29106c94b811 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b6de43feeac4b54aadc8f511cab0d39'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:56.751527 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f571a665-a650-4ed3-8385-29106c94b811 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b6de43feeac4b54aadc8f511cab0d39'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:56.899186 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 950/1888] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:48:56 2022] DELETE /identity/v3/users/1b6de43feeac4b54aadc8f511cab0d39 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:57.193804 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:57.418428 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7383018-384f-4a6f-b474-7b0618f38a65 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:57.420237 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a7383018-384f-4a6f-b474-7b0618f38a65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:57.434485 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7383018-384f-4a6f-b474-7b0618f38a65 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:57.471163 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571a665-a650-4ed3-8385-29106c94b811 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:57.473833 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f571a665-a650-4ed3-8385-29106c94b811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:57.517689 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09403f51-addd-4794-bf42-10aa4fa345d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:57.521867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09403f51-addd-4794-bf42-10aa4fa345d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:57.521867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09403f51-addd-4794-bf42-10aa4fa345d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:57.521867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09403f51-addd-4794-bf42-10aa4fa345d3 admin admin] PATH_INFO: `/v3/users/7446ea0675ce461b80c8755e56e808fb` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:57.522163 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09403f51-addd-4794-bf42-10aa4fa345d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7446ea0675ce461b80c8755e56e808fb)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:57.523980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09403f51-addd-4794-bf42-10aa4fa345d3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:57.554041 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571a665-a650-4ed3-8385-29106c94b811 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:57.559372 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1b16a-51c1-4acf-a4c4-59e8828ed42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:57.562312 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1b16a-51c1-4acf-a4c4-59e8828ed42f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:57.562312 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1b16a-51c1-4acf-a4c4-59e8828ed42f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:57.562312 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1b16a-51c1-4acf-a4c4-59e8828ed42f admin admin] PATH_INFO: `/v3/projects/4023c1075bf64a2e8ba7d910c1eb16be` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:57.562609 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1b16a-51c1-4acf-a4c4-59e8828ed42f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4023c1075bf64a2e8ba7d910c1eb16be)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:57.564447 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1b16a-51c1-4acf-a4c4-59e8828ed42f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:57.871884 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-09403f51-addd-4794-bf42-10aa4fa345d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7446ea0675ce461b80c8755e56e808fb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:57.873554 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-09403f51-addd-4794-bf42-10aa4fa345d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7446ea0675ce461b80c8755e56e808fb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:57.876916 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-94f1b16a-51c1-4acf-a4c4-59e8828ed42f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4023c1075bf64a2e8ba7d910c1eb16be', 'request_id': 'req-94f1b16a-51c1-4acf-a4c4-59e8828ed42f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:57.881879 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-09403f51-addd-4794-bf42-10aa4fa345d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7446ea0675ce461b80c8755e56e808fb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:57.894357 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-09403f51-addd-4794-bf42-10aa4fa345d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7446ea0675ce461b80c8755e56e808fb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:57.895111 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-09403f51-addd-4794-bf42-10aa4fa345d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7446ea0675ce461b80c8755e56e808fb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:58.026807 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-94f1b16a-51c1-4acf-a4c4-59e8828ed42f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4023c1075bf64a2e8ba7d910c1eb16be', 'request_id': 'req-94f1b16a-51c1-4acf-a4c4-59e8828ed42f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:58.034071 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-94f1b16a-51c1-4acf-a4c4-59e8828ed42f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4023c1075bf64a2e8ba7d910c1eb16be', 'request_id': 'req-94f1b16a-51c1-4acf-a4c4-59e8828ed42f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:58.046130 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-94f1b16a-51c1-4acf-a4c4-59e8828ed42f admin admin] The token cache is being invalidate because project 4023c1075bf64a2e8ba7d910c1eb16be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:48:58.046422 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-94f1b16a-51c1-4acf-a4c4-59e8828ed42f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:58.047064 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-94f1b16a-51c1-4acf-a4c4-59e8828ed42f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:58.048651 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 951/1889] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:48:57 2022] DELETE /identity/v3/projects/4023c1075bf64a2e8ba7d910c1eb16be => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:58.051920 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1b16a-51c1-4acf-a4c4-59e8828ed42f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:58.051920 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-94f1b16a-51c1-4acf-a4c4-59e8828ed42f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:58.113183 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1b16a-51c1-4acf-a4c4-59e8828ed42f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:58.117722 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de9738-cc98-4c3b-8150-2e14a09dba44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:58.118350 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de9738-cc98-4c3b-8150-2e14a09dba44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:58.118625 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de9738-cc98-4c3b-8150-2e14a09dba44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:58.118896 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de9738-cc98-4c3b-8150-2e14a09dba44 admin admin] PATH_INFO: `/v3/users/3a867eca442c4bb78f0a780b32db8b31` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:58.120001 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de9738-cc98-4c3b-8150-2e14a09dba44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a867eca442c4bb78f0a780b32db8b31)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:58.122038 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de9738-cc98-4c3b-8150-2e14a09dba44 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:58.223544 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 939/1890] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:48:57 2022] DELETE /identity/v3/users/7446ea0675ce461b80c8755e56e808fb => generated 0 bytes in 806 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:58.226526 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54574a62-d6a7-4cf7-aa92-3fa3f8769273 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:58.226526 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54574a62-d6a7-4cf7-aa92-3fa3f8769273 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:58.226526 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54574a62-d6a7-4cf7-aa92-3fa3f8769273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:58.247956 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-54574a62-d6a7-4cf7-aa92-3fa3f8769273 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:58.249175 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-54574a62-d6a7-4cf7-aa92-3fa3f8769273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:58.309559 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 940/1891] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:58.320368 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2f37b-3db1-4d63-a767-c29da54d5bd5 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:58.320368 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2f37b-3db1-4d63-a767-c29da54d5bd5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:58.320368 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2f37b-3db1-4d63-a767-c29da54d5bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:58.330318 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-84d2f37b-3db1-4d63-a767-c29da54d5bd5 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:58.331519 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-84d2f37b-3db1-4d63-a767-c29da54d5bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:58.339549 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 941/1892] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:58.340688 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4814ed-2726-4a6b-a3cb-247d352dbfe1 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:58.340974 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4814ed-2726-4a6b-a3cb-247d352dbfe1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:58.341248 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4814ed-2726-4a6b-a3cb-247d352dbfe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:58.360563 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-6d4814ed-2726-4a6b-a3cb-247d352dbfe1 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:58.362191 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6d4814ed-2726-4a6b-a3cb-247d352dbfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:58.369791 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 942/1893] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:58.370425 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4814ed-2726-4a6b-a3cb-247d352dbfe1 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:58.371616 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6d4814ed-2726-4a6b-a3cb-247d352dbfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:58.441507 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4814ed-2726-4a6b-a3cb-247d352dbfe1 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:58.446489 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe6905-b92d-41da-bcd9-aad5fe2f35af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:58.448208 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe6905-b92d-41da-bcd9-aad5fe2f35af service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:58.448208 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe6905-b92d-41da-bcd9-aad5fe2f35af service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:58.448208 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe6905-b92d-41da-bcd9-aad5fe2f35af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:58.457810 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe6905-b92d-41da-bcd9-aad5fe2f35af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:58.459965 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe6905-b92d-41da-bcd9-aad5fe2f35af service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:58.469701 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 943/1894] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:58.470483 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe6905-b92d-41da-bcd9-aad5fe2f35af service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:58.482895 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe6905-b92d-41da-bcd9-aad5fe2f35af service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:58.497940 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f3de9738-cc98-4c3b-8150-2e14a09dba44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a867eca442c4bb78f0a780b32db8b31'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:58.499786 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f3de9738-cc98-4c3b-8150-2e14a09dba44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a867eca442c4bb78f0a780b32db8b31'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:58.505926 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e39d94e-958c-43df-aac2-acfe3944999d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:58.506559 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39d94e-958c-43df-aac2-acfe3944999d admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:58.506838 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39d94e-958c-43df-aac2-acfe3944999d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:58.507113 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39d94e-958c-43df-aac2-acfe3944999d admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:58.507759 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e39d94e-958c-43df-aac2-acfe3944999d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:48:58.508245 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e39d94e-958c-43df-aac2-acfe3944999d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:58.509883 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e39d94e-958c-43df-aac2-acfe3944999d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:58.515265 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f3de9738-cc98-4c3b-8150-2e14a09dba44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a867eca442c4bb78f0a780b32db8b31'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:58.542816 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f3de9738-cc98-4c3b-8150-2e14a09dba44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a867eca442c4bb78f0a780b32db8b31'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:58.545380 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f3de9738-cc98-4c3b-8150-2e14a09dba44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a867eca442c4bb78f0a780b32db8b31'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:58.552725 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:58.554536 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 944/1895] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:48:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:48:58.555697 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e39d94e-958c-43df-aac2-acfe3944999d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:58.557852 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5e39d94e-958c-43df-aac2-acfe3944999d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:58.574202 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e39d94e-958c-43df-aac2-acfe3944999d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:58.580386 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb64011-6b84-43f3-888b-f7e528e55269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:58.581296 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb64011-6b84-43f3-888b-f7e528e55269 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:58.581937 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb64011-6b84-43f3-888b-f7e528e55269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:58.582217 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb64011-6b84-43f3-888b-f7e528e55269 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:58.582859 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb64011-6b84-43f3-888b-f7e528e55269 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:58.585069 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb64011-6b84-43f3-888b-f7e528e55269 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:58.685951 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 952/1896] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:48:58 2022] DELETE /identity/v3/users/3a867eca442c4bb78f0a780b32db8b31 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:58.691371 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233863b-5852-4b2a-ab71-61c5d3cf714f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:58.692057 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233863b-5852-4b2a-ab71-61c5d3cf714f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:58.692621 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233863b-5852-4b2a-ab71-61c5d3cf714f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:58.698178 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 945/1897] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:48:58 2022] POST /identity/v3/projects => generated 367 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:58.699422 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb64011-6b84-43f3-888b-f7e528e55269 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:58.730770 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6233863b-5852-4b2a-ab71-61c5d3cf714f None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:58.733218 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6233863b-5852-4b2a-ab71-61c5d3cf714f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:58.813022 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb64011-6b84-43f3-888b-f7e528e55269 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:58.820645 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9a451-e57c-4fd9-b8bc-c28ca7c15dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:58.822329 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9a451-e57c-4fd9-b8bc-c28ca7c15dd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:58.822329 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9a451-e57c-4fd9-b8bc-c28ca7c15dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:58.822329 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9a451-e57c-4fd9-b8bc-c28ca7c15dd6 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:58.822738 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d9a451-e57c-4fd9-b8bc-c28ca7c15dd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:58.825130 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 953/1898] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:48:58.836351 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d9a451-e57c-4fd9-b8bc-c28ca7c15dd6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:58.838190 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233863b-5852-4b2a-ab71-61c5d3cf714f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:58.840889 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6233863b-5852-4b2a-ab71-61c5d3cf714f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:58.930985 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233863b-5852-4b2a-ab71-61c5d3cf714f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:58.935038 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5013fbc-10cc-45c1-9275-9372e97827b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:58.935620 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5013fbc-10cc-45c1-9275-9372e97827b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:58.935620 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5013fbc-10cc-45c1-9275-9372e97827b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:58.935887 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5013fbc-10cc-45c1-9275-9372e97827b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:58.948384 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5013fbc-10cc-45c1-9275-9372e97827b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:58.953157 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5013fbc-10cc-45c1-9275-9372e97827b2 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:58.960962 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 954/1899] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:48:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:48:59.022549 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 946/1900] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:48:58 2022] POST /identity/v3/users => generated 284 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:59.026795 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5013fbc-10cc-45c1-9275-9372e97827b2 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:59.039046 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5013fbc-10cc-45c1-9275-9372e97827b2 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:59.046015 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12d8c6-34f4-4d02-93dc-bebff0de0c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:59.046631 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12d8c6-34f4-4d02-93dc-bebff0de0c38 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:59.046912 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12d8c6-34f4-4d02-93dc-bebff0de0c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:59.047185 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12d8c6-34f4-4d02-93dc-bebff0de0c38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:59.047826 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12d8c6-34f4-4d02-93dc-bebff0de0c38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:59.049656 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12d8c6-34f4-4d02-93dc-bebff0de0c38 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:59.062679 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 955/1901] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:59.066905 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9a451-e57c-4fd9-b8bc-c28ca7c15dd6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:59.078339 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9a451-e57c-4fd9-b8bc-c28ca7c15dd6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:59.084109 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9295a1-1d2e-4aa6-9a25-58a31c9af51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:59.085110 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9295a1-1d2e-4aa6-9a25-58a31c9af51e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:59.085399 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9295a1-1d2e-4aa6-9a25-58a31c9af51e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:59.085699 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9295a1-1d2e-4aa6-9a25-58a31c9af51e admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:59.086351 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9295a1-1d2e-4aa6-9a25-58a31c9af51e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:59.087951 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9295a1-1d2e-4aa6-9a25-58a31c9af51e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:59.099180 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 947/1902] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:48:59.110840 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12d8c6-34f4-4d02-93dc-bebff0de0c38 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:59.113703 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9295a1-1d2e-4aa6-9a25-58a31c9af51e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:59.117824 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8d9295a1-1d2e-4aa6-9a25-58a31c9af51e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:59.123591 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12d8c6-34f4-4d02-93dc-bebff0de0c38 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:59.131204 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfa096-dd3f-48a4-87f8-9967b485bf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:59.142534 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfa096-dd3f-48a4-87f8-9967b485bf19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:59.142534 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfa096-dd3f-48a4-87f8-9967b485bf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:59.142534 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfa096-dd3f-48a4-87f8-9967b485bf19 admin admin] PATH_INFO: `/v3/projects/000a47e15bce4267ac9b706fd1ce4750/users/dd1bd40258084900afad37a6b0403a6e/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:59.148165 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9295a1-1d2e-4aa6-9a25-58a31c9af51e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:59.158086 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d5f1b-6887-4e25-8016-8aa79ce9c591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:59.158952 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d5f1b-6887-4e25-8016-8aa79ce9c591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:59.159289 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d5f1b-6887-4e25-8016-8aa79ce9c591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:59.159743 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d5f1b-6887-4e25-8016-8aa79ce9c591 admin admin] PATH_INFO: `/v3/projects/e7aa154d73ce4aeba1cb778a5555ec49` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:59.161103 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d5f1b-6887-4e25-8016-8aa79ce9c591 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7aa154d73ce4aeba1cb778a5555ec49)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:59.163320 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d5f1b-6887-4e25-8016-8aa79ce9c591 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:59.164651 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dfa096-dd3f-48a4-87f8-9967b485bf19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=000a47e15bce4267ac9b706fd1ce4750, user_id=dd1bd40258084900afad37a6b0403a6e, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:59.173678 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dfa096-dd3f-48a4-87f8-9967b485bf19 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:59.265373 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 956/1903] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:48:59 2022] PUT /identity/v3/projects/000a47e15bce4267ac9b706fd1ce4750/users/dd1bd40258084900afad37a6b0403a6e/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:59.276725 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898bc80-3774-47c9-8214-4d486b350397 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:59.277070 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898bc80-3774-47c9-8214-4d486b350397 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:59.277692 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898bc80-3774-47c9-8214-4d486b350397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:59.300413 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-736d5f1b-6887-4e25-8016-8aa79ce9c591 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7aa154d73ce4aeba1cb778a5555ec49', 'request_id': 'req-736d5f1b-6887-4e25-8016-8aa79ce9c591'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:59.341678 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a898bc80-3774-47c9-8214-4d486b350397 None None] MFA Rules not processed for user `dd1bd40258084900afad37a6b0403a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:48:59.342533 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a898bc80-3774-47c9-8214-4d486b350397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:59.426511 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-736d5f1b-6887-4e25-8016-8aa79ce9c591 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7aa154d73ce4aeba1cb778a5555ec49', 'request_id': 'req-736d5f1b-6887-4e25-8016-8aa79ce9c591'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:59.434901 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-736d5f1b-6887-4e25-8016-8aa79ce9c591 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7aa154d73ce4aeba1cb778a5555ec49', 'request_id': 'req-736d5f1b-6887-4e25-8016-8aa79ce9c591'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:59.437094 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 957/1904] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:48:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:48:59.442301 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898bc80-3774-47c9-8214-4d486b350397 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:59.450189 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-736d5f1b-6887-4e25-8016-8aa79ce9c591 admin admin] The token cache is being invalidate because project e7aa154d73ce4aeba1cb778a5555ec49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:48:59.451135 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-736d5f1b-6887-4e25-8016-8aa79ce9c591 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:59.452686 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-736d5f1b-6887-4e25-8016-8aa79ce9c591 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:48:59.459586 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 948/1905] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:48:59 2022] DELETE /identity/v3/projects/e7aa154d73ce4aeba1cb778a5555ec49 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:48:59.460844 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d5f1b-6887-4e25-8016-8aa79ce9c591 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:59.462528 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-736d5f1b-6887-4e25-8016-8aa79ce9c591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:59.557323 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898bc80-3774-47c9-8214-4d486b350397 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:59.583880 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef013b-c506-4b3c-ba81-03cf7f5744c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:59.585008 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef013b-c506-4b3c-ba81-03cf7f5744c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:59.585296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef013b-c506-4b3c-ba81-03cf7f5744c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:59.585572 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef013b-c506-4b3c-ba81-03cf7f5744c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:59.586995 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef013b-c506-4b3c-ba81-03cf7f5744c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:59.589478 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef013b-c506-4b3c-ba81-03cf7f5744c9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:59.598633 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:48:59.610752 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d5f1b-6887-4e25-8016-8aa79ce9c591 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:59.616433 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4062a-50cb-4284-ab83-c542b3b4a805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:59.617077 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4062a-50cb-4284-ab83-c542b3b4a805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:59.617462 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4062a-50cb-4284-ab83-c542b3b4a805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:59.617746 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4062a-50cb-4284-ab83-c542b3b4a805 admin admin] PATH_INFO: `/v3/users/e0d121900659407e983beff854372e1c` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:59.618872 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af4062a-50cb-4284-ab83-c542b3b4a805 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0d121900659407e983beff854372e1c)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:59.620852 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af4062a-50cb-4284-ab83-c542b3b4a805 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:48:59.695202 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 958/1906] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:48:59 2022] POST /identity/v3/projects => generated 367 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:48:59.696507 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef013b-c506-4b3c-ba81-03cf7f5744c9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:48:59.701948 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1eef013b-c506-4b3c-ba81-03cf7f5744c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:48:59.779714 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef013b-c506-4b3c-ba81-03cf7f5744c9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:48:59.784486 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492dbbc-bd55-4c58-a0cd-8167d2ea1eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:48:59.785127 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492dbbc-bd55-4c58-a0cd-8167d2ea1eaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:48:59.785434 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492dbbc-bd55-4c58-a0cd-8167d2ea1eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:48:59.785741 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492dbbc-bd55-4c58-a0cd-8167d2ea1eaa admin admin] PATH_INFO: `/v3/projects/a147edb486e043d89e7f098926b73f6d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:48:59.787471 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492dbbc-bd55-4c58-a0cd-8167d2ea1eaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=a147edb486e043d89e7f098926b73f6d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:48:59.789380 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492dbbc-bd55-4c58-a0cd-8167d2ea1eaa admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:00.000542 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c492dbbc-bd55-4c58-a0cd-8167d2ea1eaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a147edb486e043d89e7f098926b73f6d', 'request_id': 'req-c492dbbc-bd55-4c58-a0cd-8167d2ea1eaa'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:00.017744 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2af4062a-50cb-4284-ab83-c542b3b4a805 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0d121900659407e983beff854372e1c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:00.018582 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2af4062a-50cb-4284-ab83-c542b3b4a805 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0d121900659407e983beff854372e1c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:00.029485 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2af4062a-50cb-4284-ab83-c542b3b4a805 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0d121900659407e983beff854372e1c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:00.042760 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2af4062a-50cb-4284-ab83-c542b3b4a805 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0d121900659407e983beff854372e1c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:00.043644 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2af4062a-50cb-4284-ab83-c542b3b4a805 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0d121900659407e983beff854372e1c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:00.159692 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c492dbbc-bd55-4c58-a0cd-8167d2ea1eaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a147edb486e043d89e7f098926b73f6d', 'request_id': 'req-c492dbbc-bd55-4c58-a0cd-8167d2ea1eaa'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:00.170235 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c492dbbc-bd55-4c58-a0cd-8167d2ea1eaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a147edb486e043d89e7f098926b73f6d', 'request_id': 'req-c492dbbc-bd55-4c58-a0cd-8167d2ea1eaa'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:00.183194 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c492dbbc-bd55-4c58-a0cd-8167d2ea1eaa admin admin] The token cache is being invalidate because project a147edb486e043d89e7f098926b73f6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:49:00.183508 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c492dbbc-bd55-4c58-a0cd-8167d2ea1eaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:00.190259 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c492dbbc-bd55-4c58-a0cd-8167d2ea1eaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:00.191896 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 959/1907] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:48:59 2022] DELETE /identity/v3/projects/a147edb486e043d89e7f098926b73f6d => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:00.195011 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492dbbc-bd55-4c58-a0cd-8167d2ea1eaa admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:00.197278 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c492dbbc-bd55-4c58-a0cd-8167d2ea1eaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:00.262469 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492dbbc-bd55-4c58-a0cd-8167d2ea1eaa admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:00.267108 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d92db5-04b9-4e79-a3ff-e510ff30a2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:00.267717 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d92db5-04b9-4e79-a3ff-e510ff30a2e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:00.268025 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d92db5-04b9-4e79-a3ff-e510ff30a2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:00.268298 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d92db5-04b9-4e79-a3ff-e510ff30a2e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:00.268926 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d92db5-04b9-4e79-a3ff-e510ff30a2e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:00.271495 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d92db5-04b9-4e79-a3ff-e510ff30a2e6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:00.353818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 949/1908] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:48:59 2022] DELETE /identity/v3/users/e0d121900659407e983beff854372e1c => generated 0 bytes in 894 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:00.354672 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4062a-50cb-4284-ab83-c542b3b4a805 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:00.356851 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2af4062a-50cb-4284-ab83-c542b3b4a805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:00.383755 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 960/1909] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:49:00 2022] POST /identity/v3/users => generated 290 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:49:00.387566 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d92db5-04b9-4e79-a3ff-e510ff30a2e6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:00.399014 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d92db5-04b9-4e79-a3ff-e510ff30a2e6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:00.426307 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4062a-50cb-4284-ab83-c542b3b4a805 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:00.431688 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ad354-a878-4709-8f4b-df9dafa92847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:00.432324 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ad354-a878-4709-8f4b-df9dafa92847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:00.432611 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ad354-a878-4709-8f4b-df9dafa92847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:00.432880 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ad354-a878-4709-8f4b-df9dafa92847 admin admin] PATH_INFO: `/v3/users/f8ff35d985534eea950fe9e636c1ab61` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:00.434106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ad354-a878-4709-8f4b-df9dafa92847 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8ff35d985534eea950fe9e636c1ab61)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:00.436033 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ad354-a878-4709-8f4b-df9dafa92847 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:00.461680 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8c53c-2259-44ae-934c-3b1b99f71907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:00.462333 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8c53c-2259-44ae-934c-3b1b99f71907 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:00.462621 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8c53c-2259-44ae-934c-3b1b99f71907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:00.462993 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8c53c-2259-44ae-934c-3b1b99f71907 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:00.463701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee8c53c-2259-44ae-934c-3b1b99f71907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:00.465421 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee8c53c-2259-44ae-934c-3b1b99f71907 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:00.475861 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 961/1910] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:49:00.480120 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8c53c-2259-44ae-934c-3b1b99f71907 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:00.490157 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8c53c-2259-44ae-934c-3b1b99f71907 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:00.494747 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e796f-0d84-41fc-8963-824dc103394d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:00.495387 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e796f-0d84-41fc-8963-824dc103394d admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:00.495665 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e796f-0d84-41fc-8963-824dc103394d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:00.495937 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e796f-0d84-41fc-8963-824dc103394d admin admin] PATH_INFO: `/v3/projects/0437e2ae521f4fb99fa3c849f08f00dd/users/98a75f0a81104f0ca670e1ad8ef1b37c/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:00.512082 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e796f-0d84-41fc-8963-824dc103394d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0437e2ae521f4fb99fa3c849f08f00dd, user_id=98a75f0a81104f0ca670e1ad8ef1b37c, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:00.514740 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e796f-0d84-41fc-8963-824dc103394d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:00.620680 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 962/1911] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:49:00 2022] PUT /identity/v3/projects/0437e2ae521f4fb99fa3c849f08f00dd/users/98a75f0a81104f0ca670e1ad8ef1b37c/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:49:00.622687 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e796f-0d84-41fc-8963-824dc103394d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:00.694926 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-aa5ad354-a878-4709-8f4b-df9dafa92847 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8ff35d985534eea950fe9e636c1ab61'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:00.699129 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-aa5ad354-a878-4709-8f4b-df9dafa92847 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8ff35d985534eea950fe9e636c1ab61'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:00.711478 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-aa5ad354-a878-4709-8f4b-df9dafa92847 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8ff35d985534eea950fe9e636c1ab61'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:00.713880 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e796f-0d84-41fc-8963-824dc103394d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:00.719648 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a504b5-f794-4a53-b2af-e820ffc374f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:00.720267 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a504b5-f794-4a53-b2af-e820ffc374f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:00.720545 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a504b5-f794-4a53-b2af-e820ffc374f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:00.720851 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a504b5-f794-4a53-b2af-e820ffc374f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:00.721679 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a504b5-f794-4a53-b2af-e820ffc374f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:00.723471 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a504b5-f794-4a53-b2af-e820ffc374f1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:00.725388 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-aa5ad354-a878-4709-8f4b-df9dafa92847 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8ff35d985534eea950fe9e636c1ab61'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:00.726380 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-aa5ad354-a878-4709-8f4b-df9dafa92847 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8ff35d985534eea950fe9e636c1ab61'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:00.734929 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 963/1912] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:49:00.739048 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a504b5-f794-4a53-b2af-e820ffc374f1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:00.741472 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-78a504b5-f794-4a53-b2af-e820ffc374f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:00.754446 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a504b5-f794-4a53-b2af-e820ffc374f1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:00.760304 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e1a9d-be57-44e4-bf72-3a37d7a31bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:00.760955 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e1a9d-be57-44e4-bf72-3a37d7a31bc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:00.761235 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e1a9d-be57-44e4-bf72-3a37d7a31bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:00.761511 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e1a9d-be57-44e4-bf72-3a37d7a31bc3 admin admin] PATH_INFO: `/v3/projects/0437e2ae521f4fb99fa3c849f08f00dd/users/98a75f0a81104f0ca670e1ad8ef1b37c/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:00.765768 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e1a9d-be57-44e4-bf72-3a37d7a31bc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0437e2ae521f4fb99fa3c849f08f00dd, user_id=98a75f0a81104f0ca670e1ad8ef1b37c, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:00.778871 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e1a9d-be57-44e4-bf72-3a37d7a31bc3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:00.790963 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 964/1913] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:49:00 2022] PUT /identity/v3/projects/0437e2ae521f4fb99fa3c849f08f00dd/users/98a75f0a81104f0ca670e1ad8ef1b37c/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:00.804189 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd706597-8c68-4607-83bf-a7320169ed09 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:00.805317 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd706597-8c68-4607-83bf-a7320169ed09 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:00.806877 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd706597-8c68-4607-83bf-a7320169ed09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:00.836069 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-cd706597-8c68-4607-83bf-a7320169ed09 None None] MFA Rules not processed for user `98a75f0a81104f0ca670e1ad8ef1b37c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:00.837320 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cd706597-8c68-4607-83bf-a7320169ed09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:00.846399 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:00.853370 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 950/1914] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:49:00 2022] DELETE /identity/v3/users/f8ff35d985534eea950fe9e636c1ab61 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:00.915976 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 965/1915] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:00 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:49:00.924710 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ad354-a878-4709-8f4b-df9dafa92847 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:00.926196 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd706597-8c68-4607-83bf-a7320169ed09 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:00.926317 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-aa5ad354-a878-4709-8f4b-df9dafa92847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:00.929352 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cd706597-8c68-4607-83bf-a7320169ed09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:01.008699 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd706597-8c68-4607-83bf-a7320169ed09 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:01.022336 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ad354-a878-4709-8f4b-df9dafa92847 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:01.028683 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a5e34-d6ea-4d5b-87d5-3597ca1bfd15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:01.029553 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a5e34-d6ea-4d5b-87d5-3597ca1bfd15 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:01.030015 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a5e34-d6ea-4d5b-87d5-3597ca1bfd15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:01.042608 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a5e34-d6ea-4d5b-87d5-3597ca1bfd15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:01.108166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd023dab-f910-4365-ac44-fa586c7b12af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:01.109516 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd023dab-f910-4365-ac44-fa586c7b12af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:01.109860 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd023dab-f910-4365-ac44-fa586c7b12af admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:01.113828 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd023dab-f910-4365-ac44-fa586c7b12af admin admin] PATH_INFO: `/v3/projects/4bc56fd4e70a402385efecc38bd14658` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:01.116552 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd023dab-f910-4365-ac44-fa586c7b12af admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bc56fd4e70a402385efecc38bd14658)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:01.119041 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd023dab-f910-4365-ac44-fa586c7b12af admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:01.143966 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a5e34-d6ea-4d5b-87d5-3597ca1bfd15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:01.145398 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a5e34-d6ea-4d5b-87d5-3597ca1bfd15 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:01.165890 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 951/1916] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:49:00 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:49:01.368318 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fd023dab-f910-4365-ac44-fa586c7b12af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bc56fd4e70a402385efecc38bd14658', 'request_id': 'req-fd023dab-f910-4365-ac44-fa586c7b12af'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:01.397561 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a5e34-d6ea-4d5b-87d5-3597ca1bfd15 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:01.399300 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c04a5e34-d6ea-4d5b-87d5-3597ca1bfd15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:01.413875 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a5e34-d6ea-4d5b-87d5-3597ca1bfd15 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:01.472448 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fd023dab-f910-4365-ac44-fa586c7b12af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bc56fd4e70a402385efecc38bd14658', 'request_id': 'req-fd023dab-f910-4365-ac44-fa586c7b12af'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:01.474866 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bde6f4-5b51-41b0-80a4-b527440883b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:01.477177 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bde6f4-5b51-41b0-80a4-b527440883b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:01.477177 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bde6f4-5b51-41b0-80a4-b527440883b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:01.477177 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bde6f4-5b51-41b0-80a4-b527440883b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:01.478353 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a1bde6f4-5b51-41b0-80a4-b527440883b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:01.480666 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fd023dab-f910-4365-ac44-fa586c7b12af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bc56fd4e70a402385efecc38bd14658', 'request_id': 'req-fd023dab-f910-4365-ac44-fa586c7b12af'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:01.501250 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fd023dab-f910-4365-ac44-fa586c7b12af admin admin] The token cache is being invalidate because project 4bc56fd4e70a402385efecc38bd14658 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:49:01.501250 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fd023dab-f910-4365-ac44-fa586c7b12af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:01.501796 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fd023dab-f910-4365-ac44-fa586c7b12af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:01.503710 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 966/1917] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:49:00 2022] DELETE /identity/v3/projects/4bc56fd4e70a402385efecc38bd14658 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:01.508867 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94ad92-9ae3-4251-8481-01508c3196f4 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:01.509156 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94ad92-9ae3-4251-8481-01508c3196f4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:01.511580 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94ad92-9ae3-4251-8481-01508c3196f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:01.531484 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2d94ad92-9ae3-4251-8481-01508c3196f4 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:01.534342 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2d94ad92-9ae3-4251-8481-01508c3196f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:01.546828 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bde6f4-5b51-41b0-80a4-b527440883b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:01.548277 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bde6f4-5b51-41b0-80a4-b527440883b8 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:01.557938 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 952/1918] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:49:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 03:49:01.588749 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bde6f4-5b51-41b0-80a4-b527440883b8 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:01.591703 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a1bde6f4-5b51-41b0-80a4-b527440883b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:01.646696 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 967/1919] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:49:01.653462 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79bc3f9-d1df-43e9-9cc5-c44a2ae13cd2 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:01.653780 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79bc3f9-d1df-43e9-9cc5-c44a2ae13cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:01.654057 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79bc3f9-d1df-43e9-9cc5-c44a2ae13cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:01.690991 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b79bc3f9-d1df-43e9-9cc5-c44a2ae13cd2 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:01.692196 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b79bc3f9-d1df-43e9-9cc5-c44a2ae13cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:01.692304 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bde6f4-5b51-41b0-80a4-b527440883b8 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:01.703388 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 968/1920] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:49:01.707336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79bc3f9-d1df-43e9-9cc5-c44a2ae13cd2 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:01.710784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc7e97-a281-46c7-873b-a74860d6104f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:01.711621 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc7e97-a281-46c7-873b-a74860d6104f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:01.711911 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc7e97-a281-46c7-873b-a74860d6104f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:01.712317 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc7e97-a281-46c7-873b-a74860d6104f admin admin] PATH_INFO: `/v3/projects/56b95ddf8cc542bd9898d81ca9ff9f0b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:01.713919 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc7e97-a281-46c7-873b-a74860d6104f admin admin] RBAC: Authorizing `identity:delete_project(project_id=56b95ddf8cc542bd9898d81ca9ff9f0b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:01.716420 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc7e97-a281-46c7-873b-a74860d6104f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:01.723099 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79bc3f9-d1df-43e9-9cc5-c44a2ae13cd2 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:01.729596 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec61649-a9f2-4219-98b3-5e6970dc1aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:01.730245 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec61649-a9f2-4219-98b3-5e6970dc1aab admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:01.730533 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec61649-a9f2-4219-98b3-5e6970dc1aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:01.730909 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec61649-a9f2-4219-98b3-5e6970dc1aab admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:01.731559 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec61649-a9f2-4219-98b3-5e6970dc1aab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:49:01.731867 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec61649-a9f2-4219-98b3-5e6970dc1aab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:01.733712 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec61649-a9f2-4219-98b3-5e6970dc1aab admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:01.753184 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 969/1921] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:49:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:49:01.757283 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec61649-a9f2-4219-98b3-5e6970dc1aab admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:01.767345 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec61649-a9f2-4219-98b3-5e6970dc1aab admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:01.772967 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f25cb-afbd-4d1f-ba8d-e00791f1a6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:01.773891 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f25cb-afbd-4d1f-ba8d-e00791f1a6b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:01.774067 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f25cb-afbd-4d1f-ba8d-e00791f1a6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:01.774402 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f25cb-afbd-4d1f-ba8d-e00791f1a6b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:01.775040 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f25cb-afbd-4d1f-ba8d-e00791f1a6b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:01.776986 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f25cb-afbd-4d1f-ba8d-e00791f1a6b9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:01.877812 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6ecc7e97-a281-46c7-873b-a74860d6104f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56b95ddf8cc542bd9898d81ca9ff9f0b', 'request_id': 'req-6ecc7e97-a281-46c7-873b-a74860d6104f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:01.907627 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 970/1922] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:49:01 2022] POST /identity/v3/projects => generated 389 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:49:01.908783 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f25cb-afbd-4d1f-ba8d-e00791f1a6b9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:01.963997 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6ecc7e97-a281-46c7-873b-a74860d6104f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56b95ddf8cc542bd9898d81ca9ff9f0b', 'request_id': 'req-6ecc7e97-a281-46c7-873b-a74860d6104f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:01.972099 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6ecc7e97-a281-46c7-873b-a74860d6104f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56b95ddf8cc542bd9898d81ca9ff9f0b', 'request_id': 'req-6ecc7e97-a281-46c7-873b-a74860d6104f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:01.974918 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f25cb-afbd-4d1f-ba8d-e00791f1a6b9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:01.983858 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68848b6-0f5e-4cbc-861e-9996a0d3b8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:01.984728 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68848b6-0f5e-4cbc-861e-9996a0d3b8ac admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:01.985555 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68848b6-0f5e-4cbc-861e-9996a0d3b8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:01.985988 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68848b6-0f5e-4cbc-861e-9996a0d3b8ac admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:01.987327 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68848b6-0f5e-4cbc-861e-9996a0d3b8ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:01.988329 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6ecc7e97-a281-46c7-873b-a74860d6104f admin admin] The token cache is being invalidate because project 56b95ddf8cc542bd9898d81ca9ff9f0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:49:01.988635 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6ecc7e97-a281-46c7-873b-a74860d6104f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:01.989295 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6ecc7e97-a281-46c7-873b-a74860d6104f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:01.989722 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68848b6-0f5e-4cbc-861e-9996a0d3b8ac admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:01.991197 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 953/1923] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:49:01 2022] DELETE /identity/v3/projects/56b95ddf8cc542bd9898d81ca9ff9f0b => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:01.995807 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c07447-7838-459a-aa62-81ff76fdf384 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:01.996099 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c07447-7838-459a-aa62-81ff76fdf384 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:01.996405 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c07447-7838-459a-aa62-81ff76fdf384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:02.026745 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-63c07447-7838-459a-aa62-81ff76fdf384 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:02.033793 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-63c07447-7838-459a-aa62-81ff76fdf384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:02.044162 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 954/1924] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:49:02.052119 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cbba2-3e92-4d0d-8895-f86722549618 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:02.052476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cbba2-3e92-4d0d-8895-f86722549618 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:02.056798 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cbba2-3e92-4d0d-8895-f86722549618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:02.073481 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e43cbba2-3e92-4d0d-8895-f86722549618 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:02.074859 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e43cbba2-3e92-4d0d-8895-f86722549618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:02.083188 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 955/1925] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:49:02.087258 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43cbba2-3e92-4d0d-8895-f86722549618 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:02.103147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43cbba2-3e92-4d0d-8895-f86722549618 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:02.103147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865474d-3056-467a-8540-aeabb5cc72a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:02.103425 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865474d-3056-467a-8540-aeabb5cc72a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:02.103557 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865474d-3056-467a-8540-aeabb5cc72a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:02.103803 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865474d-3056-467a-8540-aeabb5cc72a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:02.104456 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1865474d-3056-467a-8540-aeabb5cc72a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:49:02.104758 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1865474d-3056-467a-8540-aeabb5cc72a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:02.106505 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1865474d-3056-467a-8540-aeabb5cc72a8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:02.119334 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 956/1926] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:49:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:49:02.123515 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865474d-3056-467a-8540-aeabb5cc72a8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:02.138585 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 971/1927] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:49:01 2022] POST /identity/v3/users => generated 295 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:49:02.140103 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68848b6-0f5e-4cbc-861e-9996a0d3b8ac admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:02.141382 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865474d-3056-467a-8540-aeabb5cc72a8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:02.142381 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c68848b6-0f5e-4cbc-861e-9996a0d3b8ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:02.147335 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8be219-e393-49df-b482-c8208dcab7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:02.147982 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8be219-e393-49df-b482-c8208dcab7ab admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:02.148262 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8be219-e393-49df-b482-c8208dcab7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:02.148532 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8be219-e393-49df-b482-c8208dcab7ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:02.149709 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8be219-e393-49df-b482-c8208dcab7ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:02.151785 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8be219-e393-49df-b482-c8208dcab7ab admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:02.156425 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68848b6-0f5e-4cbc-861e-9996a0d3b8ac admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:02.162250 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3887b-4767-43df-8479-7ec2538da4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:02.162727 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3887b-4767-43df-8479-7ec2538da4ea admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:02.163192 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3887b-4767-43df-8479-7ec2538da4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:02.163472 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3887b-4767-43df-8479-7ec2538da4ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:02.164120 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3887b-4767-43df-8479-7ec2538da4ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:02.165743 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3887b-4767-43df-8479-7ec2538da4ea admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:02.178441 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 972/1928] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:49:02.182118 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3887b-4767-43df-8479-7ec2538da4ea admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:02.192354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3887b-4767-43df-8479-7ec2538da4ea admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:02.197493 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc108a-3991-450d-bfaa-824de5f338f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:02.198152 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc108a-3991-450d-bfaa-824de5f338f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:02.198428 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc108a-3991-450d-bfaa-824de5f338f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:02.198698 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc108a-3991-450d-bfaa-824de5f338f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:02.199345 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc108a-3991-450d-bfaa-824de5f338f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:02.200912 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc108a-3991-450d-bfaa-824de5f338f8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:02.216384 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 973/1929] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:49:02.216960 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc108a-3991-450d-bfaa-824de5f338f8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:02.233547 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc108a-3991-450d-bfaa-824de5f338f8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:02.240986 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f08a44-50f3-4fd2-aa40-722bf81c82ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:02.240986 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f08a44-50f3-4fd2-aa40-722bf81c82ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:02.240986 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f08a44-50f3-4fd2-aa40-722bf81c82ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:02.240986 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f08a44-50f3-4fd2-aa40-722bf81c82ad admin admin] PATH_INFO: `/v3/projects/0e97cdbea8ea4c70be39e74bbde6ebbf/users/1b2b7a3265eb418ca905c9526d0ea492/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:02.260548 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f08a44-50f3-4fd2-aa40-722bf81c82ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e97cdbea8ea4c70be39e74bbde6ebbf, user_id=1b2b7a3265eb418ca905c9526d0ea492, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:02.263876 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f08a44-50f3-4fd2-aa40-722bf81c82ad admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:02.297849 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 957/1930] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:49:02 2022] POST /identity/v3/projects => generated 409 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:49:02.301362 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8be219-e393-49df-b482-c8208dcab7ab admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:02.364245 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8be219-e393-49df-b482-c8208dcab7ab admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:02.369747 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b4f70-bdbb-4efe-9335-9650b6d2004e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:02.370370 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b4f70-bdbb-4efe-9335-9650b6d2004e admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:02.370658 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b4f70-bdbb-4efe-9335-9650b6d2004e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:02.371025 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b4f70-bdbb-4efe-9335-9650b6d2004e admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:02.371692 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b4f70-bdbb-4efe-9335-9650b6d2004e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:02.373966 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b4f70-bdbb-4efe-9335-9650b6d2004e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:02.399375 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 974/1931] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:49:02 2022] PUT /identity/v3/projects/0e97cdbea8ea4c70be39e74bbde6ebbf/users/1b2b7a3265eb418ca905c9526d0ea492/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:49:02.410898 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6071b1-29e8-4049-b9eb-e6915d84599d None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:02.411183 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6071b1-29e8-4049-b9eb-e6915d84599d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:02.411534 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6071b1-29e8-4049-b9eb-e6915d84599d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:02.445317 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8d6071b1-29e8-4049-b9eb-e6915d84599d None None] MFA Rules not processed for user `1b2b7a3265eb418ca905c9526d0ea492`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:02.447009 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8d6071b1-29e8-4049-b9eb-e6915d84599d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:02.481617 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 958/1932] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:49:02 2022] POST /identity/v3/users => generated 305 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:49:02.482787 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b4f70-bdbb-4efe-9335-9650b6d2004e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:02.493786 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b4f70-bdbb-4efe-9335-9650b6d2004e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:02.540019 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 975/1933] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:02 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:02.545179 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6071b1-29e8-4049-b9eb-e6915d84599d None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:02.624896 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94579f62-99f8-4f24-9a66-472a253db68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:02.626095 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94579f62-99f8-4f24-9a66-472a253db68d admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:02.628236 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94579f62-99f8-4f24-9a66-472a253db68d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:02.628875 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94579f62-99f8-4f24-9a66-472a253db68d admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:02.630851 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94579f62-99f8-4f24-9a66-472a253db68d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:02.635246 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94579f62-99f8-4f24-9a66-472a253db68d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:02.657327 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 959/1934] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:49:02.658568 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94579f62-99f8-4f24-9a66-472a253db68d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:02.664815 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6071b1-29e8-4049-b9eb-e6915d84599d None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:02.677785 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b9f2a-ed98-4545-a753-337c134f23d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:02.677785 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b9f2a-ed98-4545-a753-337c134f23d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:02.677785 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b9f2a-ed98-4545-a753-337c134f23d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:02.677785 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b9f2a-ed98-4545-a753-337c134f23d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:02.678221 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b9f2a-ed98-4545-a753-337c134f23d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:02.678221 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b9f2a-ed98-4545-a753-337c134f23d5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:02.685843 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94579f62-99f8-4f24-9a66-472a253db68d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:02.691614 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68b7ac-dd26-4614-bb17-5dbf102ed9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:02.692431 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68b7ac-dd26-4614-bb17-5dbf102ed9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:02.693440 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68b7ac-dd26-4614-bb17-5dbf102ed9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:02.693958 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68b7ac-dd26-4614-bb17-5dbf102ed9c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:02.694765 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd68b7ac-dd26-4614-bb17-5dbf102ed9c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:02.701534 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd68b7ac-dd26-4614-bb17-5dbf102ed9c0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:02.732525 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 960/1935] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:49:02.733666 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68b7ac-dd26-4614-bb17-5dbf102ed9c0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:02.745966 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68b7ac-dd26-4614-bb17-5dbf102ed9c0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:02.751515 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f74e5d8-217e-411b-8a9d-9d5def384791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:02.752572 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74e5d8-217e-411b-8a9d-9d5def384791 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:02.753141 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74e5d8-217e-411b-8a9d-9d5def384791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:02.753816 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74e5d8-217e-411b-8a9d-9d5def384791 admin admin] PATH_INFO: `/v3/projects/081e31122b9d4a2997718e18835c33f4/users/048e88e81d6f4f318a0a29c8109f8374/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:02.787897 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f74e5d8-217e-411b-8a9d-9d5def384791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=081e31122b9d4a2997718e18835c33f4, user_id=048e88e81d6f4f318a0a29c8109f8374, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:02.793380 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f74e5d8-217e-411b-8a9d-9d5def384791 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:02.806195 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 976/1936] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:49:02 2022] POST /identity/v3/projects => generated 389 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:49:02.810329 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b9f2a-ed98-4545-a753-337c134f23d5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:02.880853 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b9f2a-ed98-4545-a753-337c134f23d5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:02.886957 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100c125-7e4a-4a81-a02f-f4fc16954a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:02.887647 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100c125-7e4a-4a81-a02f-f4fc16954a22 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:02.887987 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100c125-7e4a-4a81-a02f-f4fc16954a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:02.888567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100c125-7e4a-4a81-a02f-f4fc16954a22 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:02.888928 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b100c125-7e4a-4a81-a02f-f4fc16954a22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:02.891198 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b100c125-7e4a-4a81-a02f-f4fc16954a22 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:02.903668 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 961/1937] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:49:02 2022] PUT /identity/v3/projects/081e31122b9d4a2997718e18835c33f4/users/048e88e81d6f4f318a0a29c8109f8374/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:02.915838 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1dadd7-72ca-4ae6-8890-23c8bdce5ded None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:02.925675 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1dadd7-72ca-4ae6-8890-23c8bdce5ded None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:02.925675 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1dadd7-72ca-4ae6-8890-23c8bdce5ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:02.952654 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ba1dadd7-72ca-4ae6-8890-23c8bdce5ded None None] MFA Rules not processed for user `048e88e81d6f4f318a0a29c8109f8374`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:02.955681 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ba1dadd7-72ca-4ae6-8890-23c8bdce5ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:03.030197 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 962/1938] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:02 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:49:03.031384 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1dadd7-72ca-4ae6-8890-23c8bdce5ded None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:03.070005 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 977/1939] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:49:02 2022] POST /identity/v3/users => generated 301 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:49:03.080508 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100c125-7e4a-4a81-a02f-f4fc16954a22 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:03.099399 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100c125-7e4a-4a81-a02f-f4fc16954a22 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:03.140494 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1dadd7-72ca-4ae6-8890-23c8bdce5ded None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:03.142808 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:03.150249 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6530272-77f0-45ed-8e9e-e7397e2a8265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:03.152399 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6530272-77f0-45ed-8e9e-e7397e2a8265 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:03.152399 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6530272-77f0-45ed-8e9e-e7397e2a8265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:03.152399 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6530272-77f0-45ed-8e9e-e7397e2a8265 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:03.152974 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6530272-77f0-45ed-8e9e-e7397e2a8265 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:03.155714 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6530272-77f0-45ed-8e9e-e7397e2a8265 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:03.200219 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17b7cc-53f0-4f1d-b35b-3ef48373ead2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:03.201037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17b7cc-53f0-4f1d-b35b-3ef48373ead2 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:03.201378 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17b7cc-53f0-4f1d-b35b-3ef48373ead2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:03.201771 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17b7cc-53f0-4f1d-b35b-3ef48373ead2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:03.202513 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c17b7cc-53f0-4f1d-b35b-3ef48373ead2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:03.204184 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c17b7cc-53f0-4f1d-b35b-3ef48373ead2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:03.223540 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 978/1940] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:49:03.228143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17b7cc-53f0-4f1d-b35b-3ef48373ead2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:03.238195 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17b7cc-53f0-4f1d-b35b-3ef48373ead2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:03.243073 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bd3e7-a542-441a-89ed-8013757f0b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:03.243817 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bd3e7-a542-441a-89ed-8013757f0b1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:03.244170 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bd3e7-a542-441a-89ed-8013757f0b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:03.244507 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bd3e7-a542-441a-89ed-8013757f0b1d admin admin] PATH_INFO: `/v3/projects/a2a284f562494621895927eb000f8006/users/89693d24aed944b5b25e9e0530ce77c5/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:03.260357 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6bd3e7-a542-441a-89ed-8013757f0b1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2a284f562494621895927eb000f8006, user_id=89693d24aed944b5b25e9e0530ce77c5, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:03.263620 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6bd3e7-a542-441a-89ed-8013757f0b1d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:03.336928 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 963/1941] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:49:03 2022] POST /identity/v3/projects => generated 407 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:49:03.337913 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6530272-77f0-45ed-8e9e-e7397e2a8265 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:03.387338 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 979/1942] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:49:03 2022] PUT /identity/v3/projects/a2a284f562494621895927eb000f8006/users/89693d24aed944b5b25e9e0530ce77c5/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:49:03.391180 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bd3e7-a542-441a-89ed-8013757f0b1d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:03.403397 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6530272-77f0-45ed-8e9e-e7397e2a8265 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:03.475507 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a9289-f829-4f4c-9376-4f5c096cdffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:03.476131 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a9289-f829-4f4c-9376-4f5c096cdffc admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:03.477410 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a9289-f829-4f4c-9376-4f5c096cdffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:03.477410 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a9289-f829-4f4c-9376-4f5c096cdffc admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:03.477410 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a9289-f829-4f4c-9376-4f5c096cdffc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:03.479466 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a9289-f829-4f4c-9376-4f5c096cdffc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:03.492772 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bd3e7-a542-441a-89ed-8013757f0b1d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:03.499698 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef85e8a-fed7-495c-990d-3881db7271aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:03.500326 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef85e8a-fed7-495c-990d-3881db7271aa admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:03.500618 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef85e8a-fed7-495c-990d-3881db7271aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:03.500896 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef85e8a-fed7-495c-990d-3881db7271aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:03.501547 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef85e8a-fed7-495c-990d-3881db7271aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:03.504817 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef85e8a-fed7-495c-990d-3881db7271aa admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:03.517284 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 980/1943] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:49:03.521192 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef85e8a-fed7-495c-990d-3881db7271aa admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:03.531281 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef85e8a-fed7-495c-990d-3881db7271aa admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:03.535872 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e446977-0169-491d-986e-203b6e7a62de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:03.537040 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e446977-0169-491d-986e-203b6e7a62de admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:03.537320 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e446977-0169-491d-986e-203b6e7a62de admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:03.537615 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e446977-0169-491d-986e-203b6e7a62de admin admin] PATH_INFO: `/v3/projects/a2a284f562494621895927eb000f8006/users/89693d24aed944b5b25e9e0530ce77c5/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:03.539582 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e446977-0169-491d-986e-203b6e7a62de admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2a284f562494621895927eb000f8006, user_id=89693d24aed944b5b25e9e0530ce77c5, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:03.542245 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e446977-0169-491d-986e-203b6e7a62de admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:03.553025 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 981/1944] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:49:03 2022] PUT /identity/v3/projects/a2a284f562494621895927eb000f8006/users/89693d24aed944b5b25e9e0530ce77c5/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:49:03.565079 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766d8cb-1aae-44ae-9bc4-3467f6d9664b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:03.565367 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766d8cb-1aae-44ae-9bc4-3467f6d9664b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:03.565676 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766d8cb-1aae-44ae-9bc4-3467f6d9664b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:03.596853 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 964/1945] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:49:03 2022] POST /identity/v3/users => generated 310 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:49:03.597025 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c766d8cb-1aae-44ae-9bc4-3467f6d9664b None None] MFA Rules not processed for user `89693d24aed944b5b25e9e0530ce77c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:03.597025 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c766d8cb-1aae-44ae-9bc4-3467f6d9664b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:03.600138 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a9289-f829-4f4c-9376-4f5c096cdffc admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:03.611273 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a9289-f829-4f4c-9376-4f5c096cdffc admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:03.684011 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 982/1946] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:03 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:49:03.695010 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f8d56-ceac-4143-95a1-99d14597475c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:03.695636 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f8d56-ceac-4143-95a1-99d14597475c admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:03.695917 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f8d56-ceac-4143-95a1-99d14597475c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:03.698505 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f8d56-ceac-4143-95a1-99d14597475c admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:03.699199 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f8d56-ceac-4143-95a1-99d14597475c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:03.700569 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766d8cb-1aae-44ae-9bc4-3467f6d9664b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:03.700876 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f8d56-ceac-4143-95a1-99d14597475c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:03.702256 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c766d8cb-1aae-44ae-9bc4-3467f6d9664b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:03.713127 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 965/1947] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:49:03.717613 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f8d56-ceac-4143-95a1-99d14597475c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:03.728990 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f8d56-ceac-4143-95a1-99d14597475c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:03.734451 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ddcf6f-2e04-4f60-a48c-ff03306f26df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:03.735254 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddcf6f-2e04-4f60-a48c-ff03306f26df admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:03.735617 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddcf6f-2e04-4f60-a48c-ff03306f26df admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:03.735901 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddcf6f-2e04-4f60-a48c-ff03306f26df admin admin] PATH_INFO: `/v3/projects/17a14cae5935482bbf0bd51554721db6/users/756067dec3574781bd4e49d13dcb6c42/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:03.757003 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ddcf6f-2e04-4f60-a48c-ff03306f26df admin admin] RBAC: Authorizing `identity:create_grant(project_id=17a14cae5935482bbf0bd51554721db6, user_id=756067dec3574781bd4e49d13dcb6c42, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:03.759778 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ddcf6f-2e04-4f60-a48c-ff03306f26df admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:03.778989 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766d8cb-1aae-44ae-9bc4-3467f6d9664b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:03.783119 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a8235-99b9-45ff-812f-504731d96970 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:03.783834 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a8235-99b9-45ff-812f-504731d96970 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:03.784115 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a8235-99b9-45ff-812f-504731d96970 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:03.784383 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a8235-99b9-45ff-812f-504731d96970 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:03.796270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a8235-99b9-45ff-812f-504731d96970 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:03.799349 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a8235-99b9-45ff-812f-504731d96970 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:03.820161 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 983/1948] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:49:03 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:49:03.879118 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a8235-99b9-45ff-812f-504731d96970 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:03.879633 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 966/1949] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:49:03 2022] PUT /identity/v3/projects/17a14cae5935482bbf0bd51554721db6/users/756067dec3574781bd4e49d13dcb6c42/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:03.895799 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a8235-99b9-45ff-812f-504731d96970 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:03.961875 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd8177-0ab3-45c3-91cb-708f9e0e9870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:03.962674 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd8177-0ab3-45c3-91cb-708f9e0e9870 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:03.963648 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd8177-0ab3-45c3-91cb-708f9e0e9870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:03.964005 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd8177-0ab3-45c3-91cb-708f9e0e9870 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:03.965462 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd8177-0ab3-45c3-91cb-708f9e0e9870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:03.966455 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd8177-0ab3-45c3-91cb-708f9e0e9870 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:03.980437 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 984/1950] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:49:03.984471 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ddcf6f-2e04-4f60-a48c-ff03306f26df admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:03.996696 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ddcf6f-2e04-4f60-a48c-ff03306f26df admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:04.014647 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be690d5-7831-4e41-bec3-9e6d9637898a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:04.014647 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be690d5-7831-4e41-bec3-9e6d9637898a admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:04.014647 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be690d5-7831-4e41-bec3-9e6d9637898a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:04.014647 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be690d5-7831-4e41-bec3-9e6d9637898a admin admin] PATH_INFO: `/v3/projects/17a14cae5935482bbf0bd51554721db6/users/756067dec3574781bd4e49d13dcb6c42/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:04.015268 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be690d5-7831-4e41-bec3-9e6d9637898a admin admin] RBAC: Authorizing `identity:create_grant(project_id=17a14cae5935482bbf0bd51554721db6, user_id=756067dec3574781bd4e49d13dcb6c42, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:04.015268 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be690d5-7831-4e41-bec3-9e6d9637898a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:04.025148 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 967/1951] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:49:03 2022] PUT /identity/v3/projects/17a14cae5935482bbf0bd51554721db6/users/756067dec3574781bd4e49d13dcb6c42/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:04.037013 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa746e-8141-49d6-90b8-de846558e740 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:04.037305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa746e-8141-49d6-90b8-de846558e740 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:04.037623 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa746e-8141-49d6-90b8-de846558e740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:04.074420 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-70fa746e-8141-49d6-90b8-de846558e740 None None] MFA Rules not processed for user `756067dec3574781bd4e49d13dcb6c42`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:04.075786 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-70fa746e-8141-49d6-90b8-de846558e740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:04.210805 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 985/1952] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:04 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:04.261620 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8045a-6a62-4129-a951-9c779dba3efd None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:04.262008 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8045a-6a62-4129-a951-9c779dba3efd None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:04.262219 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8045a-6a62-4129-a951-9c779dba3efd None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:04.263609 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 968/1953] 10.222.0.33 () {54 vars in 921 bytes} [Fri Sep 16 03:49:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:49:04.268765 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4117d-d6b2-4161-84c0-b853b39695d5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:04.269050 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4117d-d6b2-4161-84c0-b853b39695d5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:04.269328 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4117d-d6b2-4161-84c0-b853b39695d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:04.290361 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4cb4117d-d6b2-4161-84c0-b853b39695d5 None None] MFA Rules not processed for user `c09d1a4ac8b64921a6b05fcd567bb770`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:04.291576 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4cb4117d-d6b2-4161-84c0-b853b39695d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:04.362892 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 986/1954] 10.222.0.33 () {58 vars in 1018 bytes} [Fri Sep 16 03:49:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:04.375254 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8045a-6a62-4129-a951-9c779dba3efd None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:04.376954 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5fc8045a-6a62-4129-a951-9c779dba3efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:04.404357 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8045a-6a62-4129-a951-9c779dba3efd None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:04.412505 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b35f0-a544-464a-a5e6-f0f704213943 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:04.413118 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b35f0-a544-464a-a5e6-f0f704213943 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:04.413580 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b35f0-a544-464a-a5e6-f0f704213943 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:04.421810 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b35f0-a544-464a-a5e6-f0f704213943 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:04.437235 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b35f0-a544-464a-a5e6-f0f704213943 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:04.439134 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b35f0-a544-464a-a5e6-f0f704213943 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:04.453711 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 969/1955] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:49:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:49:04.467464 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:04.510060 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4117d-d6b2-4161-84c0-b853b39695d5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:04.512733 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:04.514318 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4cb4117d-d6b2-4161-84c0-b853b39695d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:04.585432 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4117d-d6b2-4161-84c0-b853b39695d5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:04.590613 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3407e10-2989-49c6-a832-b36b452d4029 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:04.591221 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3407e10-2989-49c6-a832-b36b452d4029 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:04.591535 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3407e10-2989-49c6-a832-b36b452d4029 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:04.591888 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3407e10-2989-49c6-a832-b36b452d4029 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:04.603245 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3407e10-2989-49c6-a832-b36b452d4029 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:04.604792 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3407e10-2989-49c6-a832-b36b452d4029 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:04.628464 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 987/1956] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:49:04 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:49:05.486742 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b35f0-a544-464a-a5e6-f0f704213943 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:05.559258 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b35f0-a544-464a-a5e6-f0f704213943 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:05.563927 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a2860-cef7-4453-b1f8-6e2a2069aff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:05.564566 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a2860-cef7-4453-b1f8-6e2a2069aff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:05.564844 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a2860-cef7-4453-b1f8-6e2a2069aff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:05.565114 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a2860-cef7-4453-b1f8-6e2a2069aff2 admin admin] PATH_INFO: `/v3/users/1b2b7a3265eb418ca905c9526d0ea492` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:05.566928 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a2860-cef7-4453-b1f8-6e2a2069aff2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b2b7a3265eb418ca905c9526d0ea492)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:05.568983 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a2860-cef7-4453-b1f8-6e2a2069aff2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:05.862291 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-185a2860-cef7-4453-b1f8-6e2a2069aff2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b2b7a3265eb418ca905c9526d0ea492'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:05.863179 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-185a2860-cef7-4453-b1f8-6e2a2069aff2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b2b7a3265eb418ca905c9526d0ea492'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:05.876774 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-185a2860-cef7-4453-b1f8-6e2a2069aff2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b2b7a3265eb418ca905c9526d0ea492'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:05.903142 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-185a2860-cef7-4453-b1f8-6e2a2069aff2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b2b7a3265eb418ca905c9526d0ea492'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:05.903844 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-185a2860-cef7-4453-b1f8-6e2a2069aff2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b2b7a3265eb418ca905c9526d0ea492'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:06.052131 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 970/1957] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:49:05 2022] DELETE /identity/v3/users/1b2b7a3265eb418ca905c9526d0ea492 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:06.056688 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d19be-a64a-4f0b-b981-12a023f52953 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:06.057163 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d19be-a64a-4f0b-b981-12a023f52953 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:06.057252 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d19be-a64a-4f0b-b981-12a023f52953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:06.084928 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c96d19be-a64a-4f0b-b981-12a023f52953 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:06.086196 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c96d19be-a64a-4f0b-b981-12a023f52953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:06.208087 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a2860-cef7-4453-b1f8-6e2a2069aff2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:06.209583 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-185a2860-cef7-4453-b1f8-6e2a2069aff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:06.234357 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 988/1958] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:06.244817 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d19be-a64a-4f0b-b981-12a023f52953 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:06.246045 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c96d19be-a64a-4f0b-b981-12a023f52953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:06.313580 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a2860-cef7-4453-b1f8-6e2a2069aff2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:06.319106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33719b-0627-44a0-a490-8390592605b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:06.319767 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33719b-0627-44a0-a490-8390592605b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:06.320142 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33719b-0627-44a0-a490-8390592605b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:06.321371 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33719b-0627-44a0-a490-8390592605b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:06.331748 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7b33719b-0627-44a0-a490-8390592605b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:06.369083 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d19be-a64a-4f0b-b981-12a023f52953 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:06.375140 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521e73d-bf3f-4239-b4d4-5591e55942af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:06.375807 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521e73d-bf3f-4239-b4d4-5591e55942af service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:06.376086 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521e73d-bf3f-4239-b4d4-5591e55942af service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:06.376364 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521e73d-bf3f-4239-b4d4-5591e55942af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:06.389735 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0521e73d-bf3f-4239-b4d4-5591e55942af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:06.391315 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0521e73d-bf3f-4239-b4d4-5591e55942af service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:06.409606 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 989/1959] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:49:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 03:49:06.466733 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33719b-0627-44a0-a490-8390592605b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:06.469656 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33719b-0627-44a0-a490-8390592605b1 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:06.484734 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 971/1960] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:49:06 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 03:49:06.727767 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:06.978462 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521e73d-bf3f-4239-b4d4-5591e55942af service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:06.980326 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0521e73d-bf3f-4239-b4d4-5591e55942af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:07.043836 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521e73d-bf3f-4239-b4d4-5591e55942af service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:07.055667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e74f5e-1b73-4dc5-b9d7-7642ffedf8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:07.057708 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e74f5e-1b73-4dc5-b9d7-7642ffedf8af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:07.058610 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e74f5e-1b73-4dc5-b9d7-7642ffedf8af admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:07.059374 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e74f5e-1b73-4dc5-b9d7-7642ffedf8af admin admin] PATH_INFO: `/v3/projects/0e97cdbea8ea4c70be39e74bbde6ebbf` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:07.061803 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e74f5e-1b73-4dc5-b9d7-7642ffedf8af admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e97cdbea8ea4c70be39e74bbde6ebbf)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:07.064568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e74f5e-1b73-4dc5-b9d7-7642ffedf8af admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:07.233848 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-75e74f5e-1b73-4dc5-b9d7-7642ffedf8af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e97cdbea8ea4c70be39e74bbde6ebbf', 'request_id': 'req-75e74f5e-1b73-4dc5-b9d7-7642ffedf8af'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:07.312256 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-75e74f5e-1b73-4dc5-b9d7-7642ffedf8af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e97cdbea8ea4c70be39e74bbde6ebbf', 'request_id': 'req-75e74f5e-1b73-4dc5-b9d7-7642ffedf8af'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:07.319928 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-75e74f5e-1b73-4dc5-b9d7-7642ffedf8af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e97cdbea8ea4c70be39e74bbde6ebbf', 'request_id': 'req-75e74f5e-1b73-4dc5-b9d7-7642ffedf8af'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:07.330822 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-75e74f5e-1b73-4dc5-b9d7-7642ffedf8af admin admin] The token cache is being invalidate because project 0e97cdbea8ea4c70be39e74bbde6ebbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:49:07.331114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-75e74f5e-1b73-4dc5-b9d7-7642ffedf8af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:07.331819 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-75e74f5e-1b73-4dc5-b9d7-7642ffedf8af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:07.333934 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 990/1961] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:49:06 2022] DELETE /identity/v3/projects/0e97cdbea8ea4c70be39e74bbde6ebbf => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:07.337991 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33719b-0627-44a0-a490-8390592605b1 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:07.350396 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33719b-0627-44a0-a490-8390592605b1 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:07.433205 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941b100-bd69-45aa-93b1-cc50571e4a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:07.433895 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941b100-bd69-45aa-93b1-cc50571e4a54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:07.434224 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941b100-bd69-45aa-93b1-cc50571e4a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:07.434861 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941b100-bd69-45aa-93b1-cc50571e4a54 admin admin] PATH_INFO: `/v3/users/89693d24aed944b5b25e9e0530ce77c5` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:07.436201 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941b100-bd69-45aa-93b1-cc50571e4a54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89693d24aed944b5b25e9e0530ce77c5)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:07.440505 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941b100-bd69-45aa-93b1-cc50571e4a54 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:07.676459 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8941b100-bd69-45aa-93b1-cc50571e4a54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89693d24aed944b5b25e9e0530ce77c5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:07.678013 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8941b100-bd69-45aa-93b1-cc50571e4a54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89693d24aed944b5b25e9e0530ce77c5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:07.685734 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8941b100-bd69-45aa-93b1-cc50571e4a54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89693d24aed944b5b25e9e0530ce77c5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:07.697074 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:07.719710 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8941b100-bd69-45aa-93b1-cc50571e4a54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89693d24aed944b5b25e9e0530ce77c5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:07.720531 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8941b100-bd69-45aa-93b1-cc50571e4a54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89693d24aed944b5b25e9e0530ce77c5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:07.833002 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 972/1962] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:49:07 2022] DELETE /identity/v3/users/89693d24aed944b5b25e9e0530ce77c5 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:08.385295 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e74f5e-1b73-4dc5-b9d7-7642ffedf8af admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:08.387709 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-75e74f5e-1b73-4dc5-b9d7-7642ffedf8af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:08.410044 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e74f5e-1b73-4dc5-b9d7-7642ffedf8af admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:08.478400 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883c30e-f196-439b-943c-765e5d2d6f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:08.479038 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883c30e-f196-439b-943c-765e5d2d6f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:08.479319 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883c30e-f196-439b-943c-765e5d2d6f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:08.479592 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883c30e-f196-439b-943c-765e5d2d6f74 admin admin] PATH_INFO: `/v3/projects/a2a284f562494621895927eb000f8006` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:08.480727 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883c30e-f196-439b-943c-765e5d2d6f74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2a284f562494621895927eb000f8006)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:08.482724 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883c30e-f196-439b-943c-765e5d2d6f74 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:08.634661 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c883c30e-f196-439b-943c-765e5d2d6f74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2a284f562494621895927eb000f8006', 'request_id': 'req-c883c30e-f196-439b-943c-765e5d2d6f74'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:08.735747 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c883c30e-f196-439b-943c-765e5d2d6f74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2a284f562494621895927eb000f8006', 'request_id': 'req-c883c30e-f196-439b-943c-765e5d2d6f74'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:08.744693 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c883c30e-f196-439b-943c-765e5d2d6f74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2a284f562494621895927eb000f8006', 'request_id': 'req-c883c30e-f196-439b-943c-765e5d2d6f74'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:08.772225 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c883c30e-f196-439b-943c-765e5d2d6f74 admin admin] The token cache is being invalidate because project a2a284f562494621895927eb000f8006 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:49:08.772225 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c883c30e-f196-439b-943c-765e5d2d6f74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:08.772225 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c883c30e-f196-439b-943c-765e5d2d6f74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:08.772225 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 991/1963] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:49:08 2022] DELETE /identity/v3/projects/a2a284f562494621895927eb000f8006 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:08.772518 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390aae6-8e0b-4a4f-98b6-b6befdfd60e2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:08.772518 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390aae6-8e0b-4a4f-98b6-b6befdfd60e2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:08.772518 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390aae6-8e0b-4a4f-98b6-b6befdfd60e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:08.792405 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8390aae6-8e0b-4a4f-98b6-b6befdfd60e2 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:08.793698 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8390aae6-8e0b-4a4f-98b6-b6befdfd60e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:08.821757 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:08.863262 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 973/1964] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:49:08.872554 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624ae0b-0b2f-4fe9-8ab0-9322cefccb98 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:08.873020 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624ae0b-0b2f-4fe9-8ab0-9322cefccb98 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:08.873405 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624ae0b-0b2f-4fe9-8ab0-9322cefccb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:08.896687 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e624ae0b-0b2f-4fe9-8ab0-9322cefccb98 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:08.898117 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e624ae0b-0b2f-4fe9-8ab0-9322cefccb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:08.908086 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 992/1965] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:08.913122 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390aae6-8e0b-4a4f-98b6-b6befdfd60e2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:08.923717 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390aae6-8e0b-4a4f-98b6-b6befdfd60e2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:08.929124 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854d8fd-262e-4dbd-8b39-657c583698f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:08.929777 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854d8fd-262e-4dbd-8b39-657c583698f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:08.930067 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854d8fd-262e-4dbd-8b39-657c583698f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:08.930338 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854d8fd-262e-4dbd-8b39-657c583698f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:08.930997 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4854d8fd-262e-4dbd-8b39-657c583698f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:49:08.931303 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4854d8fd-262e-4dbd-8b39-657c583698f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:08.932933 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4854d8fd-262e-4dbd-8b39-657c583698f0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:08.944842 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 974/1966] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:49:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:49:08.949411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624ae0b-0b2f-4fe9-8ab0-9322cefccb98 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:08.959718 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624ae0b-0b2f-4fe9-8ab0-9322cefccb98 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:08.964575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c935947-2102-471c-acae-2040757a1590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:08.965131 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c935947-2102-471c-acae-2040757a1590 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:08.965416 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c935947-2102-471c-acae-2040757a1590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:08.965722 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c935947-2102-471c-acae-2040757a1590 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:08.966489 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c935947-2102-471c-acae-2040757a1590 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:08.968477 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c935947-2102-471c-acae-2040757a1590 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:09.095477 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854d8fd-262e-4dbd-8b39-657c583698f0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:09.097230 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4854d8fd-262e-4dbd-8b39-657c583698f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:09.111367 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854d8fd-262e-4dbd-8b39-657c583698f0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:09.117363 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ede76c-dcfa-4bd4-8b38-5fc1864b8af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:09.118287 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ede76c-dcfa-4bd4-8b38-5fc1864b8af5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:09.118634 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ede76c-dcfa-4bd4-8b38-5fc1864b8af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:09.118975 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ede76c-dcfa-4bd4-8b38-5fc1864b8af5 admin admin] PATH_INFO: `/v3/users/dd1bd40258084900afad37a6b0403a6e` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:09.120404 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ede76c-dcfa-4bd4-8b38-5fc1864b8af5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd1bd40258084900afad37a6b0403a6e)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:09.122472 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ede76c-dcfa-4bd4-8b38-5fc1864b8af5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:09.143813 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 993/1967] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:49:08 2022] POST /identity/v3/projects => generated 377 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:49:09.148572 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c935947-2102-471c-acae-2040757a1590 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:09.212411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c935947-2102-471c-acae-2040757a1590 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:09.217116 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd464b-b6a0-4839-ab89-3f79dec5c07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:09.217761 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd464b-b6a0-4839-ab89-3f79dec5c07b admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:09.218045 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd464b-b6a0-4839-ab89-3f79dec5c07b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:09.218317 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd464b-b6a0-4839-ab89-3f79dec5c07b admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:09.218947 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcd464b-b6a0-4839-ab89-3f79dec5c07b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:09.220892 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcd464b-b6a0-4839-ab89-3f79dec5c07b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:09.394398 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 994/1968] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:49:09 2022] POST /identity/v3/users => generated 289 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:49:09.398142 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd464b-b6a0-4839-ab89-3f79dec5c07b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:09.418195 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-45ede76c-dcfa-4bd4-8b38-5fc1864b8af5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd1bd40258084900afad37a6b0403a6e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:09.419318 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-45ede76c-dcfa-4bd4-8b38-5fc1864b8af5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd1bd40258084900afad37a6b0403a6e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:09.420041 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd464b-b6a0-4839-ab89-3f79dec5c07b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:09.430522 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-45ede76c-dcfa-4bd4-8b38-5fc1864b8af5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd1bd40258084900afad37a6b0403a6e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:09.431290 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28425133-51f6-4b39-8a31-cdab7d8804e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:09.432057 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28425133-51f6-4b39-8a31-cdab7d8804e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:09.432443 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28425133-51f6-4b39-8a31-cdab7d8804e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:09.432821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28425133-51f6-4b39-8a31-cdab7d8804e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:09.433579 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28425133-51f6-4b39-8a31-cdab7d8804e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:09.435326 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28425133-51f6-4b39-8a31-cdab7d8804e8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:09.447306 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 995/1969] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:49:09.453846 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-45ede76c-dcfa-4bd4-8b38-5fc1864b8af5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd1bd40258084900afad37a6b0403a6e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:09.453846 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-45ede76c-dcfa-4bd4-8b38-5fc1864b8af5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd1bd40258084900afad37a6b0403a6e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:09.455119 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28425133-51f6-4b39-8a31-cdab7d8804e8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:09.456960 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-28425133-51f6-4b39-8a31-cdab7d8804e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:09.470112 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28425133-51f6-4b39-8a31-cdab7d8804e8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:09.476806 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f23c0b-ac91-450d-8cb0-cae31e907196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:09.476806 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f23c0b-ac91-450d-8cb0-cae31e907196 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:09.477188 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f23c0b-ac91-450d-8cb0-cae31e907196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:09.480914 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f23c0b-ac91-450d-8cb0-cae31e907196 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:09.480914 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f23c0b-ac91-450d-8cb0-cae31e907196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:09.480914 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f23c0b-ac91-450d-8cb0-cae31e907196 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:09.494056 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 996/1970] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:49:09.495272 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f23c0b-ac91-450d-8cb0-cae31e907196 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:09.504805 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f23c0b-ac91-450d-8cb0-cae31e907196 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:09.510422 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1760bae-1cdb-4bb0-9b87-cea67c8728a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:09.511104 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1760bae-1cdb-4bb0-9b87-cea67c8728a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:09.511356 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1760bae-1cdb-4bb0-9b87-cea67c8728a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:09.511629 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1760bae-1cdb-4bb0-9b87-cea67c8728a2 admin admin] PATH_INFO: `/v3/projects/0b128e2fa34a48ae8c0b74b669f7bbf1/users/c52f6b9367084c188adf8a1ae6bae48d/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:09.526857 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1760bae-1cdb-4bb0-9b87-cea67c8728a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b128e2fa34a48ae8c0b74b669f7bbf1, user_id=c52f6b9367084c188adf8a1ae6bae48d, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:09.529838 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1760bae-1cdb-4bb0-9b87-cea67c8728a2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:09.609507 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 975/1971] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:49:09 2022] DELETE /identity/v3/users/dd1bd40258084900afad37a6b0403a6e => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:09.613778 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3809866-24f5-474e-9140-35d9346eae6d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:09.614079 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3809866-24f5-474e-9140-35d9346eae6d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:09.614355 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3809866-24f5-474e-9140-35d9346eae6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:09.633845 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e3809866-24f5-474e-9140-35d9346eae6d None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:09.635072 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e3809866-24f5-474e-9140-35d9346eae6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:09.663446 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 997/1972] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:49:09 2022] PUT /identity/v3/projects/0b128e2fa34a48ae8c0b74b669f7bbf1/users/c52f6b9367084c188adf8a1ae6bae48d/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:49:09.664868 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606a1db-a6a5-4e61-82e1-66dcc9f7804c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:09.665359 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606a1db-a6a5-4e61-82e1-66dcc9f7804c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:09.665804 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606a1db-a6a5-4e61-82e1-66dcc9f7804c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:09.716365 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 976/1973] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:49:09.719073 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:09.724750 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3809866-24f5-474e-9140-35d9346eae6d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:09.731832 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e3809866-24f5-474e-9140-35d9346eae6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:09.746102 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f606a1db-a6a5-4e61-82e1-66dcc9f7804c None None] MFA Rules not processed for user `c52f6b9367084c188adf8a1ae6bae48d`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:09.747758 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f606a1db-a6a5-4e61-82e1-66dcc9f7804c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:09.805271 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3809866-24f5-474e-9140-35d9346eae6d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:09.818362 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3538d47-cbed-4e78-a8c1-38b44eb3c744 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:09.819875 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3538d47-cbed-4e78-a8c1-38b44eb3c744 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:09.819875 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3538d47-cbed-4e78-a8c1-38b44eb3c744 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:09.819875 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3538d47-cbed-4e78-a8c1-38b44eb3c744 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:09.837067 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3538d47-cbed-4e78-a8c1-38b44eb3c744 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:09.839885 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3538d47-cbed-4e78-a8c1-38b44eb3c744 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:09.854286 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 977/1974] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:49:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 03:49:09.889142 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 998/1975] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:09.903431 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3538d47-cbed-4e78-a8c1-38b44eb3c744 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:09.905876 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c3538d47-cbed-4e78-a8c1-38b44eb3c744 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:10.010308 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3538d47-cbed-4e78-a8c1-38b44eb3c744 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:10.015860 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0a4d2-e395-4709-8246-5bf4d2da686c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aafb065e06c3481bbed8d98e893766ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:10.016481 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0a4d2-e395-4709-8246-5bf4d2da686c service glance] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:10.016791 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0a4d2-e395-4709-8246-5bf4d2da686c service glance] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:10.017059 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0a4d2-e395-4709-8246-5bf4d2da686c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:10.028126 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0a4d2-e395-4709-8246-5bf4d2da686c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:10.029723 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0a4d2-e395-4709-8246-5bf4d2da686c service glance] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:10.040059 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 978/1976] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:49:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:49:10.360570 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606a1db-a6a5-4e61-82e1-66dcc9f7804c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:10.362373 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f606a1db-a6a5-4e61-82e1-66dcc9f7804c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:10.389618 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606a1db-a6a5-4e61-82e1-66dcc9f7804c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:10.395044 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1e7af-71a1-4cb8-baa9-f0acd30e5f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:10.395744 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1e7af-71a1-4cb8-baa9-f0acd30e5f85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:10.396570 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1e7af-71a1-4cb8-baa9-f0acd30e5f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:10.402550 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1e7af-71a1-4cb8-baa9-f0acd30e5f85 admin admin] PATH_INFO: `/v3/projects/000a47e15bce4267ac9b706fd1ce4750` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:10.402550 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d1e7af-71a1-4cb8-baa9-f0acd30e5f85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=000a47e15bce4267ac9b706fd1ce4750)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:10.402550 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d1e7af-71a1-4cb8-baa9-f0acd30e5f85 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:10.519690 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f0d1e7af-71a1-4cb8-baa9-f0acd30e5f85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '000a47e15bce4267ac9b706fd1ce4750', 'request_id': 'req-f0d1e7af-71a1-4cb8-baa9-f0acd30e5f85'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:10.558630 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:10.580896 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f0d1e7af-71a1-4cb8-baa9-f0acd30e5f85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '000a47e15bce4267ac9b706fd1ce4750', 'request_id': 'req-f0d1e7af-71a1-4cb8-baa9-f0acd30e5f85'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:10.592738 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f0d1e7af-71a1-4cb8-baa9-f0acd30e5f85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '000a47e15bce4267ac9b706fd1ce4750', 'request_id': 'req-f0d1e7af-71a1-4cb8-baa9-f0acd30e5f85'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:10.607985 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f0d1e7af-71a1-4cb8-baa9-f0acd30e5f85 admin admin] The token cache is being invalidate because project 000a47e15bce4267ac9b706fd1ce4750 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:49:10.608245 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f0d1e7af-71a1-4cb8-baa9-f0acd30e5f85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:10.609800 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f0d1e7af-71a1-4cb8-baa9-f0acd30e5f85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:10.611921 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 999/1977] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:49:10 2022] DELETE /identity/v3/projects/000a47e15bce4267ac9b706fd1ce4750 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:10.615868 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0a4d2-e395-4709-8246-5bf4d2da686c service glance] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:10.627764 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0a4d2-e395-4709-8246-5bf4d2da686c service glance] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:10.705033 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853722f-2cd7-4fef-9d66-aee754d6beb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:10.706007 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853722f-2cd7-4fef-9d66-aee754d6beb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:10.706180 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853722f-2cd7-4fef-9d66-aee754d6beb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:10.706373 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853722f-2cd7-4fef-9d66-aee754d6beb8 admin admin] PATH_INFO: `/v3/users/98a75f0a81104f0ca670e1ad8ef1b37c` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:10.707584 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6853722f-2cd7-4fef-9d66-aee754d6beb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98a75f0a81104f0ca670e1ad8ef1b37c)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:10.710253 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6853722f-2cd7-4fef-9d66-aee754d6beb8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:11.081607 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6853722f-2cd7-4fef-9d66-aee754d6beb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98a75f0a81104f0ca670e1ad8ef1b37c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:11.082783 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6853722f-2cd7-4fef-9d66-aee754d6beb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98a75f0a81104f0ca670e1ad8ef1b37c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:11.090535 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6853722f-2cd7-4fef-9d66-aee754d6beb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98a75f0a81104f0ca670e1ad8ef1b37c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:11.103935 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6853722f-2cd7-4fef-9d66-aee754d6beb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98a75f0a81104f0ca670e1ad8ef1b37c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:11.104701 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6853722f-2cd7-4fef-9d66-aee754d6beb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98a75f0a81104f0ca670e1ad8ef1b37c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:11.189129 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 979/1978] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:49:10 2022] DELETE /identity/v3/users/98a75f0a81104f0ca670e1ad8ef1b37c => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:11.783862 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1e7af-71a1-4cb8-baa9-f0acd30e5f85 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:11.785384 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f0d1e7af-71a1-4cb8-baa9-f0acd30e5f85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:11.799601 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1e7af-71a1-4cb8-baa9-f0acd30e5f85 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:11.863044 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7add1-583c-4c65-a466-fe3ad40da172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:11.863773 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7add1-583c-4c65-a466-fe3ad40da172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:11.864121 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7add1-583c-4c65-a466-fe3ad40da172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:11.864458 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7add1-583c-4c65-a466-fe3ad40da172 admin admin] PATH_INFO: `/v3/projects/0437e2ae521f4fb99fa3c849f08f00dd` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:11.866241 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7add1-583c-4c65-a466-fe3ad40da172 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0437e2ae521f4fb99fa3c849f08f00dd)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:11.868883 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7add1-583c-4c65-a466-fe3ad40da172 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:12.034299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-37f7add1-583c-4c65-a466-fe3ad40da172 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0437e2ae521f4fb99fa3c849f08f00dd', 'request_id': 'req-37f7add1-583c-4c65-a466-fe3ad40da172'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:12.129874 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-37f7add1-583c-4c65-a466-fe3ad40da172 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0437e2ae521f4fb99fa3c849f08f00dd', 'request_id': 'req-37f7add1-583c-4c65-a466-fe3ad40da172'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:12.136552 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-37f7add1-583c-4c65-a466-fe3ad40da172 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0437e2ae521f4fb99fa3c849f08f00dd', 'request_id': 'req-37f7add1-583c-4c65-a466-fe3ad40da172'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:12.147400 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-37f7add1-583c-4c65-a466-fe3ad40da172 admin admin] The token cache is being invalidate because project 0437e2ae521f4fb99fa3c849f08f00dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:49:12.147733 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-37f7add1-583c-4c65-a466-fe3ad40da172 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:12.148454 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-37f7add1-583c-4c65-a466-fe3ad40da172 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:12.150107 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1000/1979] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:49:11 2022] DELETE /identity/v3/projects/0437e2ae521f4fb99fa3c849f08f00dd => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:12.157179 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c4274-a682-4cf1-9e9a-bb77b02204f8 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:12.157752 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c4274-a682-4cf1-9e9a-bb77b02204f8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:12.158136 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c4274-a682-4cf1-9e9a-bb77b02204f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:12.182397 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-717c4274-a682-4cf1-9e9a-bb77b02204f8 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:12.183616 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-717c4274-a682-4cf1-9e9a-bb77b02204f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:12.259771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 980/1980] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:12.267410 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c931cac-dc5e-4163-a5d4-968f04a55c43 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:12.267704 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c931cac-dc5e-4163-a5d4-968f04a55c43 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:12.267982 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c931cac-dc5e-4163-a5d4-968f04a55c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:12.292637 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6c931cac-dc5e-4163-a5d4-968f04a55c43 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:12.294068 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6c931cac-dc5e-4163-a5d4-968f04a55c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:12.302947 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1001/1981] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:12.307608 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c4274-a682-4cf1-9e9a-bb77b02204f8 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:12.319067 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c4274-a682-4cf1-9e9a-bb77b02204f8 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:12.324147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454d5a0-3e09-45d8-976f-21c7ee689b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:12.324949 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454d5a0-3e09-45d8-976f-21c7ee689b67 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:12.325231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454d5a0-3e09-45d8-976f-21c7ee689b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:12.325654 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454d5a0-3e09-45d8-976f-21c7ee689b67 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:12.326332 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9454d5a0-3e09-45d8-976f-21c7ee689b67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:49:12.326637 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9454d5a0-3e09-45d8-976f-21c7ee689b67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:12.328265 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9454d5a0-3e09-45d8-976f-21c7ee689b67 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:12.340213 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 981/1982] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:49:12.344536 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c931cac-dc5e-4163-a5d4-968f04a55c43 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:12.354806 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c931cac-dc5e-4163-a5d4-968f04a55c43 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:12.359591 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415967b1-7b05-40e2-9701-4ca25b56fab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:12.360247 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415967b1-7b05-40e2-9701-4ca25b56fab8 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:12.360521 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415967b1-7b05-40e2-9701-4ca25b56fab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:12.362737 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415967b1-7b05-40e2-9701-4ca25b56fab8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:12.362737 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415967b1-7b05-40e2-9701-4ca25b56fab8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:12.363630 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415967b1-7b05-40e2-9701-4ca25b56fab8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:12.516797 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1002/1983] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:49:12 2022] POST /identity/v3/projects => generated 361 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:49:12.520953 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454d5a0-3e09-45d8-976f-21c7ee689b67 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:12.531643 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454d5a0-3e09-45d8-976f-21c7ee689b67 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:12.611322 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cb19b-12be-4c81-985b-0d08789cefac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:12.622184 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cb19b-12be-4c81-985b-0d08789cefac admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:12.622673 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cb19b-12be-4c81-985b-0d08789cefac admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:12.623196 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cb19b-12be-4c81-985b-0d08789cefac admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:12.624010 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405cb19b-12be-4c81-985b-0d08789cefac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:12.626491 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405cb19b-12be-4c81-985b-0d08789cefac admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:12.639806 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:12.739410 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 982/1984] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:49:12 2022] POST /identity/v3/users => generated 281 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:49:12.740853 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415967b1-7b05-40e2-9701-4ca25b56fab8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:12.751096 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415967b1-7b05-40e2-9701-4ca25b56fab8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:12.755652 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804c0cf-facd-4c89-ad77-394ee9a323be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:12.756258 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804c0cf-facd-4c89-ad77-394ee9a323be admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:12.756682 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804c0cf-facd-4c89-ad77-394ee9a323be admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:12.756957 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804c0cf-facd-4c89-ad77-394ee9a323be admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:12.765048 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804c0cf-facd-4c89-ad77-394ee9a323be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:12.765048 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804c0cf-facd-4c89-ad77-394ee9a323be admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:12.773411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1003/1985] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:49:12.775290 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cb19b-12be-4c81-985b-0d08789cefac admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:12.786944 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cb19b-12be-4c81-985b-0d08789cefac admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:12.791791 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6758eee3-f378-4d08-84e4-d01aed69c16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:12.792492 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758eee3-f378-4d08-84e4-d01aed69c16f admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:12.802781 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758eee3-f378-4d08-84e4-d01aed69c16f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:12.802781 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758eee3-f378-4d08-84e4-d01aed69c16f admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:12.802781 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6758eee3-f378-4d08-84e4-d01aed69c16f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:12.802781 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6758eee3-f378-4d08-84e4-d01aed69c16f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:12.807038 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 983/1986] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:49:12.811436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804c0cf-facd-4c89-ad77-394ee9a323be admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:12.822920 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804c0cf-facd-4c89-ad77-394ee9a323be admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:12.827710 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a6e70-a503-4300-a838-543e90c2d6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:12.828503 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a6e70-a503-4300-a838-543e90c2d6f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:12.828790 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a6e70-a503-4300-a838-543e90c2d6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:12.829067 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a6e70-a503-4300-a838-543e90c2d6f0 admin admin] PATH_INFO: `/v3/projects/df400efd0405457a9c5a0f393294c5e2/users/75ac889d93134ce996a609cdccff9bff/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:12.843361 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a6e70-a503-4300-a838-543e90c2d6f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df400efd0405457a9c5a0f393294c5e2, user_id=75ac889d93134ce996a609cdccff9bff, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:12.846012 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a6e70-a503-4300-a838-543e90c2d6f0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:12.935734 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1004/1987] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:49:12 2022] PUT /identity/v3/projects/df400efd0405457a9c5a0f393294c5e2/users/75ac889d93134ce996a609cdccff9bff/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:12.946420 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45924d-7fdb-452b-b152-ff3809fb353f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:12.946707 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45924d-7fdb-452b-b152-ff3809fb353f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:12.946988 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45924d-7fdb-452b-b152-ff3809fb353f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:12.975791 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-6e45924d-7fdb-452b-b152-ff3809fb353f None None] MFA Rules not processed for user `75ac889d93134ce996a609cdccff9bff`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:12.977060 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6e45924d-7fdb-452b-b152-ff3809fb353f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:13.044157 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 984/1988] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:13.519045 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a6e70-a503-4300-a838-543e90c2d6f0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:13.521506 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6b5a6e70-a503-4300-a838-543e90c2d6f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:13.536284 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:13.584880 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a6e70-a503-4300-a838-543e90c2d6f0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:13.588513 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9d6c5-b1e6-4c5e-8335-a17bf3464dec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:13.589126 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9d6c5-b1e6-4c5e-8335-a17bf3464dec service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:13.589415 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9d6c5-b1e6-4c5e-8335-a17bf3464dec service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:13.589714 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9d6c5-b1e6-4c5e-8335-a17bf3464dec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:13.598424 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b9d6c5-b1e6-4c5e-8335-a17bf3464dec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:13.599929 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b9d6c5-b1e6-4c5e-8335-a17bf3464dec service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:13.608755 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1005/1989] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:49:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:49:13.624276 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45924d-7fdb-452b-b152-ff3809fb353f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:13.688934 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45924d-7fdb-452b-b152-ff3809fb353f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:13.693661 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9d8c0-093a-4308-af92-bdd164b51d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:13.694559 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9d8c0-093a-4308-af92-bdd164b51d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:13.694839 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9d8c0-093a-4308-af92-bdd164b51d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:13.695114 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9d8c0-093a-4308-af92-bdd164b51d6b admin admin] PATH_INFO: `/v3/users/75ac889d93134ce996a609cdccff9bff` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:13.696273 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f9d8c0-093a-4308-af92-bdd164b51d6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=75ac889d93134ce996a609cdccff9bff)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:13.702002 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f9d8c0-093a-4308-af92-bdd164b51d6b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:14.081201 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d2f9d8c0-093a-4308-af92-bdd164b51d6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75ac889d93134ce996a609cdccff9bff'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:14.082279 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d2f9d8c0-093a-4308-af92-bdd164b51d6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75ac889d93134ce996a609cdccff9bff'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:14.089783 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d2f9d8c0-093a-4308-af92-bdd164b51d6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75ac889d93134ce996a609cdccff9bff'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:14.104224 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d2f9d8c0-093a-4308-af92-bdd164b51d6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75ac889d93134ce996a609cdccff9bff'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:14.106200 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d2f9d8c0-093a-4308-af92-bdd164b51d6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75ac889d93134ce996a609cdccff9bff'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:14.308504 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 985/1990] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:49:13 2022] DELETE /identity/v3/users/75ac889d93134ce996a609cdccff9bff => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:14.312970 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451cfe90-400f-444c-b60b-fc1678afb190 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:14.313494 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451cfe90-400f-444c-b60b-fc1678afb190 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:14.313494 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451cfe90-400f-444c-b60b-fc1678afb190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:14.332656 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-451cfe90-400f-444c-b60b-fc1678afb190 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:14.334565 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-451cfe90-400f-444c-b60b-fc1678afb190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:14.399542 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1006/1991] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:14.410516 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9d8c0-093a-4308-af92-bdd164b51d6b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:14.412053 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d2f9d8c0-093a-4308-af92-bdd164b51d6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:14.471402 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9d8c0-093a-4308-af92-bdd164b51d6b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:14.475490 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a06e81-4758-4281-8827-7c890b7ebd80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:14.476273 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a06e81-4758-4281-8827-7c890b7ebd80 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:14.477519 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a06e81-4758-4281-8827-7c890b7ebd80 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:14.478502 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a06e81-4758-4281-8827-7c890b7ebd80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:14.488945 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a06e81-4758-4281-8827-7c890b7ebd80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:14.491015 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a06e81-4758-4281-8827-7c890b7ebd80 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:14.507809 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 986/1992] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:49:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:49:15.245876 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451cfe90-400f-444c-b60b-fc1678afb190 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:15.247606 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-451cfe90-400f-444c-b60b-fc1678afb190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:15.260158 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451cfe90-400f-444c-b60b-fc1678afb190 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:15.264935 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768e2cb-ad7e-41f5-a7e5-aba26a9f0a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:15.265691 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768e2cb-ad7e-41f5-a7e5-aba26a9f0a07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:15.265979 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768e2cb-ad7e-41f5-a7e5-aba26a9f0a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:15.266258 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768e2cb-ad7e-41f5-a7e5-aba26a9f0a07 admin admin] PATH_INFO: `/v3/projects/df400efd0405457a9c5a0f393294c5e2` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:15.267745 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768e2cb-ad7e-41f5-a7e5-aba26a9f0a07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df400efd0405457a9c5a0f393294c5e2)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:15.269866 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768e2cb-ad7e-41f5-a7e5-aba26a9f0a07 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:15.399709 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8768e2cb-ad7e-41f5-a7e5-aba26a9f0a07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df400efd0405457a9c5a0f393294c5e2', 'request_id': 'req-8768e2cb-ad7e-41f5-a7e5-aba26a9f0a07'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:15.479468 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8768e2cb-ad7e-41f5-a7e5-aba26a9f0a07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df400efd0405457a9c5a0f393294c5e2', 'request_id': 'req-8768e2cb-ad7e-41f5-a7e5-aba26a9f0a07'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:15.490773 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8768e2cb-ad7e-41f5-a7e5-aba26a9f0a07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df400efd0405457a9c5a0f393294c5e2', 'request_id': 'req-8768e2cb-ad7e-41f5-a7e5-aba26a9f0a07'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:15.501819 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8768e2cb-ad7e-41f5-a7e5-aba26a9f0a07 admin admin] The token cache is being invalidate because project df400efd0405457a9c5a0f393294c5e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:49:15.502120 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8768e2cb-ad7e-41f5-a7e5-aba26a9f0a07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:15.502822 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8768e2cb-ad7e-41f5-a7e5-aba26a9f0a07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:15.504314 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1007/1993] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:49:15 2022] DELETE /identity/v3/projects/df400efd0405457a9c5a0f393294c5e2 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:15.510073 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9709d2-c436-4315-9896-195cf4b2efaa None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:15.510562 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9709d2-c436-4315-9896-195cf4b2efaa None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:15.510656 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9709d2-c436-4315-9896-195cf4b2efaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:15.535391 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8b9709d2-c436-4315-9896-195cf4b2efaa None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:15.537082 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8b9709d2-c436-4315-9896-195cf4b2efaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:15.589671 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768e2cb-ad7e-41f5-a7e5-aba26a9f0a07 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:15.592035 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8768e2cb-ad7e-41f5-a7e5-aba26a9f0a07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:15.635724 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 987/1994] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:49:15.645245 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162c4c4-a6ad-4f3d-a573-d2e03151ede9 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:15.646598 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162c4c4-a6ad-4f3d-a573-d2e03151ede9 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:15.646885 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162c4c4-a6ad-4f3d-a573-d2e03151ede9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:15.707981 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:15.725107 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a162c4c4-a6ad-4f3d-a573-d2e03151ede9 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:15.728301 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a162c4c4-a6ad-4f3d-a573-d2e03151ede9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:15.742802 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 988/1995] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:15.746979 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a162c4c4-a6ad-4f3d-a573-d2e03151ede9 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:15.762485 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a162c4c4-a6ad-4f3d-a573-d2e03151ede9 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:15.773063 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f6f54-cb0c-48c8-bf9a-47427d351e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:15.773761 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f6f54-cb0c-48c8-bf9a-47427d351e5c admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:15.774052 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f6f54-cb0c-48c8-bf9a-47427d351e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:15.774331 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f6f54-cb0c-48c8-bf9a-47427d351e5c admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:15.775004 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f6f54-cb0c-48c8-bf9a-47427d351e5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:49:15.775307 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f6f54-cb0c-48c8-bf9a-47427d351e5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:15.776940 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f6f54-cb0c-48c8-bf9a-47427d351e5c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:15.781546 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768e2cb-ad7e-41f5-a7e5-aba26a9f0a07 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:15.788070 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681595f-b86b-4c3f-a91c-677bd6626ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:15.788818 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681595f-b86b-4c3f-a91c-677bd6626ca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:15.789659 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681595f-b86b-4c3f-a91c-677bd6626ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:15.790031 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681595f-b86b-4c3f-a91c-677bd6626ca4 admin admin] PATH_INFO: `/v3/users/048e88e81d6f4f318a0a29c8109f8374` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:15.791451 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b681595f-b86b-4c3f-a91c-677bd6626ca4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=048e88e81d6f4f318a0a29c8109f8374)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:15.793709 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 989/1996] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:49:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:49:15.793847 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b681595f-b86b-4c3f-a91c-677bd6626ca4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:15.796062 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f6f54-cb0c-48c8-bf9a-47427d351e5c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:15.807903 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f6f54-cb0c-48c8-bf9a-47427d351e5c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:15.820415 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae8f1b-2755-437d-a5da-d9d283be1e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:15.821200 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae8f1b-2755-437d-a5da-d9d283be1e70 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:15.821551 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae8f1b-2755-437d-a5da-d9d283be1e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:15.821929 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae8f1b-2755-437d-a5da-d9d283be1e70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:15.822646 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae8f1b-2755-437d-a5da-d9d283be1e70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:15.824810 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae8f1b-2755-437d-a5da-d9d283be1e70 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:16.044743 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 990/1997] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:49:15 2022] POST /identity/v3/projects => generated 373 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:49:16.045763 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae8f1b-2755-437d-a5da-d9d283be1e70 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:16.111856 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae8f1b-2755-437d-a5da-d9d283be1e70 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:16.117064 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d7a2f9-1eb1-478c-a9cf-44dbd36dd4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:16.117984 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7a2f9-1eb1-478c-a9cf-44dbd36dd4d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:16.118550 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7a2f9-1eb1-478c-a9cf-44dbd36dd4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:16.118550 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7a2f9-1eb1-478c-a9cf-44dbd36dd4d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:16.119153 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d7a2f9-1eb1-478c-a9cf-44dbd36dd4d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:16.121121 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d7a2f9-1eb1-478c-a9cf-44dbd36dd4d1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:16.159820 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b681595f-b86b-4c3f-a91c-677bd6626ca4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '048e88e81d6f4f318a0a29c8109f8374'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:16.160866 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b681595f-b86b-4c3f-a91c-677bd6626ca4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '048e88e81d6f4f318a0a29c8109f8374'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:16.170257 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b681595f-b86b-4c3f-a91c-677bd6626ca4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '048e88e81d6f4f318a0a29c8109f8374'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:16.188823 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b681595f-b86b-4c3f-a91c-677bd6626ca4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '048e88e81d6f4f318a0a29c8109f8374'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:16.189566 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b681595f-b86b-4c3f-a91c-677bd6626ca4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '048e88e81d6f4f318a0a29c8109f8374'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:16.219285 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 991/1998] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:49:16 2022] POST /identity/v3/users => generated 287 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:49:16.220352 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d7a2f9-1eb1-478c-a9cf-44dbd36dd4d1 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:16.222054 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-38d7a2f9-1eb1-478c-a9cf-44dbd36dd4d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:16.235493 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d7a2f9-1eb1-478c-a9cf-44dbd36dd4d1 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:16.240534 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e3c2d-006d-4085-b20e-fd9d00b7f83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:16.241172 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e3c2d-006d-4085-b20e-fd9d00b7f83f admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:16.241456 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e3c2d-006d-4085-b20e-fd9d00b7f83f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:16.241769 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e3c2d-006d-4085-b20e-fd9d00b7f83f admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:16.242560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2e3c2d-006d-4085-b20e-fd9d00b7f83f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:16.244029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2e3c2d-006d-4085-b20e-fd9d00b7f83f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:16.254398 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 992/1999] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:49:16.259684 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e3c2d-006d-4085-b20e-fd9d00b7f83f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:16.269908 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e3c2d-006d-4085-b20e-fd9d00b7f83f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:16.275256 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd197914-1527-4606-a4d9-f1edcf18f164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:16.275864 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd197914-1527-4606-a4d9-f1edcf18f164 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:16.276143 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd197914-1527-4606-a4d9-f1edcf18f164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:16.276447 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd197914-1527-4606-a4d9-f1edcf18f164 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:16.277085 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd197914-1527-4606-a4d9-f1edcf18f164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:16.278979 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd197914-1527-4606-a4d9-f1edcf18f164 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:16.289826 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 993/2000] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:49:16.294065 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd197914-1527-4606-a4d9-f1edcf18f164 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:16.308450 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd197914-1527-4606-a4d9-f1edcf18f164 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:16.314922 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42895884-eeed-4d10-8973-d5ae9b8b7fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:16.315773 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42895884-eeed-4d10-8973-d5ae9b8b7fde admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:16.316234 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42895884-eeed-4d10-8973-d5ae9b8b7fde admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:16.316638 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42895884-eeed-4d10-8973-d5ae9b8b7fde admin admin] PATH_INFO: `/v3/projects/856b0f6294ed49dea7d7f192bb38a86e/users/b612217c1da94e9db3bab736c2c85c59/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:16.340374 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42895884-eeed-4d10-8973-d5ae9b8b7fde admin admin] RBAC: Authorizing `identity:create_grant(project_id=856b0f6294ed49dea7d7f192bb38a86e, user_id=b612217c1da94e9db3bab736c2c85c59, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:16.343702 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42895884-eeed-4d10-8973-d5ae9b8b7fde admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:16.348772 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1008/2001] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:49:15 2022] DELETE /identity/v3/users/048e88e81d6f4f318a0a29c8109f8374 => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:16.349950 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681595f-b86b-4c3f-a91c-677bd6626ca4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:16.351699 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b681595f-b86b-4c3f-a91c-677bd6626ca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:16.436044 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681595f-b86b-4c3f-a91c-677bd6626ca4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:16.440766 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3414769-8dcf-4654-b298-ba20a8af3d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:16.441585 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3414769-8dcf-4654-b298-ba20a8af3d98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:16.441818 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3414769-8dcf-4654-b298-ba20a8af3d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:16.442094 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3414769-8dcf-4654-b298-ba20a8af3d98 admin admin] PATH_INFO: `/v3/users/961d0da5168949169227d7afe8f07cca` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:16.443365 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3414769-8dcf-4654-b298-ba20a8af3d98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=961d0da5168949169227d7afe8f07cca)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:16.445780 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3414769-8dcf-4654-b298-ba20a8af3d98 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:16.457773 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:16.496475 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 994/2002] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:49:16 2022] PUT /identity/v3/projects/856b0f6294ed49dea7d7f192bb38a86e/users/b612217c1da94e9db3bab736c2c85c59/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:49:16.497781 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d6653-0b23-412b-8771-b74c8a05fc0c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:16.498065 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d6653-0b23-412b-8771-b74c8a05fc0c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:16.498335 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d6653-0b23-412b-8771-b74c8a05fc0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:16.518662 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-cf8d6653-0b23-412b-8771-b74c8a05fc0c None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:16.521613 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cf8d6653-0b23-412b-8771-b74c8a05fc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:16.605666 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 995/2003] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:16.609160 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce99a8a-27d4-4d03-a898-cb43a0410458 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:16.609160 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce99a8a-27d4-4d03-a898-cb43a0410458 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:16.609160 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce99a8a-27d4-4d03-a898-cb43a0410458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:16.627399 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8ce99a8a-27d4-4d03-a898-cb43a0410458 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:16.628632 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8ce99a8a-27d4-4d03-a898-cb43a0410458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:16.641140 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 996/2004] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:16.641863 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce99a8a-27d4-4d03-a898-cb43a0410458 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:16.643129 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8ce99a8a-27d4-4d03-a898-cb43a0410458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:16.688127 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c3414769-8dcf-4654-b298-ba20a8af3d98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '961d0da5168949169227d7afe8f07cca'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:16.688795 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c3414769-8dcf-4654-b298-ba20a8af3d98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '961d0da5168949169227d7afe8f07cca'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:16.704391 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c3414769-8dcf-4654-b298-ba20a8af3d98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '961d0da5168949169227d7afe8f07cca'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:16.721698 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce99a8a-27d4-4d03-a898-cb43a0410458 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:16.724772 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c3414769-8dcf-4654-b298-ba20a8af3d98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '961d0da5168949169227d7afe8f07cca'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:16.725462 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c3414769-8dcf-4654-b298-ba20a8af3d98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '961d0da5168949169227d7afe8f07cca'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:16.736016 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c4fb8-2881-4ec3-b604-afd172ab010a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:16.736753 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c4fb8-2881-4ec3-b604-afd172ab010a service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:16.737118 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c4fb8-2881-4ec3-b604-afd172ab010a service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:16.737450 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c4fb8-2881-4ec3-b604-afd172ab010a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:16.745852 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ad3c4fb8-2881-4ec3-b604-afd172ab010a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:16.774513 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c4fb8-2881-4ec3-b604-afd172ab010a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:16.774513 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c4fb8-2881-4ec3-b604-afd172ab010a service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:16.781103 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 997/2005] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:49:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:49:16.782848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c4fb8-2881-4ec3-b604-afd172ab010a service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:16.784292 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ad3c4fb8-2881-4ec3-b604-afd172ab010a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:16.795378 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c4fb8-2881-4ec3-b604-afd172ab010a service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:16.799220 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1dc81-8b88-4a84-9395-0eb8cb96ac57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:16.799929 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1dc81-8b88-4a84-9395-0eb8cb96ac57 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:16.800313 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1dc81-8b88-4a84-9395-0eb8cb96ac57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:16.800682 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1dc81-8b88-4a84-9395-0eb8cb96ac57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:16.803194 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c5d1dc81-8b88-4a84-9395-0eb8cb96ac57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:16.816691 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1009/2006] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:49:16 2022] DELETE /identity/v3/users/961d0da5168949169227d7afe8f07cca => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:16.822304 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c3e33-60d0-4a1b-baae-4de22d8ce762 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:16.822554 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1dc81-8b88-4a84-9395-0eb8cb96ac57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:16.823332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c3e33-60d0-4a1b-baae-4de22d8ce762 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:16.823758 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c3e33-60d0-4a1b-baae-4de22d8ce762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:16.824296 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1dc81-8b88-4a84-9395-0eb8cb96ac57 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:16.837034 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 998/2007] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:49:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:49:16.847985 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-602c3e33-60d0-4a1b-baae-4de22d8ce762 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:16.849023 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-602c3e33-60d0-4a1b-baae-4de22d8ce762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:16.928355 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1010/2008] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:16.942491 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1dc81-8b88-4a84-9395-0eb8cb96ac57 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:16.951301 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1dc81-8b88-4a84-9395-0eb8cb96ac57 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:17.026630 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786390e-9f17-4cdb-958e-3498f8978b72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:17.027357 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786390e-9f17-4cdb-958e-3498f8978b72 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:17.027639 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786390e-9f17-4cdb-958e-3498f8978b72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:17.029424 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786390e-9f17-4cdb-958e-3498f8978b72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:17.038242 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786390e-9f17-4cdb-958e-3498f8978b72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:17.040047 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786390e-9f17-4cdb-958e-3498f8978b72 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:17.050112 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 999/2009] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:49:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:49:17.658037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c3e33-60d0-4a1b-baae-4de22d8ce762 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:17.660415 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-602c3e33-60d0-4a1b-baae-4de22d8ce762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:17.683065 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c3e33-60d0-4a1b-baae-4de22d8ce762 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:17.706380 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99d29c-dcbc-426c-a0c4-6a4ed8873740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:17.708037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99d29c-dcbc-426c-a0c4-6a4ed8873740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:17.708325 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99d29c-dcbc-426c-a0c4-6a4ed8873740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:17.708603 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99d29c-dcbc-426c-a0c4-6a4ed8873740 admin admin] PATH_INFO: `/v3/projects/081e31122b9d4a2997718e18835c33f4` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:17.713168 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99d29c-dcbc-426c-a0c4-6a4ed8873740 admin admin] RBAC: Authorizing `identity:delete_project(project_id=081e31122b9d4a2997718e18835c33f4)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:17.723594 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99d29c-dcbc-426c-a0c4-6a4ed8873740 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:17.756811 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786390e-9f17-4cdb-958e-3498f8978b72 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:17.758939 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6786390e-9f17-4cdb-958e-3498f8978b72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:17.788329 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786390e-9f17-4cdb-958e-3498f8978b72 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:17.796517 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7dd13-ce27-408e-b83f-6dc6e1ca65e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:17.797772 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7dd13-ce27-408e-b83f-6dc6e1ca65e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:17.798204 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7dd13-ce27-408e-b83f-6dc6e1ca65e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:17.798660 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7dd13-ce27-408e-b83f-6dc6e1ca65e0 admin admin] PATH_INFO: `/v3/projects/216d25f9b11b4c97bebefbd061993292` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:17.800098 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7dd13-ce27-408e-b83f-6dc6e1ca65e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=216d25f9b11b4c97bebefbd061993292)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:17.803023 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7dd13-ce27-408e-b83f-6dc6e1ca65e0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:17.988346 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fb99d29c-dcbc-426c-a0c4-6a4ed8873740 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '081e31122b9d4a2997718e18835c33f4', 'request_id': 'req-fb99d29c-dcbc-426c-a0c4-6a4ed8873740'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:17.991976 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3cf7dd13-ce27-408e-b83f-6dc6e1ca65e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '216d25f9b11b4c97bebefbd061993292', 'request_id': 'req-3cf7dd13-ce27-408e-b83f-6dc6e1ca65e0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:18.060539 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:18.094071 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fb99d29c-dcbc-426c-a0c4-6a4ed8873740 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '081e31122b9d4a2997718e18835c33f4', 'request_id': 'req-fb99d29c-dcbc-426c-a0c4-6a4ed8873740'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:18.102357 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fb99d29c-dcbc-426c-a0c4-6a4ed8873740 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '081e31122b9d4a2997718e18835c33f4', 'request_id': 'req-fb99d29c-dcbc-426c-a0c4-6a4ed8873740'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:18.113865 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fb99d29c-dcbc-426c-a0c4-6a4ed8873740 admin admin] The token cache is being invalidate because project 081e31122b9d4a2997718e18835c33f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:49:18.114160 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fb99d29c-dcbc-426c-a0c4-6a4ed8873740 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:18.114844 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fb99d29c-dcbc-426c-a0c4-6a4ed8873740 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:18.116425 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1011/2010] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:49:17 2022] DELETE /identity/v3/projects/081e31122b9d4a2997718e18835c33f4 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:18.120548 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99d29c-dcbc-426c-a0c4-6a4ed8873740 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:18.122991 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fb99d29c-dcbc-426c-a0c4-6a4ed8873740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:18.208240 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99d29c-dcbc-426c-a0c4-6a4ed8873740 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:18.234111 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3cf7dd13-ce27-408e-b83f-6dc6e1ca65e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '216d25f9b11b4c97bebefbd061993292', 'request_id': 'req-3cf7dd13-ce27-408e-b83f-6dc6e1ca65e0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:18.244533 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3cf7dd13-ce27-408e-b83f-6dc6e1ca65e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '216d25f9b11b4c97bebefbd061993292', 'request_id': 'req-3cf7dd13-ce27-408e-b83f-6dc6e1ca65e0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:18.271462 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3cf7dd13-ce27-408e-b83f-6dc6e1ca65e0 admin admin] The token cache is being invalidate because project 216d25f9b11b4c97bebefbd061993292 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:49:18.271756 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3cf7dd13-ce27-408e-b83f-6dc6e1ca65e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:18.272473 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3cf7dd13-ce27-408e-b83f-6dc6e1ca65e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:18.274524 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1000/2011] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:49:17 2022] DELETE /identity/v3/projects/216d25f9b11b4c97bebefbd061993292 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:49:18.281530 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7dd13-ce27-408e-b83f-6dc6e1ca65e0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:18.281530 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3cf7dd13-ce27-408e-b83f-6dc6e1ca65e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:18.299687 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c63e32e-f7d8-45c4-bfba-52901fee11db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:18.300431 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63e32e-f7d8-45c4-bfba-52901fee11db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:18.300945 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63e32e-f7d8-45c4-bfba-52901fee11db admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:18.301302 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63e32e-f7d8-45c4-bfba-52901fee11db admin admin] PATH_INFO: `/v3/users/756067dec3574781bd4e49d13dcb6c42` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:18.303086 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c63e32e-f7d8-45c4-bfba-52901fee11db admin admin] RBAC: Authorizing `identity:delete_user(user_id=756067dec3574781bd4e49d13dcb6c42)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:18.305260 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c63e32e-f7d8-45c4-bfba-52901fee11db admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:18.364030 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7dd13-ce27-408e-b83f-6dc6e1ca65e0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:18.370044 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd040f-3c01-4d20-80ef-733a04362299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:18.371205 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd040f-3c01-4d20-80ef-733a04362299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:18.371488 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd040f-3c01-4d20-80ef-733a04362299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:18.371758 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd040f-3c01-4d20-80ef-733a04362299 admin admin] PATH_INFO: `/v3/users/6b60c613897c47988b9971680dd54066` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:18.372912 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd040f-3c01-4d20-80ef-733a04362299 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b60c613897c47988b9971680dd54066)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:18.375103 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd040f-3c01-4d20-80ef-733a04362299 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:18.526616 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8c63e32e-f7d8-45c4-bfba-52901fee11db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '756067dec3574781bd4e49d13dcb6c42'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:18.527434 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8c63e32e-f7d8-45c4-bfba-52901fee11db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '756067dec3574781bd4e49d13dcb6c42'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:18.538210 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8c63e32e-f7d8-45c4-bfba-52901fee11db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '756067dec3574781bd4e49d13dcb6c42'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:18.566520 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8c63e32e-f7d8-45c4-bfba-52901fee11db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '756067dec3574781bd4e49d13dcb6c42'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:18.567326 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8c63e32e-f7d8-45c4-bfba-52901fee11db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '756067dec3574781bd4e49d13dcb6c42'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:18.573315 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-adcd040f-3c01-4d20-80ef-733a04362299 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b60c613897c47988b9971680dd54066'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:18.574688 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-adcd040f-3c01-4d20-80ef-733a04362299 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b60c613897c47988b9971680dd54066'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:18.583753 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-adcd040f-3c01-4d20-80ef-733a04362299 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b60c613897c47988b9971680dd54066'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:18.596892 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-adcd040f-3c01-4d20-80ef-733a04362299 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b60c613897c47988b9971680dd54066'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:18.602837 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-adcd040f-3c01-4d20-80ef-733a04362299 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b60c613897c47988b9971680dd54066'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:18.647174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1012/2012] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:49:18 2022] DELETE /identity/v3/users/756067dec3574781bd4e49d13dcb6c42 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:49:18.735728 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1001/2013] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:49:18 2022] DELETE /identity/v3/users/6b60c613897c47988b9971680dd54066 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:49:18.936807 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:18.948828 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0f96e-0b13-4f1e-b678-ef85e9d7737e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:18.949387 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0f96e-0b13-4f1e-b678-ef85e9d7737e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:18.949504 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0f96e-0b13-4f1e-b678-ef85e9d7737e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:19.007140 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-37a0f96e-0b13-4f1e-b678-ef85e9d7737e None None] MFA Rules not processed for user `b612217c1da94e9db3bab736c2c85c59`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:19.008666 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-37a0f96e-0b13-4f1e-b678-ef85e9d7737e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:19.121252 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1013/2014] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:19.133055 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd040f-3c01-4d20-80ef-733a04362299 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:19.134571 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-adcd040f-3c01-4d20-80ef-733a04362299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:19.204792 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd040f-3c01-4d20-80ef-733a04362299 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:19.208851 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dabaa0-1c7a-4f6e-aedb-65672dccd567 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:19.209478 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dabaa0-1c7a-4f6e-aedb-65672dccd567 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:19.209796 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dabaa0-1c7a-4f6e-aedb-65672dccd567 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:19.210074 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dabaa0-1c7a-4f6e-aedb-65672dccd567 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:19.219667 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dabaa0-1c7a-4f6e-aedb-65672dccd567 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:19.221071 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dabaa0-1c7a-4f6e-aedb-65672dccd567 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:19.231480 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1002/2015] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:49:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:49:19.254037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0f96e-0b13-4f1e-b678-ef85e9d7737e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:19.256151 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-37a0f96e-0b13-4f1e-b678-ef85e9d7737e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:19.268974 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe4685-ebb8-4b6d-b191-8917a9ff9d91 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:19.269254 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe4685-ebb8-4b6d-b191-8917a9ff9d91 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:19.269534 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe4685-ebb8-4b6d-b191-8917a9ff9d91 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:19.272612 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1003/2016] 10.222.0.33 () {54 vars in 921 bytes} [Fri Sep 16 03:49:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:49:19.289271 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67f116-d106-4702-9f1d-9599873633fd None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:19.289567 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67f116-d106-4702-9f1d-9599873633fd None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:19.289886 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67f116-d106-4702-9f1d-9599873633fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:19.323923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-db67f116-d106-4702-9f1d-9599873633fd None None] MFA Rules not processed for user `c39fd09bea1a40babc5f629612c6702b`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:19.325055 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-db67f116-d106-4702-9f1d-9599873633fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:19.340261 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0f96e-0b13-4f1e-b678-ef85e9d7737e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:19.347682 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3bd979-a9d6-431b-8aa1-a4fc9c384c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:19.348345 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bd979-a9d6-431b-8aa1-a4fc9c384c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:19.348790 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bd979-a9d6-431b-8aa1-a4fc9c384c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:19.357142 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bd979-a9d6-431b-8aa1-a4fc9c384c47 admin admin] PATH_INFO: `/v3/projects/17a14cae5935482bbf0bd51554721db6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:19.359730 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3bd979-a9d6-431b-8aa1-a4fc9c384c47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17a14cae5935482bbf0bd51554721db6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:19.361301 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3bd979-a9d6-431b-8aa1-a4fc9c384c47 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:19.428329 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1004/2017] 10.222.0.33 () {58 vars in 1018 bytes} [Fri Sep 16 03:49:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:49:19.439733 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67f116-d106-4702-9f1d-9599873633fd None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:19.441343 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-db67f116-d106-4702-9f1d-9599873633fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:19.456037 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67f116-d106-4702-9f1d-9599873633fd None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:19.461982 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3ee93-88bd-452e-88e4-76d9872254fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c39fd09bea1a40babc5f629612c6702b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:19.462675 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3ee93-88bd-452e-88e4-76d9872254fa service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:19.463097 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3ee93-88bd-452e-88e4-76d9872254fa service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:19.463436 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3ee93-88bd-452e-88e4-76d9872254fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:19.475065 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab3ee93-88bd-452e-88e4-76d9872254fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:19.476848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab3ee93-88bd-452e-88e4-76d9872254fa service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:19.489222 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1005/2018] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:49:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 03:49:19.504815 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3f3bd979-a9d6-431b-8aa1-a4fc9c384c47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17a14cae5935482bbf0bd51554721db6', 'request_id': 'req-3f3bd979-a9d6-431b-8aa1-a4fc9c384c47'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:19.564882 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3ee93-88bd-452e-88e4-76d9872254fa service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:19.566735 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7ab3ee93-88bd-452e-88e4-76d9872254fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:19.583285 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3ee93-88bd-452e-88e4-76d9872254fa service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:19.595034 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3f3bd979-a9d6-431b-8aa1-a4fc9c384c47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17a14cae5935482bbf0bd51554721db6', 'request_id': 'req-3f3bd979-a9d6-431b-8aa1-a4fc9c384c47'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:19.611837 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3f3bd979-a9d6-431b-8aa1-a4fc9c384c47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17a14cae5935482bbf0bd51554721db6', 'request_id': 'req-3f3bd979-a9d6-431b-8aa1-a4fc9c384c47'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:19.637055 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3f3bd979-a9d6-431b-8aa1-a4fc9c384c47 admin admin] The token cache is being invalidate because project 17a14cae5935482bbf0bd51554721db6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:49:19.637543 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3f3bd979-a9d6-431b-8aa1-a4fc9c384c47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:19.638315 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3f3bd979-a9d6-431b-8aa1-a4fc9c384c47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:19.642306 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1014/2019] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:49:19 2022] DELETE /identity/v3/projects/17a14cae5935482bbf0bd51554721db6 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:19.647660 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a596c-b11c-4263-93f6-c4d91cf358ec None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:19.647868 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a596c-b11c-4263-93f6-c4d91cf358ec None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:19.648148 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a596c-b11c-4263-93f6-c4d91cf358ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:19.685141 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-898a596c-b11c-4263-93f6-c4d91cf358ec None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:19.697595 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-898a596c-b11c-4263-93f6-c4d91cf358ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:19.724390 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a52d3-8430-46ba-838c-83e5b59bc15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:19.725122 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a52d3-8430-46ba-838c-83e5b59bc15c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:19.725824 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a52d3-8430-46ba-838c-83e5b59bc15c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:19.725824 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a52d3-8430-46ba-838c-83e5b59bc15c admin admin] PATH_INFO: `/v3/users/5832b2a9564f49338f91e6672343ef61` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:19.727433 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a52d3-8430-46ba-838c-83e5b59bc15c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5832b2a9564f49338f91e6672343ef61)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:19.730258 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a52d3-8430-46ba-838c-83e5b59bc15c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:19.830779 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1015/2020] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:19.833516 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aeeb1d-a304-4246-a293-8d27fa35d025 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:19.833927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aeeb1d-a304-4246-a293-8d27fa35d025 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:19.834282 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aeeb1d-a304-4246-a293-8d27fa35d025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:19.857425 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-35aeeb1d-a304-4246-a293-8d27fa35d025 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:19.858716 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-35aeeb1d-a304-4246-a293-8d27fa35d025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:19.868366 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1016/2021] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:19.872613 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aeeb1d-a304-4246-a293-8d27fa35d025 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:19.882840 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aeeb1d-a304-4246-a293-8d27fa35d025 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:19.887965 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18584347-1bd9-456c-869c-7c8f230c7c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:19.888722 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18584347-1bd9-456c-869c-7c8f230c7c04 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:19.889004 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18584347-1bd9-456c-869c-7c8f230c7c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:19.889304 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18584347-1bd9-456c-869c-7c8f230c7c04 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:19.890006 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18584347-1bd9-456c-869c-7c8f230c7c04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:49:19.890304 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18584347-1bd9-456c-869c-7c8f230c7c04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:19.894836 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18584347-1bd9-456c-869c-7c8f230c7c04 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:19.912427 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1017/2022] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:49:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:49:19.918868 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18584347-1bd9-456c-869c-7c8f230c7c04 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:19.926845 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-18584347-1bd9-456c-869c-7c8f230c7c04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:19.932610 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0f0a52d3-8430-46ba-838c-83e5b59bc15c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5832b2a9564f49338f91e6672343ef61'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:19.933414 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0f0a52d3-8430-46ba-838c-83e5b59bc15c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5832b2a9564f49338f91e6672343ef61'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:19.942352 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18584347-1bd9-456c-869c-7c8f230c7c04 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:19.946204 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0f0a52d3-8430-46ba-838c-83e5b59bc15c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5832b2a9564f49338f91e6672343ef61'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:19.949523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997f91a-ee51-4da5-9e22-d30755727fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:19.950948 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997f91a-ee51-4da5-9e22-d30755727fb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:19.951707 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997f91a-ee51-4da5-9e22-d30755727fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:19.952277 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997f91a-ee51-4da5-9e22-d30755727fb5 admin admin] PATH_INFO: `/v3/projects/449151af186240e49a77189165ca441c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:19.954327 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7997f91a-ee51-4da5-9e22-d30755727fb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=449151af186240e49a77189165ca441c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:19.956849 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7997f91a-ee51-4da5-9e22-d30755727fb5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:19.965955 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0f0a52d3-8430-46ba-838c-83e5b59bc15c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5832b2a9564f49338f91e6672343ef61'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:19.966786 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0f0a52d3-8430-46ba-838c-83e5b59bc15c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5832b2a9564f49338f91e6672343ef61'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:20.109684 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1006/2023] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:49:19 2022] DELETE /identity/v3/users/5832b2a9564f49338f91e6672343ef61 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:49:20.111187 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a52d3-8430-46ba-838c-83e5b59bc15c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:20.118675 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0f0a52d3-8430-46ba-838c-83e5b59bc15c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:20.145534 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7997f91a-ee51-4da5-9e22-d30755727fb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '449151af186240e49a77189165ca441c', 'request_id': 'req-7997f91a-ee51-4da5-9e22-d30755727fb5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:20.250075 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7997f91a-ee51-4da5-9e22-d30755727fb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '449151af186240e49a77189165ca441c', 'request_id': 'req-7997f91a-ee51-4da5-9e22-d30755727fb5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:20.264252 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7997f91a-ee51-4da5-9e22-d30755727fb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '449151af186240e49a77189165ca441c', 'request_id': 'req-7997f91a-ee51-4da5-9e22-d30755727fb5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:20.264457 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a52d3-8430-46ba-838c-83e5b59bc15c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:20.279198 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7997f91a-ee51-4da5-9e22-d30755727fb5 admin admin] The token cache is being invalidate because project 449151af186240e49a77189165ca441c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:49:20.279589 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7997f91a-ee51-4da5-9e22-d30755727fb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:20.280626 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7997f91a-ee51-4da5-9e22-d30755727fb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:20.282731 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1018/2024] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:49:19 2022] DELETE /identity/v3/projects/449151af186240e49a77189165ca441c => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:20.290372 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63a5c3-52df-4f72-b8a5-468b53c6cdd8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:20.290740 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63a5c3-52df-4f72-b8a5-468b53c6cdd8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:20.291090 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63a5c3-52df-4f72-b8a5-468b53c6cdd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:20.319206 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7a63a5c3-52df-4f72-b8a5-468b53c6cdd8 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:20.320559 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7a63a5c3-52df-4f72-b8a5-468b53c6cdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:20.345348 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe1faa-6581-40c0-a177-5c1eb5245ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:20.346105 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe1faa-6581-40c0-a177-5c1eb5245ed3 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:20.346453 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe1faa-6581-40c0-a177-5c1eb5245ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:20.347244 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe1faa-6581-40c0-a177-5c1eb5245ed3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:20.347969 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe1faa-6581-40c0-a177-5c1eb5245ed3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:20.353664 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe1faa-6581-40c0-a177-5c1eb5245ed3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:20.405696 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1019/2025] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:49:20.414028 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5aa0b4-39af-40f3-af12-97ebfba8e5f5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:20.414315 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5aa0b4-39af-40f3-af12-97ebfba8e5f5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:20.414610 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5aa0b4-39af-40f3-af12-97ebfba8e5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:20.434481 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7e5aa0b4-39af-40f3-af12-97ebfba8e5f5 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:20.435709 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7e5aa0b4-39af-40f3-af12-97ebfba8e5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:20.443962 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1020/2026] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:49:20.448324 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5aa0b4-39af-40f3-af12-97ebfba8e5f5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:20.457289 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5aa0b4-39af-40f3-af12-97ebfba8e5f5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:20.462612 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee81771-be54-40f2-b77d-91932dbb828b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:20.463214 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee81771-be54-40f2-b77d-91932dbb828b admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:20.463492 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee81771-be54-40f2-b77d-91932dbb828b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:20.463766 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee81771-be54-40f2-b77d-91932dbb828b admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:20.464464 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee81771-be54-40f2-b77d-91932dbb828b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:49:20.464769 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee81771-be54-40f2-b77d-91932dbb828b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:20.466423 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee81771-be54-40f2-b77d-91932dbb828b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:20.481726 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1021/2027] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:49:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:49:20.483626 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee81771-be54-40f2-b77d-91932dbb828b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:20.486002 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1007/2028] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:49:20 2022] POST /identity/v3/projects => generated 379 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:49:20.490001 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe1faa-6581-40c0-a177-5c1eb5245ed3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:20.491674 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-68fe1faa-6581-40c0-a177-5c1eb5245ed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:20.493348 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee81771-be54-40f2-b77d-91932dbb828b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:20.579319 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe1faa-6581-40c0-a177-5c1eb5245ed3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:20.584620 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6814cf-69a9-48f0-ba3f-4c90d6395489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:20.585605 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6814cf-69a9-48f0-ba3f-4c90d6395489 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:20.585605 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6814cf-69a9-48f0-ba3f-4c90d6395489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:20.585913 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6814cf-69a9-48f0-ba3f-4c90d6395489 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:20.586553 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6814cf-69a9-48f0-ba3f-4c90d6395489 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:20.586870 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29252a-5a38-4a98-9c11-53c3eb5bbfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:20.587498 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29252a-5a38-4a98-9c11-53c3eb5bbfcd admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:20.587781 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29252a-5a38-4a98-9c11-53c3eb5bbfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:20.588053 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29252a-5a38-4a98-9c11-53c3eb5bbfcd admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:20.588459 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6814cf-69a9-48f0-ba3f-4c90d6395489 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:20.588826 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29252a-5a38-4a98-9c11-53c3eb5bbfcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:20.590803 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29252a-5a38-4a98-9c11-53c3eb5bbfcd admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:20.644530 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:20.713906 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1008/2029] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:49:20 2022] POST /identity/v3/users => generated 290 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:49:20.714746 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6814cf-69a9-48f0-ba3f-4c90d6395489 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:20.716729 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0e6814cf-69a9-48f0-ba3f-4c90d6395489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:20.729794 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6814cf-69a9-48f0-ba3f-4c90d6395489 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:20.735257 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5a097-66c5-4a36-80bb-a916d24ea699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:20.735881 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5a097-66c5-4a36-80bb-a916d24ea699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:20.736164 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5a097-66c5-4a36-80bb-a916d24ea699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:20.736441 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5a097-66c5-4a36-80bb-a916d24ea699 admin admin] PATH_INFO: `/v3/projects/665f0a8950634436b7efe6fbd34675e3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:20.737620 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de5a097-66c5-4a36-80bb-a916d24ea699 admin admin] RBAC: Authorizing `identity:delete_project(project_id=665f0a8950634436b7efe6fbd34675e3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:20.738661 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:20.739580 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de5a097-66c5-4a36-80bb-a916d24ea699 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:20.746919 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1022/2030] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:49:20 2022] POST /identity/v3/projects => generated 375 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:49:20.751365 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29252a-5a38-4a98-9c11-53c3eb5bbfcd admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:20.820121 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29252a-5a38-4a98-9c11-53c3eb5bbfcd admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:20.825710 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ffc071-b2a1-4c3f-8abf-8bbc65e1c9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:20.826316 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffc071-b2a1-4c3f-8abf-8bbc65e1c9b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:20.826596 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffc071-b2a1-4c3f-8abf-8bbc65e1c9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:20.826869 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffc071-b2a1-4c3f-8abf-8bbc65e1c9b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:20.827716 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ffc071-b2a1-4c3f-8abf-8bbc65e1c9b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:20.829597 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ffc071-b2a1-4c3f-8abf-8bbc65e1c9b2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:20.840330 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1023/2031] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:49:20.841119 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ffc071-b2a1-4c3f-8abf-8bbc65e1c9b2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:20.851620 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ffc071-b2a1-4c3f-8abf-8bbc65e1c9b2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:20.863131 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1de5a097-66c5-4a36-80bb-a916d24ea699 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '665f0a8950634436b7efe6fbd34675e3', 'request_id': 'req-1de5a097-66c5-4a36-80bb-a916d24ea699'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:20.908112 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773ec65-b036-447e-a457-f69a94edb40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:20.908762 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773ec65-b036-447e-a457-f69a94edb40a admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:20.909052 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773ec65-b036-447e-a457-f69a94edb40a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:20.909328 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773ec65-b036-447e-a457-f69a94edb40a admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:20.910002 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773ec65-b036-447e-a457-f69a94edb40a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:20.912501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773ec65-b036-447e-a457-f69a94edb40a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:21.080711 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1de5a097-66c5-4a36-80bb-a916d24ea699 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '665f0a8950634436b7efe6fbd34675e3', 'request_id': 'req-1de5a097-66c5-4a36-80bb-a916d24ea699'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:21.088408 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1de5a097-66c5-4a36-80bb-a916d24ea699 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '665f0a8950634436b7efe6fbd34675e3', 'request_id': 'req-1de5a097-66c5-4a36-80bb-a916d24ea699'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:21.100134 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1de5a097-66c5-4a36-80bb-a916d24ea699 admin admin] The token cache is being invalidate because project 665f0a8950634436b7efe6fbd34675e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:49:21.100499 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1de5a097-66c5-4a36-80bb-a916d24ea699 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:21.101218 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1de5a097-66c5-4a36-80bb-a916d24ea699 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:21.102786 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1009/2032] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:49:20 2022] DELETE /identity/v3/projects/665f0a8950634436b7efe6fbd34675e3 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:21.103697 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5a097-66c5-4a36-80bb-a916d24ea699 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:21.105051 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1de5a097-66c5-4a36-80bb-a916d24ea699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:21.118330 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5a097-66c5-4a36-80bb-a916d24ea699 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:21.122872 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ef49a-dace-4d00-bf2d-0600dd211aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:21.123461 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ef49a-dace-4d00-bf2d-0600dd211aeb admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:21.123746 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ef49a-dace-4d00-bf2d-0600dd211aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:21.135261 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ef49a-dace-4d00-bf2d-0600dd211aeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:21.135261 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ef49a-dace-4d00-bf2d-0600dd211aeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:21.135261 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ef49a-dace-4d00-bf2d-0600dd211aeb admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:21.135604 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1024/2033] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:49:20 2022] POST /identity/v3/users => generated 288 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:49:21.135604 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e8f73-1be7-4e6f-b8a5-565929ff787c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:21.135604 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e8f73-1be7-4e6f-b8a5-565929ff787c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:21.135604 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e8f73-1be7-4e6f-b8a5-565929ff787c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:21.136456 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1010/2034] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:49:21.140343 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ef49a-dace-4d00-bf2d-0600dd211aeb admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:21.150995 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ef49a-dace-4d00-bf2d-0600dd211aeb admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:21.155267 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-628e8f73-1be7-4e6f-b8a5-565929ff787c None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:21.156031 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45226684-cc67-48cf-bcf3-cec39bee3316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:21.156614 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-628e8f73-1be7-4e6f-b8a5-565929ff787c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:21.156717 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45226684-cc67-48cf-bcf3-cec39bee3316 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:21.156950 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45226684-cc67-48cf-bcf3-cec39bee3316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:21.157228 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45226684-cc67-48cf-bcf3-cec39bee3316 admin admin] PATH_INFO: `/v3/projects/8164452d003b4800973e527f52f190f0/users/23ff8e38d6ec40b6888ed571a3ef5a3e/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:21.165501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1025/2035] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:21.166382 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e8f73-1be7-4e6f-b8a5-565929ff787c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:21.167663 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-628e8f73-1be7-4e6f-b8a5-565929ff787c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:21.180340 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45226684-cc67-48cf-bcf3-cec39bee3316 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8164452d003b4800973e527f52f190f0, user_id=23ff8e38d6ec40b6888ed571a3ef5a3e, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:21.180595 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e8f73-1be7-4e6f-b8a5-565929ff787c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:21.183104 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45226684-cc67-48cf-bcf3-cec39bee3316 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:21.184968 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb55084-b4f4-481a-9b9a-87b960ec89b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:21.185625 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb55084-b4f4-481a-9b9a-87b960ec89b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:21.185924 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb55084-b4f4-481a-9b9a-87b960ec89b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:21.186194 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb55084-b4f4-481a-9b9a-87b960ec89b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:21.186823 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb55084-b4f4-481a-9b9a-87b960ec89b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:21.188457 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb55084-b4f4-481a-9b9a-87b960ec89b5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:21.198779 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1026/2036] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:49:21.200220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22251b8b-59ec-4d35-90d2-79abb96be3d9 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:21.200508 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22251b8b-59ec-4d35-90d2-79abb96be3d9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:21.200803 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22251b8b-59ec-4d35-90d2-79abb96be3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:21.220183 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-22251b8b-59ec-4d35-90d2-79abb96be3d9 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:21.221458 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-22251b8b-59ec-4d35-90d2-79abb96be3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:21.229841 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1027/2037] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:21.230620 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22251b8b-59ec-4d35-90d2-79abb96be3d9 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:21.240134 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22251b8b-59ec-4d35-90d2-79abb96be3d9 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:21.244856 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54044c8d-efef-4a12-b133-1dd8dfda3d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:21.245449 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54044c8d-efef-4a12-b133-1dd8dfda3d1c admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:21.245768 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54044c8d-efef-4a12-b133-1dd8dfda3d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:21.246057 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54044c8d-efef-4a12-b133-1dd8dfda3d1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:21.246701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54044c8d-efef-4a12-b133-1dd8dfda3d1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:21.248309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54044c8d-efef-4a12-b133-1dd8dfda3d1c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:21.259445 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1028/2038] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:49:21.260253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54044c8d-efef-4a12-b133-1dd8dfda3d1c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:21.270181 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54044c8d-efef-4a12-b133-1dd8dfda3d1c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:21.275925 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c13c4-04ea-44cb-87cb-fd84b8e74a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:21.276552 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c13c4-04ea-44cb-87cb-fd84b8e74a95 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:21.278899 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c13c4-04ea-44cb-87cb-fd84b8e74a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:21.278899 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c13c4-04ea-44cb-87cb-fd84b8e74a95 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:21.278899 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c13c4-04ea-44cb-87cb-fd84b8e74a95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:49:21.278899 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c13c4-04ea-44cb-87cb-fd84b8e74a95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:21.280177 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c13c4-04ea-44cb-87cb-fd84b8e74a95 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:21.292234 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1029/2039] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:49:21.293154 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c13c4-04ea-44cb-87cb-fd84b8e74a95 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:21.303773 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c13c4-04ea-44cb-87cb-fd84b8e74a95 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:21.308619 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ceabf-d37d-435a-8759-d386a589ebc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:21.309412 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ceabf-d37d-435a-8759-d386a589ebc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:21.311264 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ceabf-d37d-435a-8759-d386a589ebc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:21.311264 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ceabf-d37d-435a-8759-d386a589ebc3 admin admin] PATH_INFO: `/v3/projects/e72f5c5c88fb4a3f857e4d767bde6852/users/8c051bf284e9481eba693c497e46453c/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:21.322725 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1011/2040] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:49:21 2022] PUT /identity/v3/projects/8164452d003b4800973e527f52f190f0/users/23ff8e38d6ec40b6888ed571a3ef5a3e/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:49:21.323674 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45226684-cc67-48cf-bcf3-cec39bee3316 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:21.328562 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ceabf-d37d-435a-8759-d386a589ebc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e72f5c5c88fb4a3f857e4d767bde6852, user_id=8c051bf284e9481eba693c497e46453c, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:21.332385 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ceabf-d37d-435a-8759-d386a589ebc3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:21.394003 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45226684-cc67-48cf-bcf3-cec39bee3316 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:21.399079 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c9bce-7341-44cd-8dda-2d4638df7809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:21.399685 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c9bce-7341-44cd-8dda-2d4638df7809 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:21.399962 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c9bce-7341-44cd-8dda-2d4638df7809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:21.400228 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c9bce-7341-44cd-8dda-2d4638df7809 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:21.400848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c9bce-7341-44cd-8dda-2d4638df7809 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:21.402926 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c9bce-7341-44cd-8dda-2d4638df7809 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:21.479274 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1030/2041] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:49:21 2022] PUT /identity/v3/projects/e72f5c5c88fb4a3f857e4d767bde6852/users/8c051bf284e9481eba693c497e46453c/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:21.480537 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c1c66-1dc8-4abd-9cda-7bc3b5d0a1c6 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:21.480825 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c1c66-1dc8-4abd-9cda-7bc3b5d0a1c6 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:21.481102 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c1c66-1dc8-4abd-9cda-7bc3b5d0a1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:21.510630 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5b5c1c66-1dc8-4abd-9cda-7bc3b5d0a1c6 None None] MFA Rules not processed for user `23ff8e38d6ec40b6888ed571a3ef5a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:21.511999 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5b5c1c66-1dc8-4abd-9cda-7bc3b5d0a1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:21.532008 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1012/2042] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:49:21 2022] POST /identity/v3/projects => generated 393 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:49:21.536664 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e1b92-853a-4436-9015-86cc83e9b998 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:21.536956 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e1b92-853a-4436-9015-86cc83e9b998 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:21.537236 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e1b92-853a-4436-9015-86cc83e9b998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:21.560337 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-af1e1b92-853a-4436-9015-86cc83e9b998 None None] MFA Rules not processed for user `b612217c1da94e9db3bab736c2c85c59`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:21.561561 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-af1e1b92-853a-4436-9015-86cc83e9b998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:21.578989 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1031/2043] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:21.580216 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1264c6-b353-4181-b9c2-5635c3f60f1e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:21.580436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1264c6-b353-4181-b9c2-5635c3f60f1e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:21.580709 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1264c6-b353-4181-b9c2-5635c3f60f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:21.610450 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1a1264c6-b353-4181-b9c2-5635c3f60f1e None None] MFA Rules not processed for user `8c051bf284e9481eba693c497e46453c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:21.611657 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1a1264c6-b353-4181-b9c2-5635c3f60f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:21.624482 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1013/2044] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:21.625316 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e1b92-853a-4436-9015-86cc83e9b998 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:21.693659 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1032/2045] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:21.693659 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1264c6-b353-4181-b9c2-5635c3f60f1e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:21.709282 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e1b92-853a-4436-9015-86cc83e9b998 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:21.709834 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1264c6-b353-4181-b9c2-5635c3f60f1e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:21.714389 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92942b9-d1ee-40ad-896c-a360f5c7d1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:21.715027 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92942b9-d1ee-40ad-896c-a360f5c7d1ec admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:21.715312 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92942b9-d1ee-40ad-896c-a360f5c7d1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:21.715591 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92942b9-d1ee-40ad-896c-a360f5c7d1ec admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:21.716244 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92942b9-d1ee-40ad-896c-a360f5c7d1ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:21.720788 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a1c1c-0a55-4792-b701-32e7a953e4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:21.721421 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a1c1c-0a55-4792-b701-32e7a953e4c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:21.721738 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a1c1c-0a55-4792-b701-32e7a953e4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:21.722017 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a1c1c-0a55-4792-b701-32e7a953e4c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:21.722656 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347a1c1c-0a55-4792-b701-32e7a953e4c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:21.723473 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92942b9-d1ee-40ad-896c-a360f5c7d1ec admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:21.724714 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347a1c1c-0a55-4792-b701-32e7a953e4c5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:21.839779 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1014/2046] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:49:21 2022] POST /identity/v3/users => generated 297 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:49:21.843382 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92942b9-d1ee-40ad-896c-a360f5c7d1ec admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:21.854014 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92942b9-d1ee-40ad-896c-a360f5c7d1ec admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:21.858760 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3941f4b-8a9e-44c8-aa68-d012dd975935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:21.859382 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3941f4b-8a9e-44c8-aa68-d012dd975935 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:21.859670 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3941f4b-8a9e-44c8-aa68-d012dd975935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:21.860348 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3941f4b-8a9e-44c8-aa68-d012dd975935 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:21.862655 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3941f4b-8a9e-44c8-aa68-d012dd975935 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:21.863069 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3941f4b-8a9e-44c8-aa68-d012dd975935 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:21.872506 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1033/2047] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:49:21 2022] POST /identity/v3/projects => generated 377 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:49:21.874080 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a1c1c-0a55-4792-b701-32e7a953e4c5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:21.944684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a1c1c-0a55-4792-b701-32e7a953e4c5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:21.950027 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684852ee-1d00-4903-86bd-c0e7b79dbb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:21.950637 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684852ee-1d00-4903-86bd-c0e7b79dbb0a admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:21.950918 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684852ee-1d00-4903-86bd-c0e7b79dbb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:21.951190 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684852ee-1d00-4903-86bd-c0e7b79dbb0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:21.951830 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684852ee-1d00-4903-86bd-c0e7b79dbb0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:21.953436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684852ee-1d00-4903-86bd-c0e7b79dbb0a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:21.963350 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1034/2048] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:49:21.964223 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684852ee-1d00-4903-86bd-c0e7b79dbb0a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:21.974623 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684852ee-1d00-4903-86bd-c0e7b79dbb0a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:21.982498 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1103a8-1d9a-47b7-b439-c6dcf2f34e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:21.982498 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1103a8-1d9a-47b7-b439-c6dcf2f34e15 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:21.982498 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1103a8-1d9a-47b7-b439-c6dcf2f34e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:21.982498 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1103a8-1d9a-47b7-b439-c6dcf2f34e15 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:21.982894 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1103a8-1d9a-47b7-b439-c6dcf2f34e15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:21.984147 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1103a8-1d9a-47b7-b439-c6dcf2f34e15 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:22.026777 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1015/2049] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:49:21 2022] POST /identity/v3/projects => generated 377 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:49:22.026777 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3941f4b-8a9e-44c8-aa68-d012dd975935 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:22.091412 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3941f4b-8a9e-44c8-aa68-d012dd975935 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:22.099945 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa5388d-98ee-454e-8bef-b0afa5a9e4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:22.100564 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5388d-98ee-454e-8bef-b0afa5a9e4b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:22.100870 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5388d-98ee-454e-8bef-b0afa5a9e4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:22.101101 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5388d-98ee-454e-8bef-b0afa5a9e4b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:22.101975 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa5388d-98ee-454e-8bef-b0afa5a9e4b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:22.105430 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1035/2050] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:49:21 2022] POST /identity/v3/users => generated 289 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:49:22.105430 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1103a8-1d9a-47b7-b439-c6dcf2f34e15 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:22.105857 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa5388d-98ee-454e-8bef-b0afa5a9e4b6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:22.114162 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1103a8-1d9a-47b7-b439-c6dcf2f34e15 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:22.119240 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1016/2051] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:49:22.119240 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa5388d-98ee-454e-8bef-b0afa5a9e4b6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:22.129921 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa5388d-98ee-454e-8bef-b0afa5a9e4b6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:22.135393 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc77d39-d610-4002-b395-875d37518bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:22.135825 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc77d39-d610-4002-b395-875d37518bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:22.136109 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc77d39-d610-4002-b395-875d37518bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:22.136647 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc77d39-d610-4002-b395-875d37518bb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:22.137029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc77d39-d610-4002-b395-875d37518bb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:22.138939 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc77d39-d610-4002-b395-875d37518bb7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:22.145286 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715cc856-c5fb-4b04-bd24-7a9dcdb1abb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:22.151296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715cc856-c5fb-4b04-bd24-7a9dcdb1abb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:22.151296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715cc856-c5fb-4b04-bd24-7a9dcdb1abb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:22.151296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715cc856-c5fb-4b04-bd24-7a9dcdb1abb4 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:22.151296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715cc856-c5fb-4b04-bd24-7a9dcdb1abb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:22.151296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715cc856-c5fb-4b04-bd24-7a9dcdb1abb4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:22.151656 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1017/2052] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:49:22.151656 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc77d39-d610-4002-b395-875d37518bb7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:22.161931 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc77d39-d610-4002-b395-875d37518bb7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:22.170369 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad11e04-0373-4069-9cae-6209591f9a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:22.171092 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad11e04-0373-4069-9cae-6209591f9a81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:22.171365 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad11e04-0373-4069-9cae-6209591f9a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:22.171640 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad11e04-0373-4069-9cae-6209591f9a81 admin admin] PATH_INFO: `/v3/projects/4746d3cf9df74697a7d92f42ade5363d/users/88532079079a4976ad5b51dda910f3e7/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:22.190554 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad11e04-0373-4069-9cae-6209591f9a81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4746d3cf9df74697a7d92f42ade5363d, user_id=88532079079a4976ad5b51dda910f3e7, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:22.194042 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad11e04-0373-4069-9cae-6209591f9a81 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:22.266180 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1036/2053] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:49:22 2022] POST /identity/v3/users => generated 295 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:49:22.267266 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715cc856-c5fb-4b04-bd24-7a9dcdb1abb4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:22.277224 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715cc856-c5fb-4b04-bd24-7a9dcdb1abb4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:22.282753 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9899cb-86e3-4592-a437-4f2c3dbc483d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:22.283507 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9899cb-86e3-4592-a437-4f2c3dbc483d admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:22.283791 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9899cb-86e3-4592-a437-4f2c3dbc483d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:22.284064 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9899cb-86e3-4592-a437-4f2c3dbc483d admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:22.284712 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9899cb-86e3-4592-a437-4f2c3dbc483d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:22.286365 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9899cb-86e3-4592-a437-4f2c3dbc483d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:22.297785 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1037/2054] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:49:22.300208 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1018/2055] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:49:22 2022] PUT /identity/v3/projects/4746d3cf9df74697a7d92f42ade5363d/users/88532079079a4976ad5b51dda910f3e7/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:22.300337 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9899cb-86e3-4592-a437-4f2c3dbc483d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:22.305427 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad11e04-0373-4069-9cae-6209591f9a81 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:22.327291 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9899cb-86e3-4592-a437-4f2c3dbc483d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:22.404698 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:22.420136 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ce109-2c6d-410d-a046-46367dabd82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:22.421844 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ce109-2c6d-410d-a046-46367dabd82f admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:22.422216 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ce109-2c6d-410d-a046-46367dabd82f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:22.422581 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ce109-2c6d-410d-a046-46367dabd82f admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:22.423557 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ce109-2c6d-410d-a046-46367dabd82f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:22.425544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ce109-2c6d-410d-a046-46367dabd82f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:22.457671 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1038/2056] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:49:22.457671 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b5807-20f8-4bb8-9b6c-542fe72ee45f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:22.457984 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b5807-20f8-4bb8-9b6c-542fe72ee45f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:22.458269 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b5807-20f8-4bb8-9b6c-542fe72ee45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:22.486763 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6c9b5807-20f8-4bb8-9b6c-542fe72ee45f None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:22.487994 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6c9b5807-20f8-4bb8-9b6c-542fe72ee45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:22.488742 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad11e04-0373-4069-9cae-6209591f9a81 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:22.495076 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4ce22-0e34-4b9c-bdbc-321abc141c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:22.496152 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4ce22-0e34-4b9c-bdbc-321abc141c04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:22.496537 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4ce22-0e34-4b9c-bdbc-321abc141c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:22.496978 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4ce22-0e34-4b9c-bdbc-321abc141c04 admin admin] PATH_INFO: `/v3/projects/542c88e5c3864c75aa970d2b52364bad/users/18a6ce50e1914cca946d91fc862f21af/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:22.502214 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1039/2057] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:22.502893 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b5807-20f8-4bb8-9b6c-542fe72ee45f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:22.514049 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:22.519777 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4ce22-0e34-4b9c-bdbc-321abc141c04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=542c88e5c3864c75aa970d2b52364bad, user_id=18a6ce50e1914cca946d91fc862f21af, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:22.523819 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4ce22-0e34-4b9c-bdbc-321abc141c04 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:22.523928 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b5807-20f8-4bb8-9b6c-542fe72ee45f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:22.529526 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553905a-9802-4f4b-8748-54997416c6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:22.530360 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553905a-9802-4f4b-8748-54997416c6b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:22.530756 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553905a-9802-4f4b-8748-54997416c6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:22.531035 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553905a-9802-4f4b-8748-54997416c6b1 admin admin] PATH_INFO: `/v3/projects/18bae2f09a7a4b2fa8d32d37f59d1a3e/users/395c7b4b34954df79d60cbaf5ea42156/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:22.561868 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553905a-9802-4f4b-8748-54997416c6b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18bae2f09a7a4b2fa8d32d37f59d1a3e, user_id=395c7b4b34954df79d60cbaf5ea42156, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:22.561868 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553905a-9802-4f4b-8748-54997416c6b1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:22.620114 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1019/2058] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:49:22 2022] PUT /identity/v3/projects/542c88e5c3864c75aa970d2b52364bad/users/18a6ce50e1914cca946d91fc862f21af/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:22.620877 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4ce22-0e34-4b9c-bdbc-321abc141c04 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:22.622540 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bde4ce22-0e34-4b9c-bdbc-321abc141c04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:22.676810 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1040/2059] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:49:22 2022] PUT /identity/v3/projects/18bae2f09a7a4b2fa8d32d37f59d1a3e/users/395c7b4b34954df79d60cbaf5ea42156/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:22.678684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf36f4-9490-4dfa-8b61-7c2adcb1e49d None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:22.679104 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf36f4-9490-4dfa-8b61-7c2adcb1e49d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:22.679384 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf36f4-9490-4dfa-8b61-7c2adcb1e49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:22.689308 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4ce22-0e34-4b9c-bdbc-321abc141c04 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:22.715409 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1fcf36f4-9490-4dfa-8b61-7c2adcb1e49d None None] MFA Rules not processed for user `18a6ce50e1914cca946d91fc862f21af`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:22.716630 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1fcf36f4-9490-4dfa-8b61-7c2adcb1e49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:22.748635 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd98e2-0b54-4875-bbb4-d43dc2265f6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:22.749561 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd98e2-0b54-4875-bbb4-d43dc2265f6d service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:22.750173 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd98e2-0b54-4875-bbb4-d43dc2265f6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:22.750613 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd98e2-0b54-4875-bbb4-d43dc2265f6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:22.785859 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1041/2060] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:22.787017 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf36f4-9490-4dfa-8b61-7c2adcb1e49d None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:22.816118 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd98e2-0b54-4875-bbb4-d43dc2265f6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:22.817836 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd98e2-0b54-4875-bbb4-d43dc2265f6d service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:22.829607 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1020/2061] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:49:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:49:22.830427 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd98e2-0b54-4875-bbb4-d43dc2265f6d service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:22.840198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd98e2-0b54-4875-bbb4-d43dc2265f6d service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:22.848313 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ab958-a6e4-42fb-a92d-2d1a6db40c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:22.848981 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ab958-a6e4-42fb-a92d-2d1a6db40c5c admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:22.849326 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ab958-a6e4-42fb-a92d-2d1a6db40c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:22.849607 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ab958-a6e4-42fb-a92d-2d1a6db40c5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:22.850362 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ab958-a6e4-42fb-a92d-2d1a6db40c5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:22.852566 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ab958-a6e4-42fb-a92d-2d1a6db40c5c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:22.878479 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf36f4-9490-4dfa-8b61-7c2adcb1e49d None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:22.883940 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8cb09-11d7-4454-ae50-9e13058e64d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:22.884596 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8cb09-11d7-4454-ae50-9e13058e64d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:22.884874 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8cb09-11d7-4454-ae50-9e13058e64d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:22.885146 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8cb09-11d7-4454-ae50-9e13058e64d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:22.885923 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8cb09-11d7-4454-ae50-9e13058e64d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:22.889177 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8cb09-11d7-4454-ae50-9e13058e64d4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:22.901022 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1042/2062] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:49:22.902072 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8cb09-11d7-4454-ae50-9e13058e64d4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:22.912029 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8cb09-11d7-4454-ae50-9e13058e64d4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:22.916822 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bbf1d-3dca-4410-afbc-33eed87a3021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:22.917452 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bbf1d-3dca-4410-afbc-33eed87a3021 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:22.917760 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bbf1d-3dca-4410-afbc-33eed87a3021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:22.918033 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bbf1d-3dca-4410-afbc-33eed87a3021 admin admin] PATH_INFO: `/v3/projects/18bae2f09a7a4b2fa8d32d37f59d1a3e/users/395c7b4b34954df79d60cbaf5ea42156/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:22.919933 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045bbf1d-3dca-4410-afbc-33eed87a3021 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18bae2f09a7a4b2fa8d32d37f59d1a3e, user_id=395c7b4b34954df79d60cbaf5ea42156, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:22.922626 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045bbf1d-3dca-4410-afbc-33eed87a3021 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:22.933256 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1043/2063] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:49:22 2022] PUT /identity/v3/projects/18bae2f09a7a4b2fa8d32d37f59d1a3e/users/395c7b4b34954df79d60cbaf5ea42156/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:22.944550 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5a5d2-40e1-4185-abe9-d292a6ce56d6 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:22.944833 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5a5d2-40e1-4185-abe9-d292a6ce56d6 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:22.945126 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5a5d2-40e1-4185-abe9-d292a6ce56d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:22.972084 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2ee5a5d2-40e1-4185-abe9-d292a6ce56d6 None None] MFA Rules not processed for user `395c7b4b34954df79d60cbaf5ea42156`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:22.973431 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2ee5a5d2-40e1-4185-abe9-d292a6ce56d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:23.042164 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1044/2064] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:49:23.053582 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee5a5d2-40e1-4185-abe9-d292a6ce56d6 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:23.054962 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2ee5a5d2-40e1-4185-abe9-d292a6ce56d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:23.102911 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1021/2065] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:49:22 2022] POST /identity/v3/projects => generated 377 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:49:23.110673 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ab958-a6e4-42fb-a92d-2d1a6db40c5c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:23.116132 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee5a5d2-40e1-4185-abe9-d292a6ce56d6 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:23.187964 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8fd8b1-5fe7-4a42-897d-d0c57d989ec7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:23.188576 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fd8b1-5fe7-4a42-897d-d0c57d989ec7 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:23.188899 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fd8b1-5fe7-4a42-897d-d0c57d989ec7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:23.189118 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fd8b1-5fe7-4a42-897d-d0c57d989ec7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:23.191159 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ab958-a6e4-42fb-a92d-2d1a6db40c5c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:23.199049 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1990af-ce64-412b-b873-1ed94febdf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:23.199952 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1990af-ce64-412b-b873-1ed94febdf73 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:23.200402 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1990af-ce64-412b-b873-1ed94febdf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:23.200985 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1990af-ce64-412b-b873-1ed94febdf73 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:23.202214 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1990af-ce64-412b-b873-1ed94febdf73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:23.204701 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1990af-ce64-412b-b873-1ed94febdf73 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:23.253274 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8fd8b1-5fe7-4a42-897d-d0c57d989ec7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:23.254751 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8fd8b1-5fe7-4a42-897d-d0c57d989ec7 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:23.264209 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1045/2066] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:49:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:49:23.319712 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1022/2067] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:49:23 2022] POST /identity/v3/users => generated 295 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:49:23.324119 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8fd8b1-5fe7-4a42-897d-d0c57d989ec7 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:23.336557 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8fd8b1-5fe7-4a42-897d-d0c57d989ec7 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:23.341862 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef4195-7a0e-406a-b1dd-9bde775cd87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:23.342464 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef4195-7a0e-406a-b1dd-9bde775cd87b admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:23.342796 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef4195-7a0e-406a-b1dd-9bde775cd87b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:23.343073 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef4195-7a0e-406a-b1dd-9bde775cd87b admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:23.343706 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef4195-7a0e-406a-b1dd-9bde775cd87b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:23.345424 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef4195-7a0e-406a-b1dd-9bde775cd87b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:23.355560 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1046/2068] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:49:23.359979 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1990af-ce64-412b-b873-1ed94febdf73 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:23.370504 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1990af-ce64-412b-b873-1ed94febdf73 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:23.376681 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a88e7-e154-4fdf-82ac-bf6996b93695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:23.377533 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a88e7-e154-4fdf-82ac-bf6996b93695 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:23.377984 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a88e7-e154-4fdf-82ac-bf6996b93695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:23.378399 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a88e7-e154-4fdf-82ac-bf6996b93695 admin admin] PATH_INFO: `/v3/projects/acd0658036364c2796f000741df5ba5a/users/370d30c208894890b065ee6c8cec20d7/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:23.398272 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a88e7-e154-4fdf-82ac-bf6996b93695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acd0658036364c2796f000741df5ba5a, user_id=370d30c208894890b065ee6c8cec20d7, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:23.401223 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a88e7-e154-4fdf-82ac-bf6996b93695 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:23.677589 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1023/2069] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:49:23 2022] PUT /identity/v3/projects/acd0658036364c2796f000741df5ba5a/users/370d30c208894890b065ee6c8cec20d7/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:49:23.677787 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef4195-7a0e-406a-b1dd-9bde775cd87b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:23.688134 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef4195-7a0e-406a-b1dd-9bde775cd87b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:23.759197 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86000b72-7956-4fba-9328-04a80562fbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:23.759812 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86000b72-7956-4fba-9328-04a80562fbfc admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:23.760098 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86000b72-7956-4fba-9328-04a80562fbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:23.760377 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86000b72-7956-4fba-9328-04a80562fbfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:23.761021 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86000b72-7956-4fba-9328-04a80562fbfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:23.762672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86000b72-7956-4fba-9328-04a80562fbfc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:23.772638 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1047/2070] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:49:23.777100 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a88e7-e154-4fdf-82ac-bf6996b93695 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:23.790149 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a88e7-e154-4fdf-82ac-bf6996b93695 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:23.794841 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44c56c-6763-49f0-a18b-7ccb293a917a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:23.795540 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44c56c-6763-49f0-a18b-7ccb293a917a admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:23.795817 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44c56c-6763-49f0-a18b-7ccb293a917a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:23.796091 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44c56c-6763-49f0-a18b-7ccb293a917a admin admin] PATH_INFO: `/v3/projects/acd0658036364c2796f000741df5ba5a/users/370d30c208894890b065ee6c8cec20d7/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:23.798115 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44c56c-6763-49f0-a18b-7ccb293a917a admin admin] RBAC: Authorizing `identity:create_grant(project_id=acd0658036364c2796f000741df5ba5a, user_id=370d30c208894890b065ee6c8cec20d7, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:23.800749 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44c56c-6763-49f0-a18b-7ccb293a917a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:23.814292 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1024/2071] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:49:23 2022] PUT /identity/v3/projects/acd0658036364c2796f000741df5ba5a/users/370d30c208894890b065ee6c8cec20d7/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:23.825018 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698bbd4-9622-4610-a16d-7e8a4b5ca41c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:23.825968 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698bbd4-9622-4610-a16d-7e8a4b5ca41c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:23.826390 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698bbd4-9622-4610-a16d-7e8a4b5ca41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:23.854451 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d698bbd4-9622-4610-a16d-7e8a4b5ca41c None None] MFA Rules not processed for user `370d30c208894890b065ee6c8cec20d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:23.855730 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d698bbd4-9622-4610-a16d-7e8a4b5ca41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:23.936779 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1048/2072] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:23 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:23.981946 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44c56c-6763-49f0-a18b-7ccb293a917a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:23.983654 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1e44c56c-6763-49f0-a18b-7ccb293a917a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:24.043783 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44c56c-6763-49f0-a18b-7ccb293a917a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:24.047877 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa3714-2630-44ac-bdcf-10ed5948d427 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:24.048531 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa3714-2630-44ac-bdcf-10ed5948d427 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:24.048815 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa3714-2630-44ac-bdcf-10ed5948d427 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:24.049091 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa3714-2630-44ac-bdcf-10ed5948d427 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:24.059245 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa3714-2630-44ac-bdcf-10ed5948d427 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:24.060873 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa3714-2630-44ac-bdcf-10ed5948d427 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:24.070745 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1025/2073] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:49:23 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:49:24.224876 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698bbd4-9622-4610-a16d-7e8a4b5ca41c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:24.234382 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698bbd4-9622-4610-a16d-7e8a4b5ca41c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:24.238001 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe9fa5-1abb-49e0-a8ab-f9119592fe28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:24.238603 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe9fa5-1abb-49e0-a8ab-f9119592fe28 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:24.238877 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe9fa5-1abb-49e0-a8ab-f9119592fe28 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:24.239147 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe9fa5-1abb-49e0-a8ab-f9119592fe28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:24.293880 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe9fa5-1abb-49e0-a8ab-f9119592fe28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:24.295350 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe9fa5-1abb-49e0-a8ab-f9119592fe28 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:24.309064 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1049/2074] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:49:24 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:49:24.574389 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:24.656201 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:27.200346 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:27.304501 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa3714-2630-44ac-bdcf-10ed5948d427 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:27.314224 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa3714-2630-44ac-bdcf-10ed5948d427 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:27.318626 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6084e-a1f3-4b4d-961c-9d0de7457322 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:27.320095 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6084e-a1f3-4b4d-961c-9d0de7457322 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:27.320095 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6084e-a1f3-4b4d-961c-9d0de7457322 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:27.320095 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6084e-a1f3-4b4d-961c-9d0de7457322 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:27.396346 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6084e-a1f3-4b4d-961c-9d0de7457322 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:27.400576 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6084e-a1f3-4b4d-961c-9d0de7457322 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:27.409168 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1026/2075] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:49:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:49:28.272695 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:28.314027 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:29.658197 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe9fa5-1abb-49e0-a8ab-f9119592fe28 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:29.663193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-95fe9fa5-1abb-49e0-a8ab-f9119592fe28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:29.796830 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe9fa5-1abb-49e0-a8ab-f9119592fe28 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:29.807324 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bad854-a8d6-411e-ba42-ce233a7c61d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:29.808523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bad854-a8d6-411e-ba42-ce233a7c61d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:29.808965 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bad854-a8d6-411e-ba42-ce233a7c61d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:29.809475 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bad854-a8d6-411e-ba42-ce233a7c61d7 admin admin] PATH_INFO: `/v3/users/c52f6b9367084c188adf8a1ae6bae48d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:29.811836 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bad854-a8d6-411e-ba42-ce233a7c61d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c52f6b9367084c188adf8a1ae6bae48d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:29.815161 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bad854-a8d6-411e-ba42-ce233a7c61d7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:30.050066 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6084e-a1f3-4b4d-961c-9d0de7457322 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:30.061795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6084e-a1f3-4b4d-961c-9d0de7457322 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:30.087159 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec5b87-934d-434e-9857-4272cefa61bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:30.089739 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec5b87-934d-434e-9857-4272cefa61bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:30.090111 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec5b87-934d-434e-9857-4272cefa61bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:30.091554 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec5b87-934d-434e-9857-4272cefa61bd admin admin] PATH_INFO: `/v3/users/23ff8e38d6ec40b6888ed571a3ef5a3e` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:30.095098 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec5b87-934d-434e-9857-4272cefa61bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=23ff8e38d6ec40b6888ed571a3ef5a3e)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:30.097186 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec5b87-934d-434e-9857-4272cefa61bd admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:30.262916 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-30bad854-a8d6-411e-ba42-ce233a7c61d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c52f6b9367084c188adf8a1ae6bae48d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:30.263903 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-30bad854-a8d6-411e-ba42-ce233a7c61d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c52f6b9367084c188adf8a1ae6bae48d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:30.283027 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-30bad854-a8d6-411e-ba42-ce233a7c61d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c52f6b9367084c188adf8a1ae6bae48d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:30.306402 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-30bad854-a8d6-411e-ba42-ce233a7c61d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c52f6b9367084c188adf8a1ae6bae48d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:30.310502 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-30bad854-a8d6-411e-ba42-ce233a7c61d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c52f6b9367084c188adf8a1ae6bae48d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:30.409302 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1050/2076] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:49:29 2022] DELETE /identity/v3/users/c52f6b9367084c188adf8a1ae6bae48d => generated 0 bytes in 751 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:30.414280 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ca7cb-4af7-4343-b42b-9ee6b8e0f118 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:30.414891 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ca7cb-4af7-4343-b42b-9ee6b8e0f118 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:30.415702 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ca7cb-4af7-4343-b42b-9ee6b8e0f118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:30.432750 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-12ec5b87-934d-434e-9857-4272cefa61bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23ff8e38d6ec40b6888ed571a3ef5a3e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:30.434345 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-12ec5b87-934d-434e-9857-4272cefa61bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23ff8e38d6ec40b6888ed571a3ef5a3e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:30.458323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-12ec5b87-934d-434e-9857-4272cefa61bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23ff8e38d6ec40b6888ed571a3ef5a3e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:30.474917 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-380ca7cb-4af7-4343-b42b-9ee6b8e0f118 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:30.476310 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-380ca7cb-4af7-4343-b42b-9ee6b8e0f118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:30.495561 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-12ec5b87-934d-434e-9857-4272cefa61bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23ff8e38d6ec40b6888ed571a3ef5a3e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:30.496537 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-12ec5b87-934d-434e-9857-4272cefa61bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23ff8e38d6ec40b6888ed571a3ef5a3e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:30.572444 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1051/2077] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:30.572444 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7c9fe-c3ad-47eb-a1a2-5474acf3ca4a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:30.572444 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7c9fe-c3ad-47eb-a1a2-5474acf3ca4a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:30.572444 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7c9fe-c3ad-47eb-a1a2-5474acf3ca4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:30.606750 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ead7c9fe-c3ad-47eb-a1a2-5474acf3ca4a None None] MFA Rules not processed for user `88532079079a4976ad5b51dda910f3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:30.608013 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ead7c9fe-c3ad-47eb-a1a2-5474acf3ca4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:30.619810 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1027/2078] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:49:30 2022] DELETE /identity/v3/users/23ff8e38d6ec40b6888ed571a3ef5a3e => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:30.620735 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec5b87-934d-434e-9857-4272cefa61bd admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:30.623149 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-12ec5b87-934d-434e-9857-4272cefa61bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:30.718090 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec5b87-934d-434e-9857-4272cefa61bd admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:30.719334 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1052/2079] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:30 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:30.729968 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7accf5-f853-457a-99c0-f0ff0a63b681 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:30.729968 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7accf5-f853-457a-99c0-f0ff0a63b681 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:30.729968 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7accf5-f853-457a-99c0-f0ff0a63b681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:30.730212 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87cb64-1282-4fda-bdde-785fae3a428d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:30.730212 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87cb64-1282-4fda-bdde-785fae3a428d service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:30.730212 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87cb64-1282-4fda-bdde-785fae3a428d service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:30.730212 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87cb64-1282-4fda-bdde-785fae3a428d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:30.737487 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:30.749776 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6c7accf5-f853-457a-99c0-f0ff0a63b681 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:30.751171 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6c7accf5-f853-457a-99c0-f0ff0a63b681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:30.798845 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:30.820716 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87cb64-1282-4fda-bdde-785fae3a428d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:30.822338 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87cb64-1282-4fda-bdde-785fae3a428d service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:30.833379 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1053/2080] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:30.835209 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1028/2081] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:49:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:49:30.835687 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc8c01-4c10-41dd-ad05-43240745f5f4 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:30.835978 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc8c01-4c10-41dd-ad05-43240745f5f4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:30.836262 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc8c01-4c10-41dd-ad05-43240745f5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:30.845872 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87cb64-1282-4fda-bdde-785fae3a428d service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:30.846699 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1c87cb64-1282-4fda-bdde-785fae3a428d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:30.860582 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87cb64-1282-4fda-bdde-785fae3a428d service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:30.865755 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a5cc8c01-4c10-41dd-ad05-43240745f5f4 None None] MFA Rules not processed for user `88532079079a4976ad5b51dda910f3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:30.865982 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c12d52-f7ea-4be2-9a74-c1844dca2ff4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:30.866611 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c12d52-f7ea-4be2-9a74-c1844dca2ff4 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:30.866889 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c12d52-f7ea-4be2-9a74-c1844dca2ff4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:30.867160 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c12d52-f7ea-4be2-9a74-c1844dca2ff4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:30.867899 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a5cc8c01-4c10-41dd-ad05-43240745f5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:30.884168 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c12d52-f7ea-4be2-9a74-c1844dca2ff4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:30.889042 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c12d52-f7ea-4be2-9a74-c1844dca2ff4 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:30.903330 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1029/2082] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:49:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:49:30.941073 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1054/2083] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:30 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:30.953005 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c12d52-f7ea-4be2-9a74-c1844dca2ff4 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:30.954883 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a1c12d52-f7ea-4be2-9a74-c1844dca2ff4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:31.042170 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c12d52-f7ea-4be2-9a74-c1844dca2ff4 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:31.047873 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25881699-ddd1-40ad-a91e-9f043e87864c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:31.048498 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25881699-ddd1-40ad-a91e-9f043e87864c service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:31.048806 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25881699-ddd1-40ad-a91e-9f043e87864c service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:31.049072 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25881699-ddd1-40ad-a91e-9f043e87864c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:31.058477 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25881699-ddd1-40ad-a91e-9f043e87864c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:31.060468 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25881699-ddd1-40ad-a91e-9f043e87864c service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:31.070600 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1030/2084] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:49:30 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:49:31.606362 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc8c01-4c10-41dd-ad05-43240745f5f4 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:31.608447 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a5cc8c01-4c10-41dd-ad05-43240745f5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:31.635944 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc8c01-4c10-41dd-ad05-43240745f5f4 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:31.641196 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e75fcf-4dca-46d7-a773-448c64ed7f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:31.641999 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e75fcf-4dca-46d7-a773-448c64ed7f4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:31.642305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e75fcf-4dca-46d7-a773-448c64ed7f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:31.643577 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e75fcf-4dca-46d7-a773-448c64ed7f4d admin admin] PATH_INFO: `/v3/projects/8164452d003b4800973e527f52f190f0` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:31.644929 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e75fcf-4dca-46d7-a773-448c64ed7f4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8164452d003b4800973e527f52f190f0)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:31.647983 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e75fcf-4dca-46d7-a773-448c64ed7f4d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:31.767222 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25881699-ddd1-40ad-a91e-9f043e87864c service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:31.770250 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-25881699-ddd1-40ad-a91e-9f043e87864c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:31.815560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25881699-ddd1-40ad-a91e-9f043e87864c service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:31.817507 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e2e75fcf-4dca-46d7-a773-448c64ed7f4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8164452d003b4800973e527f52f190f0', 'request_id': 'req-e2e75fcf-4dca-46d7-a773-448c64ed7f4d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:31.910102 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e2e75fcf-4dca-46d7-a773-448c64ed7f4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8164452d003b4800973e527f52f190f0', 'request_id': 'req-e2e75fcf-4dca-46d7-a773-448c64ed7f4d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:31.923753 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e2e75fcf-4dca-46d7-a773-448c64ed7f4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8164452d003b4800973e527f52f190f0', 'request_id': 'req-e2e75fcf-4dca-46d7-a773-448c64ed7f4d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:31.938349 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503c99d8-8c55-4f39-b7cb-689b4506db85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:31.939584 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c99d8-8c55-4f39-b7cb-689b4506db85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:31.940356 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c99d8-8c55-4f39-b7cb-689b4506db85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:31.940821 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c99d8-8c55-4f39-b7cb-689b4506db85 admin admin] PATH_INFO: `/v3/projects/0b128e2fa34a48ae8c0b74b669f7bbf1` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:31.944215 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503c99d8-8c55-4f39-b7cb-689b4506db85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b128e2fa34a48ae8c0b74b669f7bbf1)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:31.951318 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503c99d8-8c55-4f39-b7cb-689b4506db85 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:31.953660 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e2e75fcf-4dca-46d7-a773-448c64ed7f4d admin admin] The token cache is being invalidate because project 8164452d003b4800973e527f52f190f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:49:31.954780 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e2e75fcf-4dca-46d7-a773-448c64ed7f4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:31.956256 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e2e75fcf-4dca-46d7-a773-448c64ed7f4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:31.958434 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1055/2085] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:49:31 2022] DELETE /identity/v3/projects/8164452d003b4800973e527f52f190f0 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:31.962973 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e75fcf-4dca-46d7-a773-448c64ed7f4d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:31.965798 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e2e75fcf-4dca-46d7-a773-448c64ed7f4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:32.003360 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e75fcf-4dca-46d7-a773-448c64ed7f4d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:32.013445 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b138c79-cf17-4c54-aab2-111b100704c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:32.014288 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b138c79-cf17-4c54-aab2-111b100704c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:32.014573 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b138c79-cf17-4c54-aab2-111b100704c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:32.014853 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b138c79-cf17-4c54-aab2-111b100704c4 admin admin] PATH_INFO: `/v3/users/18a6ce50e1914cca946d91fc862f21af` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:32.016103 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b138c79-cf17-4c54-aab2-111b100704c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18a6ce50e1914cca946d91fc862f21af)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:32.018639 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b138c79-cf17-4c54-aab2-111b100704c4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:32.267785 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4b138c79-cf17-4c54-aab2-111b100704c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18a6ce50e1914cca946d91fc862f21af'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:32.269103 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4b138c79-cf17-4c54-aab2-111b100704c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18a6ce50e1914cca946d91fc862f21af'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:32.272257 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-503c99d8-8c55-4f39-b7cb-689b4506db85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b128e2fa34a48ae8c0b74b669f7bbf1', 'request_id': 'req-503c99d8-8c55-4f39-b7cb-689b4506db85'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:32.283126 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4b138c79-cf17-4c54-aab2-111b100704c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18a6ce50e1914cca946d91fc862f21af'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:32.299193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4b138c79-cf17-4c54-aab2-111b100704c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18a6ce50e1914cca946d91fc862f21af'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:32.299917 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4b138c79-cf17-4c54-aab2-111b100704c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18a6ce50e1914cca946d91fc862f21af'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:32.385294 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-503c99d8-8c55-4f39-b7cb-689b4506db85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b128e2fa34a48ae8c0b74b669f7bbf1', 'request_id': 'req-503c99d8-8c55-4f39-b7cb-689b4506db85'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:32.409290 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-503c99d8-8c55-4f39-b7cb-689b4506db85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b128e2fa34a48ae8c0b74b669f7bbf1', 'request_id': 'req-503c99d8-8c55-4f39-b7cb-689b4506db85'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:32.430739 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-503c99d8-8c55-4f39-b7cb-689b4506db85 admin admin] The token cache is being invalidate because project 0b128e2fa34a48ae8c0b74b669f7bbf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:49:32.430739 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-503c99d8-8c55-4f39-b7cb-689b4506db85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:32.438305 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-503c99d8-8c55-4f39-b7cb-689b4506db85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:32.439904 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1031/2086] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:49:31 2022] DELETE /identity/v3/projects/0b128e2fa34a48ae8c0b74b669f7bbf1 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:32.441787 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d607298-8ab9-4765-99fd-f8248ba2f6d3 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:32.442299 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d607298-8ab9-4765-99fd-f8248ba2f6d3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:32.442834 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d607298-8ab9-4765-99fd-f8248ba2f6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:32.462978 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2d607298-8ab9-4765-99fd-f8248ba2f6d3 None None] MFA Rules not processed for user `88532079079a4976ad5b51dda910f3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:32.465548 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2d607298-8ab9-4765-99fd-f8248ba2f6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:32.465676 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1056/2087] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:49:31 2022] DELETE /identity/v3/users/18a6ce50e1914cca946d91fc862f21af => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:32.466303 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf4e8e-b422-43a2-9f7c-7dbcdef5796c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:32.466669 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf4e8e-b422-43a2-9f7c-7dbcdef5796c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:32.466950 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf4e8e-b422-43a2-9f7c-7dbcdef5796c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:32.491553 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-86bf4e8e-b422-43a2-9f7c-7dbcdef5796c None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:32.492809 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-86bf4e8e-b422-43a2-9f7c-7dbcdef5796c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:32.546016 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1032/2088] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:32.615753 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95ffcc-9162-45c2-abbc-3304a51435e8 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:32.616218 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95ffcc-9162-45c2-abbc-3304a51435e8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:32.616703 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95ffcc-9162-45c2-abbc-3304a51435e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:32.619252 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1057/2089] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:32.646196 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-da95ffcc-9162-45c2-abbc-3304a51435e8 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:32.647893 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-da95ffcc-9162-45c2-abbc-3304a51435e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:32.663508 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1033/2090] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:32.666761 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf4e8e-b422-43a2-9f7c-7dbcdef5796c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:32.680331 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf4e8e-b422-43a2-9f7c-7dbcdef5796c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:32.687139 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127ace9-e1fd-4ce7-ad84-0ec0f411adc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:32.687822 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127ace9-e1fd-4ce7-ad84-0ec0f411adc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:32.688192 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127ace9-e1fd-4ce7-ad84-0ec0f411adc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:32.688534 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127ace9-e1fd-4ce7-ad84-0ec0f411adc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:32.689321 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127ace9-e1fd-4ce7-ad84-0ec0f411adc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:49:32.689847 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127ace9-e1fd-4ce7-ad84-0ec0f411adc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:32.691655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127ace9-e1fd-4ce7-ad84-0ec0f411adc9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:32.709945 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1058/2091] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:49:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:49:32.714064 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95ffcc-9162-45c2-abbc-3304a51435e8 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:32.725540 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95ffcc-9162-45c2-abbc-3304a51435e8 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:32.730958 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f7aeb-511d-4f2d-a963-4fad35da23e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:32.731577 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f7aeb-511d-4f2d-a963-4fad35da23e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:32.731861 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f7aeb-511d-4f2d-a963-4fad35da23e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:32.732236 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f7aeb-511d-4f2d-a963-4fad35da23e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:32.732864 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f7aeb-511d-4f2d-a963-4fad35da23e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:32.735649 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f7aeb-511d-4f2d-a963-4fad35da23e1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:32.757538 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:32.878657 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1034/2092] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:49:32 2022] POST /identity/v3/projects => generated 385 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:49:32.883413 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127ace9-e1fd-4ce7-ad84-0ec0f411adc9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:32.897469 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127ace9-e1fd-4ce7-ad84-0ec0f411adc9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:33.002905 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5508e2-196f-42b3-8623-09a3b9cadb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:33.003518 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5508e2-196f-42b3-8623-09a3b9cadb87 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:33.003964 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5508e2-196f-42b3-8623-09a3b9cadb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:33.004381 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5508e2-196f-42b3-8623-09a3b9cadb87 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:33.006457 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5508e2-196f-42b3-8623-09a3b9cadb87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:33.009499 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5508e2-196f-42b3-8623-09a3b9cadb87 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:33.026016 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f7aeb-511d-4f2d-a963-4fad35da23e1 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:33.026277 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-264f7aeb-511d-4f2d-a963-4fad35da23e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:33.084403 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f7aeb-511d-4f2d-a963-4fad35da23e1 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:33.099846 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e97ca0-fa41-4cdd-97f2-34e9d57800c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:33.100510 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e97ca0-fa41-4cdd-97f2-34e9d57800c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:33.100789 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e97ca0-fa41-4cdd-97f2-34e9d57800c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:33.101064 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e97ca0-fa41-4cdd-97f2-34e9d57800c6 admin admin] PATH_INFO: `/v3/projects/542c88e5c3864c75aa970d2b52364bad` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:33.103053 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e97ca0-fa41-4cdd-97f2-34e9d57800c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=542c88e5c3864c75aa970d2b52364bad)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:33.105124 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e97ca0-fa41-4cdd-97f2-34e9d57800c6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:33.189664 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1059/2093] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:49:32 2022] POST /identity/v3/users => generated 293 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:49:33.189664 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5508e2-196f-42b3-8623-09a3b9cadb87 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:33.192270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5508e2-196f-42b3-8623-09a3b9cadb87 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:33.197652 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17023f01-246a-4465-a6a9-6b31bbe55275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:33.198410 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17023f01-246a-4465-a6a9-6b31bbe55275 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:33.198766 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17023f01-246a-4465-a6a9-6b31bbe55275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:33.199028 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17023f01-246a-4465-a6a9-6b31bbe55275 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:33.199670 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17023f01-246a-4465-a6a9-6b31bbe55275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:33.203775 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17023f01-246a-4465-a6a9-6b31bbe55275 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:33.216673 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1060/2094] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:49:33.220583 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17023f01-246a-4465-a6a9-6b31bbe55275 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:33.246434 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17023f01-246a-4465-a6a9-6b31bbe55275 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:33.265439 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cadf77e-beca-46ee-a3e3-e797261cb2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:33.265439 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cadf77e-beca-46ee-a3e3-e797261cb2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:33.265439 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cadf77e-beca-46ee-a3e3-e797261cb2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:33.265439 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cadf77e-beca-46ee-a3e3-e797261cb2c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:33.265895 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cadf77e-beca-46ee-a3e3-e797261cb2c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:33.265895 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cadf77e-beca-46ee-a3e3-e797261cb2c9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:33.275094 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1061/2095] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:49:33.279900 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cadf77e-beca-46ee-a3e3-e797261cb2c9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:33.311370 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d9e97ca0-fa41-4cdd-97f2-34e9d57800c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '542c88e5c3864c75aa970d2b52364bad', 'request_id': 'req-d9e97ca0-fa41-4cdd-97f2-34e9d57800c6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:33.316175 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cadf77e-beca-46ee-a3e3-e797261cb2c9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:33.381438 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ba0da-290d-4da4-8bdf-c54db9024cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:33.382143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ba0da-290d-4da4-8bdf-c54db9024cd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:33.382427 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ba0da-290d-4da4-8bdf-c54db9024cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:33.382698 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ba0da-290d-4da4-8bdf-c54db9024cd8 admin admin] PATH_INFO: `/v3/projects/d2c39a81769c403d8719be7e6d249425/users/6a43f2c3f9ce47d2bfd4b10c22bc5f50/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:33.404710 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ba0da-290d-4da4-8bdf-c54db9024cd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c39a81769c403d8719be7e6d249425, user_id=6a43f2c3f9ce47d2bfd4b10c22bc5f50, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:33.407416 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ba0da-290d-4da4-8bdf-c54db9024cd8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:33.427663 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d9e97ca0-fa41-4cdd-97f2-34e9d57800c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '542c88e5c3864c75aa970d2b52364bad', 'request_id': 'req-d9e97ca0-fa41-4cdd-97f2-34e9d57800c6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:33.435121 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d9e97ca0-fa41-4cdd-97f2-34e9d57800c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '542c88e5c3864c75aa970d2b52364bad', 'request_id': 'req-d9e97ca0-fa41-4cdd-97f2-34e9d57800c6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:33.477913 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d9e97ca0-fa41-4cdd-97f2-34e9d57800c6 admin admin] The token cache is being invalidate because project 542c88e5c3864c75aa970d2b52364bad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:49:33.477913 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d9e97ca0-fa41-4cdd-97f2-34e9d57800c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:33.477913 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d9e97ca0-fa41-4cdd-97f2-34e9d57800c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:33.477913 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1035/2096] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:49:33 2022] DELETE /identity/v3/projects/542c88e5c3864c75aa970d2b52364bad => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:33.481023 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e97ca0-fa41-4cdd-97f2-34e9d57800c6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:33.482818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d9e97ca0-fa41-4cdd-97f2-34e9d57800c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:33.509078 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1062/2097] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:49:33 2022] PUT /identity/v3/projects/d2c39a81769c403d8719be7e6d249425/users/6a43f2c3f9ce47d2bfd4b10c22bc5f50/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:33.522438 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e97ca0-fa41-4cdd-97f2-34e9d57800c6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:33.535453 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af378a-afe3-4f83-82f2-8f60ce7171dd None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:33.535742 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af378a-afe3-4f83-82f2-8f60ce7171dd None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:33.536022 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af378a-afe3-4f83-82f2-8f60ce7171dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:33.620423 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-23af378a-afe3-4f83-82f2-8f60ce7171dd None None] MFA Rules not processed for user `6a43f2c3f9ce47d2bfd4b10c22bc5f50`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:33.621782 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-23af378a-afe3-4f83-82f2-8f60ce7171dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:33.649115 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7f33d-0ba1-4689-9708-b72a89d2a921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:33.649856 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7f33d-0ba1-4689-9708-b72a89d2a921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:33.650142 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7f33d-0ba1-4689-9708-b72a89d2a921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:33.650468 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7f33d-0ba1-4689-9708-b72a89d2a921 admin admin] PATH_INFO: `/v3/users/370d30c208894890b065ee6c8cec20d7` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:33.651664 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c7f33d-0ba1-4689-9708-b72a89d2a921 admin admin] RBAC: Authorizing `identity:delete_user(user_id=370d30c208894890b065ee6c8cec20d7)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:33.654170 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c7f33d-0ba1-4689-9708-b72a89d2a921 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:33.787269 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1063/2098] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:33.795650 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af378a-afe3-4f83-82f2-8f60ce7171dd None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:33.798377 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-23af378a-afe3-4f83-82f2-8f60ce7171dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:33.864854 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af378a-afe3-4f83-82f2-8f60ce7171dd None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:33.868913 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885b164-2529-492e-a63a-2bd20c9268b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:33.870008 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885b164-2529-492e-a63a-2bd20c9268b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:33.870231 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885b164-2529-492e-a63a-2bd20c9268b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:33.870660 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885b164-2529-492e-a63a-2bd20c9268b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:33.886460 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885b164-2529-492e-a63a-2bd20c9268b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:33.889223 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885b164-2529-492e-a63a-2bd20c9268b0 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:33.916490 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1064/2099] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:49:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:49:34.065260 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-26c7f33d-0ba1-4689-9708-b72a89d2a921 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '370d30c208894890b065ee6c8cec20d7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:34.066588 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-26c7f33d-0ba1-4689-9708-b72a89d2a921 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '370d30c208894890b065ee6c8cec20d7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:34.082003 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-26c7f33d-0ba1-4689-9708-b72a89d2a921 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '370d30c208894890b065ee6c8cec20d7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:34.117167 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-26c7f33d-0ba1-4689-9708-b72a89d2a921 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '370d30c208894890b065ee6c8cec20d7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:34.118792 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-26c7f33d-0ba1-4689-9708-b72a89d2a921 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '370d30c208894890b065ee6c8cec20d7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:34.228681 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1036/2100] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:49:33 2022] DELETE /identity/v3/users/370d30c208894890b065ee6c8cec20d7 => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:49:34.553279 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:34.855949 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885b164-2529-492e-a63a-2bd20c9268b0 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:34.871181 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885b164-2529-492e-a63a-2bd20c9268b0 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:34.986225 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248a8cc-9334-4fb4-b06e-dbec08fda549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:34.988181 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248a8cc-9334-4fb4-b06e-dbec08fda549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:34.988181 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248a8cc-9334-4fb4-b06e-dbec08fda549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:34.988181 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248a8cc-9334-4fb4-b06e-dbec08fda549 admin admin] PATH_INFO: `/v3/projects/acd0658036364c2796f000741df5ba5a` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:34.990984 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248a8cc-9334-4fb4-b06e-dbec08fda549 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acd0658036364c2796f000741df5ba5a)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:34.992981 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248a8cc-9334-4fb4-b06e-dbec08fda549 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:35.190729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2248a8cc-9334-4fb4-b06e-dbec08fda549 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acd0658036364c2796f000741df5ba5a', 'request_id': 'req-2248a8cc-9334-4fb4-b06e-dbec08fda549'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:35.268142 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2248a8cc-9334-4fb4-b06e-dbec08fda549 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acd0658036364c2796f000741df5ba5a', 'request_id': 'req-2248a8cc-9334-4fb4-b06e-dbec08fda549'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:35.278834 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2248a8cc-9334-4fb4-b06e-dbec08fda549 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acd0658036364c2796f000741df5ba5a', 'request_id': 'req-2248a8cc-9334-4fb4-b06e-dbec08fda549'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:35.290919 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2248a8cc-9334-4fb4-b06e-dbec08fda549 admin admin] The token cache is being invalidate because project acd0658036364c2796f000741df5ba5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:49:35.291332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2248a8cc-9334-4fb4-b06e-dbec08fda549 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:35.292196 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2248a8cc-9334-4fb4-b06e-dbec08fda549 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:35.293848 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1065/2101] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:49:34 2022] DELETE /identity/v3/projects/acd0658036364c2796f000741df5ba5a => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:35.299758 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cebae6-7856-4151-9324-710c78e65bdc None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:35.300239 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cebae6-7856-4151-9324-710c78e65bdc None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:35.300316 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cebae6-7856-4151-9324-710c78e65bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:35.324415 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-47cebae6-7856-4151-9324-710c78e65bdc None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:35.325812 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-47cebae6-7856-4151-9324-710c78e65bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:35.416841 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1037/2102] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:35.418808 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbe92a-e3ea-470a-95fe-ba743ef10df9 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:35.419159 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbe92a-e3ea-470a-95fe-ba743ef10df9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:35.419439 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbe92a-e3ea-470a-95fe-ba743ef10df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:35.445482 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-cbcbe92a-e3ea-470a-95fe-ba743ef10df9 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:35.446920 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cbcbe92a-e3ea-470a-95fe-ba743ef10df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:35.456971 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1066/2103] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:35.462747 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cebae6-7856-4151-9324-710c78e65bdc None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:35.474537 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cebae6-7856-4151-9324-710c78e65bdc None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:35.480540 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f8565-cb22-4177-87b0-d2c982d83c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:35.481922 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f8565-cb22-4177-87b0-d2c982d83c11 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:35.482267 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f8565-cb22-4177-87b0-d2c982d83c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:35.482606 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f8565-cb22-4177-87b0-d2c982d83c11 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:35.483447 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f8565-cb22-4177-87b0-d2c982d83c11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:49:35.484179 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f8565-cb22-4177-87b0-d2c982d83c11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:35.485948 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f8565-cb22-4177-87b0-d2c982d83c11 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:35.503158 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1038/2104] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:49:35.508006 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcbe92a-e3ea-470a-95fe-ba743ef10df9 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:35.523356 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcbe92a-e3ea-470a-95fe-ba743ef10df9 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:35.539056 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d5474-f866-4e3a-8ad7-52f21c2699d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:35.539056 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d5474-f866-4e3a-8ad7-52f21c2699d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:35.539056 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d5474-f866-4e3a-8ad7-52f21c2699d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:35.539056 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d5474-f866-4e3a-8ad7-52f21c2699d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:35.540378 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d5474-f866-4e3a-8ad7-52f21c2699d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:35.544881 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d5474-f866-4e3a-8ad7-52f21c2699d2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:35.700803 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1067/2105] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:49:35 2022] POST /identity/v3/projects => generated 373 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:49:35.704933 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f8565-cb22-4177-87b0-d2c982d83c11 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:35.715277 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f8565-cb22-4177-87b0-d2c982d83c11 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:35.800283 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d1246-5c2f-4374-b8d6-08d9b47cd583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:35.803335 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d1246-5c2f-4374-b8d6-08d9b47cd583 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:35.803630 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d1246-5c2f-4374-b8d6-08d9b47cd583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:35.803952 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d1246-5c2f-4374-b8d6-08d9b47cd583 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:35.805228 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d1246-5c2f-4374-b8d6-08d9b47cd583 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:35.808576 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d1246-5c2f-4374-b8d6-08d9b47cd583 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:35.964032 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1039/2106] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:49:35 2022] POST /identity/v3/users => generated 287 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:49:35.964135 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d5474-f866-4e3a-8ad7-52f21c2699d2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:35.974053 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d5474-f866-4e3a-8ad7-52f21c2699d2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:35.982199 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc1085-2c62-4696-8faa-5d2e9f618c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:35.983027 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc1085-2c62-4696-8faa-5d2e9f618c86 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:35.983310 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc1085-2c62-4696-8faa-5d2e9f618c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:35.983582 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc1085-2c62-4696-8faa-5d2e9f618c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:35.984229 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcc1085-2c62-4696-8faa-5d2e9f618c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:35.986105 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcc1085-2c62-4696-8faa-5d2e9f618c86 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:35.999570 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1068/2107] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:49:36.003912 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d1246-5c2f-4374-b8d6-08d9b47cd583 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:36.014921 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d1246-5c2f-4374-b8d6-08d9b47cd583 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:36.022413 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb84c5d-4b28-4573-ba7d-20d3245ebc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:36.023955 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb84c5d-4b28-4573-ba7d-20d3245ebc40 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:36.024231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb84c5d-4b28-4573-ba7d-20d3245ebc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:36.024536 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb84c5d-4b28-4573-ba7d-20d3245ebc40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:36.025386 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb84c5d-4b28-4573-ba7d-20d3245ebc40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:36.027690 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb84c5d-4b28-4573-ba7d-20d3245ebc40 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:36.042879 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1040/2108] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:49:36.046911 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc1085-2c62-4696-8faa-5d2e9f618c86 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:36.059803 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc1085-2c62-4696-8faa-5d2e9f618c86 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:36.066197 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d895b0-bd92-40a4-bd6c-9ed21c9120c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:36.066921 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d895b0-bd92-40a4-bd6c-9ed21c9120c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:36.067201 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d895b0-bd92-40a4-bd6c-9ed21c9120c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:36.067474 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d895b0-bd92-40a4-bd6c-9ed21c9120c8 admin admin] PATH_INFO: `/v3/projects/5a82c8dcc081412d90f1ccabc749f05c/users/66014603adea41d9ba27ec8ffd7f76d8/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:36.086805 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d895b0-bd92-40a4-bd6c-9ed21c9120c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a82c8dcc081412d90f1ccabc749f05c, user_id=66014603adea41d9ba27ec8ffd7f76d8, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:36.094914 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d895b0-bd92-40a4-bd6c-9ed21c9120c8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:36.198936 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1069/2109] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:49:36 2022] PUT /identity/v3/projects/5a82c8dcc081412d90f1ccabc749f05c/users/66014603adea41d9ba27ec8ffd7f76d8/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:36.203938 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fdea9-06ce-4edf-bbe4-e9ca3413e7b7 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:36.204421 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fdea9-06ce-4edf-bbe4-e9ca3413e7b7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:36.204704 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fdea9-06ce-4edf-bbe4-e9ca3413e7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:36.224498 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b37fdea9-06ce-4edf-bbe4-e9ca3413e7b7 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:36.225898 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b37fdea9-06ce-4edf-bbe4-e9ca3413e7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:36.320769 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1041/2110] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:36.331838 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d895b0-bd92-40a4-bd6c-9ed21c9120c8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:36.334615 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-63d895b0-bd92-40a4-bd6c-9ed21c9120c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:36.409884 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d895b0-bd92-40a4-bd6c-9ed21c9120c8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:36.414356 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd2dd2-f2cd-4911-8f8b-b430211e4537 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:36.415173 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd2dd2-f2cd-4911-8f8b-b430211e4537 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:36.415602 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd2dd2-f2cd-4911-8f8b-b430211e4537 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:36.416018 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd2dd2-f2cd-4911-8f8b-b430211e4537 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:36.429142 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd2dd2-f2cd-4911-8f8b-b430211e4537 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:36.430853 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd2dd2-f2cd-4911-8f8b-b430211e4537 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:36.445056 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1070/2111] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:49:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:49:37.025681 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37fdea9-06ce-4edf-bbe4-e9ca3413e7b7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:37.025681 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b37fdea9-06ce-4edf-bbe4-e9ca3413e7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:37.038138 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37fdea9-06ce-4edf-bbe4-e9ca3413e7b7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:37.043610 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b83bed-8f3f-4462-864b-6d30ca90a791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:37.044730 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b83bed-8f3f-4462-864b-6d30ca90a791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:37.045136 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b83bed-8f3f-4462-864b-6d30ca90a791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:37.045416 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b83bed-8f3f-4462-864b-6d30ca90a791 admin admin] PATH_INFO: `/v3/users/87a044269d684270a0808ff76ea31f11` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:37.046804 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b83bed-8f3f-4462-864b-6d30ca90a791 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87a044269d684270a0808ff76ea31f11)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:37.070907 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b83bed-8f3f-4462-864b-6d30ca90a791 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:37.333135 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-73b83bed-8f3f-4462-864b-6d30ca90a791 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87a044269d684270a0808ff76ea31f11'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:37.342387 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-73b83bed-8f3f-4462-864b-6d30ca90a791 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87a044269d684270a0808ff76ea31f11'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:37.357790 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-73b83bed-8f3f-4462-864b-6d30ca90a791 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87a044269d684270a0808ff76ea31f11'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:37.385491 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-73b83bed-8f3f-4462-864b-6d30ca90a791 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87a044269d684270a0808ff76ea31f11'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:37.385491 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-73b83bed-8f3f-4462-864b-6d30ca90a791 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87a044269d684270a0808ff76ea31f11'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:37.486150 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1042/2112] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:49:37 2022] DELETE /identity/v3/users/87a044269d684270a0808ff76ea31f11 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:37.491167 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17427b5d-5f70-4c0f-8d89-25cf808ebf5f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:37.492074 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17427b5d-5f70-4c0f-8d89-25cf808ebf5f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:37.492737 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17427b5d-5f70-4c0f-8d89-25cf808ebf5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:37.528884 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-17427b5d-5f70-4c0f-8d89-25cf808ebf5f None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:37.531244 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-17427b5d-5f70-4c0f-8d89-25cf808ebf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:37.617921 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1071/2113] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:37.631230 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b83bed-8f3f-4462-864b-6d30ca90a791 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:37.632941 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-73b83bed-8f3f-4462-864b-6d30ca90a791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:37.724766 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b83bed-8f3f-4462-864b-6d30ca90a791 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:37.730495 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca41e1-35b1-4d21-8830-7cb5a6dced22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:37.731433 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca41e1-35b1-4d21-8830-7cb5a6dced22 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:37.732908 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:37.734175 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca41e1-35b1-4d21-8830-7cb5a6dced22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:37.744810 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca41e1-35b1-4d21-8830-7cb5a6dced22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:37.746793 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ca41e1-35b1-4d21-8830-7cb5a6dced22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:37.748456 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ca41e1-35b1-4d21-8830-7cb5a6dced22 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:37.761172 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1043/2114] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:49:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:49:38.045435 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:38.471311 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2582c-c10c-4889-9c20-ac1f6e7e9af5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:38.471605 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2582c-c10c-4889-9c20-ac1f6e7e9af5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:38.471887 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2582c-c10c-4889-9c20-ac1f6e7e9af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:38.515719 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-66f2582c-c10c-4889-9c20-ac1f6e7e9af5 None None] MFA Rules not processed for user `66014603adea41d9ba27ec8ffd7f76d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:38.517291 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-66f2582c-c10c-4889-9c20-ac1f6e7e9af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:38.583222 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca41e1-35b1-4d21-8830-7cb5a6dced22 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:38.585174 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-13ca41e1-35b1-4d21-8830-7cb5a6dced22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:38.604918 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1072/2115] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:38.606426 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2582c-c10c-4889-9c20-ac1f6e7e9af5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:38.608062 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-66f2582c-c10c-4889-9c20-ac1f6e7e9af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:38.613834 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca41e1-35b1-4d21-8830-7cb5a6dced22 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:38.621806 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8635a-910f-410b-aebc-6b9f6cf2e6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:38.622509 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8635a-910f-410b-aebc-6b9f6cf2e6e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:38.622799 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8635a-910f-410b-aebc-6b9f6cf2e6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:38.623108 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8635a-910f-410b-aebc-6b9f6cf2e6e9 admin admin] PATH_INFO: `/v3/projects/371621ca79c54e10b67fa637098476a5` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:38.624389 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a8635a-910f-410b-aebc-6b9f6cf2e6e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=371621ca79c54e10b67fa637098476a5)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:38.624897 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2582c-c10c-4889-9c20-ac1f6e7e9af5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:38.626470 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a8635a-910f-410b-aebc-6b9f6cf2e6e9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:38.635044 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61129e-523a-493d-a6ea-500043d875a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:38.635044 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61129e-523a-493d-a6ea-500043d875a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:38.635044 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61129e-523a-493d-a6ea-500043d875a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:38.635044 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61129e-523a-493d-a6ea-500043d875a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:38.635403 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c61129e-523a-493d-a6ea-500043d875a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:38.635403 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c61129e-523a-493d-a6ea-500043d875a6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:38.774804 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1073/2116] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:49:38 2022] POST /identity/v3/projects => generated 373 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:49:38.781038 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61129e-523a-493d-a6ea-500043d875a6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:38.789897 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-11a8635a-910f-410b-aebc-6b9f6cf2e6e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '371621ca79c54e10b67fa637098476a5', 'request_id': 'req-11a8635a-910f-410b-aebc-6b9f6cf2e6e9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:38.847422 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61129e-523a-493d-a6ea-500043d875a6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:38.853186 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbf753-a095-44b1-a3f8-cc8dc520cdd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:38.854172 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbf753-a095-44b1-a3f8-cc8dc520cdd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:38.854457 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbf753-a095-44b1-a3f8-cc8dc520cdd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:38.854766 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbf753-a095-44b1-a3f8-cc8dc520cdd0 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:38.855414 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fbf753-a095-44b1-a3f8-cc8dc520cdd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:38.857473 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fbf753-a095-44b1-a3f8-cc8dc520cdd0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:38.899409 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-11a8635a-910f-410b-aebc-6b9f6cf2e6e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '371621ca79c54e10b67fa637098476a5', 'request_id': 'req-11a8635a-910f-410b-aebc-6b9f6cf2e6e9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:38.910298 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-11a8635a-910f-410b-aebc-6b9f6cf2e6e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '371621ca79c54e10b67fa637098476a5', 'request_id': 'req-11a8635a-910f-410b-aebc-6b9f6cf2e6e9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:38.921136 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-11a8635a-910f-410b-aebc-6b9f6cf2e6e9 admin admin] The token cache is being invalidate because project 371621ca79c54e10b67fa637098476a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:49:38.921443 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-11a8635a-910f-410b-aebc-6b9f6cf2e6e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:38.922147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-11a8635a-910f-410b-aebc-6b9f6cf2e6e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:38.923747 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1044/2117] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:49:38 2022] DELETE /identity/v3/projects/371621ca79c54e10b67fa637098476a5 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:49:38.928495 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8635a-910f-410b-aebc-6b9f6cf2e6e9 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:38.931026 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-11a8635a-910f-410b-aebc-6b9f6cf2e6e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:39.007507 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8635a-910f-410b-aebc-6b9f6cf2e6e9 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:39.012887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf45ad-518a-4237-a106-cb672ae37d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:39.013538 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf45ad-518a-4237-a106-cb672ae37d95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:39.022659 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf45ad-518a-4237-a106-cb672ae37d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:39.022659 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf45ad-518a-4237-a106-cb672ae37d95 admin admin] PATH_INFO: `/v3/users/5d65a89df7a04da3b574a757759ed16a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:39.022659 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf45ad-518a-4237-a106-cb672ae37d95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d65a89df7a04da3b574a757759ed16a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:39.022659 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf45ad-518a-4237-a106-cb672ae37d95 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:39.054182 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1074/2118] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:49:38 2022] POST /identity/v3/users => generated 293 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:49:39.055492 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbf753-a095-44b1-a3f8-cc8dc520cdd0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:39.057415 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b1fbf753-a095-44b1-a3f8-cc8dc520cdd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:39.070085 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbf753-a095-44b1-a3f8-cc8dc520cdd0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:39.074925 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ececb4-3c09-4dd4-9599-d3461ff59cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:39.075562 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ececb4-3c09-4dd4-9599-d3461ff59cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:39.075841 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ececb4-3c09-4dd4-9599-d3461ff59cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:39.076111 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ececb4-3c09-4dd4-9599-d3461ff59cd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:39.076800 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ececb4-3c09-4dd4-9599-d3461ff59cd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:39.078485 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ececb4-3c09-4dd4-9599-d3461ff59cd8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:39.092685 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1075/2119] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:49:39.093973 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ececb4-3c09-4dd4-9599-d3461ff59cd8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:39.105585 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ececb4-3c09-4dd4-9599-d3461ff59cd8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:39.111973 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3bacc-76cb-42ad-9998-2e7de9b98b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:39.112652 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3bacc-76cb-42ad-9998-2e7de9b98b04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:39.112933 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3bacc-76cb-42ad-9998-2e7de9b98b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:39.113210 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3bacc-76cb-42ad-9998-2e7de9b98b04 admin admin] PATH_INFO: `/v3/projects/f87c76e7c86d46108f703a81c8fceb0f/users/fb0fdf3b1d3c48f0b3f4151e66ef15da/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:39.133517 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef3bacc-76cb-42ad-9998-2e7de9b98b04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f87c76e7c86d46108f703a81c8fceb0f, user_id=fb0fdf3b1d3c48f0b3f4151e66ef15da, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:39.133939 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef3bacc-76cb-42ad-9998-2e7de9b98b04 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:39.270809 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1076/2120] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:49:39 2022] PUT /identity/v3/projects/f87c76e7c86d46108f703a81c8fceb0f/users/fb0fdf3b1d3c48f0b3f4151e66ef15da/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:39.274991 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3bacc-76cb-42ad-9998-2e7de9b98b04 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:39.313949 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e9cf45ad-518a-4237-a106-cb672ae37d95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d65a89df7a04da3b574a757759ed16a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:39.314874 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e9cf45ad-518a-4237-a106-cb672ae37d95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d65a89df7a04da3b574a757759ed16a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:39.323291 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e9cf45ad-518a-4237-a106-cb672ae37d95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d65a89df7a04da3b574a757759ed16a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:39.353324 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e9cf45ad-518a-4237-a106-cb672ae37d95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d65a89df7a04da3b574a757759ed16a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:39.354078 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e9cf45ad-518a-4237-a106-cb672ae37d95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d65a89df7a04da3b574a757759ed16a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:39.364109 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3bacc-76cb-42ad-9998-2e7de9b98b04 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:39.375845 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9e993-8f32-4f02-b341-88eb629227bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:39.375845 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9e993-8f32-4f02-b341-88eb629227bf admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:39.375845 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9e993-8f32-4f02-b341-88eb629227bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:39.375845 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9e993-8f32-4f02-b341-88eb629227bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:39.377798 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9e993-8f32-4f02-b341-88eb629227bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:39.379473 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9e993-8f32-4f02-b341-88eb629227bf admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:39.409855 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1077/2121] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:49:39.410845 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9e993-8f32-4f02-b341-88eb629227bf admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:39.413027 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-66a9e993-8f32-4f02-b341-88eb629227bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:39.426097 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9e993-8f32-4f02-b341-88eb629227bf admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:39.430079 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1045/2122] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:49:38 2022] DELETE /identity/v3/users/5d65a89df7a04da3b574a757759ed16a => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:39.431717 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b49a82-d46e-4427-925a-9e5f68c27532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:39.432462 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b49a82-d46e-4427-925a-9e5f68c27532 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:39.432740 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b49a82-d46e-4427-925a-9e5f68c27532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:39.433022 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b49a82-d46e-4427-925a-9e5f68c27532 admin admin] PATH_INFO: `/v3/projects/f87c76e7c86d46108f703a81c8fceb0f/users/fb0fdf3b1d3c48f0b3f4151e66ef15da/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:39.435094 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b49a82-d46e-4427-925a-9e5f68c27532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f87c76e7c86d46108f703a81c8fceb0f, user_id=fb0fdf3b1d3c48f0b3f4151e66ef15da, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:39.437993 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b49a82-d46e-4427-925a-9e5f68c27532 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:39.448847 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1078/2123] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:49:39 2022] PUT /identity/v3/projects/f87c76e7c86d46108f703a81c8fceb0f/users/fb0fdf3b1d3c48f0b3f4151e66ef15da/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:40.321765 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf45ad-518a-4237-a106-cb672ae37d95 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:40.323254 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e9cf45ad-518a-4237-a106-cb672ae37d95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:40.447376 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf45ad-518a-4237-a106-cb672ae37d95 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:40.504820 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1404835f-9a5f-4cd2-8b37-63a334586f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:40.506207 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404835f-9a5f-4cd2-8b37-63a334586f5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:40.506502 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404835f-9a5f-4cd2-8b37-63a334586f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:40.506798 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404835f-9a5f-4cd2-8b37-63a334586f5b admin admin] PATH_INFO: `/v3/projects/e8781927dfa043f49638ef71b5ef9f82` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:40.507970 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1404835f-9a5f-4cd2-8b37-63a334586f5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8781927dfa043f49638ef71b5ef9f82)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:40.510013 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1404835f-9a5f-4cd2-8b37-63a334586f5b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:40.645159 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1404835f-9a5f-4cd2-8b37-63a334586f5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8781927dfa043f49638ef71b5ef9f82', 'request_id': 'req-1404835f-9a5f-4cd2-8b37-63a334586f5b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:40.718835 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1404835f-9a5f-4cd2-8b37-63a334586f5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8781927dfa043f49638ef71b5ef9f82', 'request_id': 'req-1404835f-9a5f-4cd2-8b37-63a334586f5b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:40.726514 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1404835f-9a5f-4cd2-8b37-63a334586f5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8781927dfa043f49638ef71b5ef9f82', 'request_id': 'req-1404835f-9a5f-4cd2-8b37-63a334586f5b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:40.737781 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1404835f-9a5f-4cd2-8b37-63a334586f5b admin admin] The token cache is being invalidate because project e8781927dfa043f49638ef71b5ef9f82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:49:40.738103 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1404835f-9a5f-4cd2-8b37-63a334586f5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:40.738764 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1404835f-9a5f-4cd2-8b37-63a334586f5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:40.740241 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1046/2124] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:49:40 2022] DELETE /identity/v3/projects/e8781927dfa043f49638ef71b5ef9f82 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:40.745039 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6455c-b407-4439-82df-dc92735caaf1 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:40.745496 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6455c-b407-4439-82df-dc92735caaf1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:40.745586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6455c-b407-4439-82df-dc92735caaf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:40.768325 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c1a6455c-b407-4439-82df-dc92735caaf1 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:40.769591 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c1a6455c-b407-4439-82df-dc92735caaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:40.832262 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1079/2125] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:40.840426 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608349d-0203-4c9d-b194-47754094cca2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:40.841017 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608349d-0203-4c9d-b194-47754094cca2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:40.841715 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608349d-0203-4c9d-b194-47754094cca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:40.868338 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d608349d-0203-4c9d-b194-47754094cca2 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:40.869618 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d608349d-0203-4c9d-b194-47754094cca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:40.878153 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1047/2126] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:40.882270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a6455c-b407-4439-82df-dc92735caaf1 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:40.892657 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a6455c-b407-4439-82df-dc92735caaf1 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:40.898077 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442405c-cd86-4b69-9b72-be48fff6f390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:40.898695 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442405c-cd86-4b69-9b72-be48fff6f390 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:40.898978 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442405c-cd86-4b69-9b72-be48fff6f390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:40.899272 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442405c-cd86-4b69-9b72-be48fff6f390 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:40.899971 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442405c-cd86-4b69-9b72-be48fff6f390 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:49:40.900259 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442405c-cd86-4b69-9b72-be48fff6f390 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:40.902603 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442405c-cd86-4b69-9b72-be48fff6f390 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:40.918553 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1080/2127] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:49:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:49:40.920304 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608349d-0203-4c9d-b194-47754094cca2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:40.931254 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608349d-0203-4c9d-b194-47754094cca2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:40.936113 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5ef91-8802-4d00-b0bb-8bc2f0aa63f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:40.936827 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5ef91-8802-4d00-b0bb-8bc2f0aa63f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:40.937110 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5ef91-8802-4d00-b0bb-8bc2f0aa63f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:40.937382 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5ef91-8802-4d00-b0bb-8bc2f0aa63f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:40.938114 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee5ef91-8802-4d00-b0bb-8bc2f0aa63f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:40.940106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee5ef91-8802-4d00-b0bb-8bc2f0aa63f4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:41.045531 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1048/2128] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:49:40 2022] POST /identity/v3/projects => generated 367 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:49:41.049568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442405c-cd86-4b69-9b72-be48fff6f390 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:41.059709 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442405c-cd86-4b69-9b72-be48fff6f390 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:41.123249 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c7f7e-87b5-464b-8658-0fd42422cb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:41.123858 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c7f7e-87b5-464b-8658-0fd42422cb06 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:41.124160 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c7f7e-87b5-464b-8658-0fd42422cb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:41.124455 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c7f7e-87b5-464b-8658-0fd42422cb06 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:41.125100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c7f7e-87b5-464b-8658-0fd42422cb06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:41.127151 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c7f7e-87b5-464b-8658-0fd42422cb06 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:41.263526 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:41.271155 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1081/2129] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:49:41 2022] POST /identity/v3/users => generated 284 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:49:41.275364 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5ef91-8802-4d00-b0bb-8bc2f0aa63f4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:41.284243 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c3c6e-55ab-4fdf-8caa-0fd501b0231b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:41.284532 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c3c6e-55ab-4fdf-8caa-0fd501b0231b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:41.284806 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c3c6e-55ab-4fdf-8caa-0fd501b0231b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:41.295250 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5ef91-8802-4d00-b0bb-8bc2f0aa63f4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:41.300610 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f5b8a-52c4-4b7d-894d-3583bca71bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:41.301430 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f5b8a-52c4-4b7d-894d-3583bca71bfb admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:41.301917 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f5b8a-52c4-4b7d-894d-3583bca71bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:41.302376 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f5b8a-52c4-4b7d-894d-3583bca71bfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:41.303803 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f5b8a-52c4-4b7d-894d-3583bca71bfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:41.306639 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f5b8a-52c4-4b7d-894d-3583bca71bfb admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:41.322174 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1049/2130] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:49:41.326640 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f5b8a-52c4-4b7d-894d-3583bca71bfb admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:41.337924 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f5b8a-52c4-4b7d-894d-3583bca71bfb admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:41.338229 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-332c3c6e-55ab-4fdf-8caa-0fd501b0231b None None] MFA Rules not processed for user `fb0fdf3b1d3c48f0b3f4151e66ef15da`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:41.339546 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-332c3c6e-55ab-4fdf-8caa-0fd501b0231b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:41.349714 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1edc6-ca02-40f0-85aa-e215227420f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:41.349714 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1edc6-ca02-40f0-85aa-e215227420f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:41.349714 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1edc6-ca02-40f0-85aa-e215227420f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:41.349714 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1edc6-ca02-40f0-85aa-e215227420f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:41.351107 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd1edc6-ca02-40f0-85aa-e215227420f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:41.353000 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd1edc6-ca02-40f0-85aa-e215227420f9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:41.382023 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1050/2131] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:49:41.386142 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1edc6-ca02-40f0-85aa-e215227420f9 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:41.398755 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1edc6-ca02-40f0-85aa-e215227420f9 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:41.406575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58405e72-c942-4bb6-ad60-0f4f96d9962e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:41.407783 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58405e72-c942-4bb6-ad60-0f4f96d9962e admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:41.408502 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58405e72-c942-4bb6-ad60-0f4f96d9962e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:41.408964 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58405e72-c942-4bb6-ad60-0f4f96d9962e admin admin] PATH_INFO: `/v3/projects/8b1b9bc9f39c4c9eb8a3bd7a6488fd62/users/60f880db178d4fd78e6492e91e9e02c5/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:41.432042 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58405e72-c942-4bb6-ad60-0f4f96d9962e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b1b9bc9f39c4c9eb8a3bd7a6488fd62, user_id=60f880db178d4fd78e6492e91e9e02c5, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:41.434989 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58405e72-c942-4bb6-ad60-0f4f96d9962e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:41.453759 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1082/2132] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:41.459883 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ab17c-f221-47c1-a5eb-add252cd20d8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:41.460180 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ab17c-f221-47c1-a5eb-add252cd20d8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:41.460442 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ab17c-f221-47c1-a5eb-add252cd20d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:41.481666 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3a7ab17c-f221-47c1-a5eb-add252cd20d8 None None] MFA Rules not processed for user `66014603adea41d9ba27ec8ffd7f76d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:41.482992 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3a7ab17c-f221-47c1-a5eb-add252cd20d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:41.536282 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1051/2133] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:49:41 2022] PUT /identity/v3/projects/8b1b9bc9f39c4c9eb8a3bd7a6488fd62/users/60f880db178d4fd78e6492e91e9e02c5/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:41.539328 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1083/2134] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:41.548266 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52d602-d180-4cc2-b408-e545ae90b081 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:41.548624 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52d602-d180-4cc2-b408-e545ae90b081 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:41.548933 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52d602-d180-4cc2-b408-e545ae90b081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:41.551231 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ab17c-f221-47c1-a5eb-add252cd20d8 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:41.553444 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3a7ab17c-f221-47c1-a5eb-add252cd20d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:41.582974 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-fe52d602-d180-4cc2-b408-e545ae90b081 None None] MFA Rules not processed for user `60f880db178d4fd78e6492e91e9e02c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:41.585194 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fe52d602-d180-4cc2-b408-e545ae90b081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:41.664738 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ab17c-f221-47c1-a5eb-add252cd20d8 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:41.684443 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1052/2135] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:41.685886 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe52d602-d180-4cc2-b408-e545ae90b081 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:41.774109 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d53998-f931-4c39-9dbc-744608570a24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:41.775116 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d53998-f931-4c39-9dbc-744608570a24 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:41.775396 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d53998-f931-4c39-9dbc-744608570a24 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:41.775664 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d53998-f931-4c39-9dbc-744608570a24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:41.779080 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-43d53998-f931-4c39-9dbc-744608570a24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:41.804446 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe52d602-d180-4cc2-b408-e545ae90b081 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:41.809615 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:41.812879 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785ef59-8130-4ae0-a685-a2c5ec6e9397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:41.813509 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785ef59-8130-4ae0-a685-a2c5ec6e9397 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:41.813826 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785ef59-8130-4ae0-a685-a2c5ec6e9397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:41.814134 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785ef59-8130-4ae0-a685-a2c5ec6e9397 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:41.814719 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785ef59-8130-4ae0-a685-a2c5ec6e9397 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:41.816663 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785ef59-8130-4ae0-a685-a2c5ec6e9397 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:41.860782 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d53998-f931-4c39-9dbc-744608570a24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:41.862446 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d53998-f931-4c39-9dbc-744608570a24 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:41.871939 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1084/2136] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:49:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:49:42.053608 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1053/2137] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:49:41 2022] POST /identity/v3/projects => generated 367 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:49:42.056199 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d53998-f931-4c39-9dbc-744608570a24 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:42.067936 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d53998-f931-4c39-9dbc-744608570a24 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:42.154016 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0869b6d9-454b-4b23-9cc1-3ef2f8295a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:42.154888 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869b6d9-454b-4b23-9cc1-3ef2f8295a55 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:42.155169 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869b6d9-454b-4b23-9cc1-3ef2f8295a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:42.155440 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869b6d9-454b-4b23-9cc1-3ef2f8295a55 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:42.156110 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0869b6d9-454b-4b23-9cc1-3ef2f8295a55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:42.158133 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0869b6d9-454b-4b23-9cc1-3ef2f8295a55 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:42.299116 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1085/2138] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:49:42 2022] POST /identity/v3/users => generated 290 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:49:42.299213 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785ef59-8130-4ae0-a685-a2c5ec6e9397 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:42.317391 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785ef59-8130-4ae0-a685-a2c5ec6e9397 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:42.324541 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cec817-8171-4b2e-97ec-6626f2b0a9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:42.325262 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cec817-8171-4b2e-97ec-6626f2b0a9ca admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:42.325553 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cec817-8171-4b2e-97ec-6626f2b0a9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:42.325860 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cec817-8171-4b2e-97ec-6626f2b0a9ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:42.326518 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cec817-8171-4b2e-97ec-6626f2b0a9ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:42.341530 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cec817-8171-4b2e-97ec-6626f2b0a9ca admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:42.359177 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0869b6d9-454b-4b23-9cc1-3ef2f8295a55 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:42.368329 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1054/2139] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:49:42.372329 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0869b6d9-454b-4b23-9cc1-3ef2f8295a55 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:42.377388 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7c50a-9620-4f8c-bd17-71a2f2ca7964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:42.378109 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7c50a-9620-4f8c-bd17-71a2f2ca7964 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:42.378414 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7c50a-9620-4f8c-bd17-71a2f2ca7964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:42.378662 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7c50a-9620-4f8c-bd17-71a2f2ca7964 admin admin] PATH_INFO: `/v3/projects/d92ab8315f2f4621a26ded57e2a129f7/users/8f9ad49a80af4a3e82c266686ebc639a/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:42.400621 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7c50a-9620-4f8c-bd17-71a2f2ca7964 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d92ab8315f2f4621a26ded57e2a129f7, user_id=8f9ad49a80af4a3e82c266686ebc639a, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:42.405045 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7c50a-9620-4f8c-bd17-71a2f2ca7964 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:42.406208 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cec817-8171-4b2e-97ec-6626f2b0a9ca admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:42.408260 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-02cec817-8171-4b2e-97ec-6626f2b0a9ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:42.424536 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cec817-8171-4b2e-97ec-6626f2b0a9ca admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:42.429432 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36342640-25e6-40c2-bff0-37c13b236b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:42.430178 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36342640-25e6-40c2-bff0-37c13b236b53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:42.431124 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36342640-25e6-40c2-bff0-37c13b236b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:42.445907 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36342640-25e6-40c2-bff0-37c13b236b53 admin admin] PATH_INFO: `/v3/users/6a43f2c3f9ce47d2bfd4b10c22bc5f50` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:42.447411 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36342640-25e6-40c2-bff0-37c13b236b53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a43f2c3f9ce47d2bfd4b10c22bc5f50)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:42.450337 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36342640-25e6-40c2-bff0-37c13b236b53 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:42.524780 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1086/2140] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:49:42 2022] PUT /identity/v3/projects/d92ab8315f2f4621a26ded57e2a129f7/users/8f9ad49a80af4a3e82c266686ebc639a/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:49:42.528608 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7c50a-9620-4f8c-bd17-71a2f2ca7964 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:42.603578 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7c50a-9620-4f8c-bd17-71a2f2ca7964 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:42.607852 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac9364-0073-456e-ad0a-d1715c0a9277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:42.608576 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac9364-0073-456e-ad0a-d1715c0a9277 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:42.608977 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac9364-0073-456e-ad0a-d1715c0a9277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:42.609305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac9364-0073-456e-ad0a-d1715c0a9277 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:42.610158 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac9364-0073-456e-ad0a-d1715c0a9277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:42.611945 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac9364-0073-456e-ad0a-d1715c0a9277 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:42.625981 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1087/2141] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:49:42.627961 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac9364-0073-456e-ad0a-d1715c0a9277 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:42.643813 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac9364-0073-456e-ad0a-d1715c0a9277 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:42.649576 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc03a6-598c-4875-a9b9-64db8a50e592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:42.650411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc03a6-598c-4875-a9b9-64db8a50e592 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:42.650691 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc03a6-598c-4875-a9b9-64db8a50e592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:42.650965 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc03a6-598c-4875-a9b9-64db8a50e592 admin admin] PATH_INFO: `/v3/projects/d92ab8315f2f4621a26ded57e2a129f7/users/8f9ad49a80af4a3e82c266686ebc639a/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:42.655321 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc03a6-598c-4875-a9b9-64db8a50e592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d92ab8315f2f4621a26ded57e2a129f7, user_id=8f9ad49a80af4a3e82c266686ebc639a, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:42.655999 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc03a6-598c-4875-a9b9-64db8a50e592 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:42.676237 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1088/2142] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:49:42 2022] PUT /identity/v3/projects/d92ab8315f2f4621a26ded57e2a129f7/users/8f9ad49a80af4a3e82c266686ebc639a/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:49:42.678313 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03295b9-8522-4621-80f4-67c719762340 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:42.678603 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03295b9-8522-4621-80f4-67c719762340 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:42.678881 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03295b9-8522-4621-80f4-67c719762340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:42.716568 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-36342640-25e6-40c2-bff0-37c13b236b53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a43f2c3f9ce47d2bfd4b10c22bc5f50'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:42.717657 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-36342640-25e6-40c2-bff0-37c13b236b53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a43f2c3f9ce47d2bfd4b10c22bc5f50'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:42.718145 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e03295b9-8522-4621-80f4-67c719762340 None None] MFA Rules not processed for user `8f9ad49a80af4a3e82c266686ebc639a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:42.719754 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e03295b9-8522-4621-80f4-67c719762340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:42.726335 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-36342640-25e6-40c2-bff0-37c13b236b53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a43f2c3f9ce47d2bfd4b10c22bc5f50'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:42.742960 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-36342640-25e6-40c2-bff0-37c13b236b53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a43f2c3f9ce47d2bfd4b10c22bc5f50'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:42.743829 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-36342640-25e6-40c2-bff0-37c13b236b53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a43f2c3f9ce47d2bfd4b10c22bc5f50'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:42.797602 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:42.801944 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1089/2143] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:42 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:42.813836 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03295b9-8522-4621-80f4-67c719762340 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:42.815455 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e03295b9-8522-4621-80f4-67c719762340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:42.919886 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03295b9-8522-4621-80f4-67c719762340 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:42.925479 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303df246-df15-4c83-a823-69db425f109a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:42.926654 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303df246-df15-4c83-a823-69db425f109a service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:42.926950 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303df246-df15-4c83-a823-69db425f109a service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:42.927224 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303df246-df15-4c83-a823-69db425f109a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:42.950272 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303df246-df15-4c83-a823-69db425f109a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:42.952240 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303df246-df15-4c83-a823-69db425f109a service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:42.963981 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1090/2144] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:49:42 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 03:49:43.027651 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1055/2145] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:49:42 2022] DELETE /identity/v3/users/6a43f2c3f9ce47d2bfd4b10c22bc5f50 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:43.032827 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d22f8-143f-4194-a83a-74ab1aed7bc1 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:43.033128 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d22f8-143f-4194-a83a-74ab1aed7bc1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:43.033390 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d22f8-143f-4194-a83a-74ab1aed7bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:43.061385 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8b9d22f8-143f-4194-a83a-74ab1aed7bc1 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:43.062722 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8b9d22f8-143f-4194-a83a-74ab1aed7bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:43.122995 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1091/2146] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:43.132998 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36342640-25e6-40c2-bff0-37c13b236b53 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:43.138037 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-36342640-25e6-40c2-bff0-37c13b236b53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:43.202562 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36342640-25e6-40c2-bff0-37c13b236b53 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:43.206742 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8304ff-b371-424b-9669-80a0090d9b52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:43.207359 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8304ff-b371-424b-9669-80a0090d9b52 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:43.207638 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8304ff-b371-424b-9669-80a0090d9b52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:43.207909 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8304ff-b371-424b-9669-80a0090d9b52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:43.218135 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8304ff-b371-424b-9669-80a0090d9b52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:43.219634 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8304ff-b371-424b-9669-80a0090d9b52 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:43.239803 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1056/2147] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:49:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:49:43.756282 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d22f8-143f-4194-a83a-74ab1aed7bc1 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:43.758016 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8b9d22f8-143f-4194-a83a-74ab1aed7bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:43.772924 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d22f8-143f-4194-a83a-74ab1aed7bc1 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:43.778418 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67025e2c-df9d-4668-a4b2-ba8f0592aa2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:43.779059 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67025e2c-df9d-4668-a4b2-ba8f0592aa2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:43.779758 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67025e2c-df9d-4668-a4b2-ba8f0592aa2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:43.780035 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67025e2c-df9d-4668-a4b2-ba8f0592aa2e admin admin] PATH_INFO: `/v3/projects/d2c39a81769c403d8719be7e6d249425` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:43.781580 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67025e2c-df9d-4668-a4b2-ba8f0592aa2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2c39a81769c403d8719be7e6d249425)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:43.784135 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67025e2c-df9d-4668-a4b2-ba8f0592aa2e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:43.959746 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-67025e2c-df9d-4668-a4b2-ba8f0592aa2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2c39a81769c403d8719be7e6d249425', 'request_id': 'req-67025e2c-df9d-4668-a4b2-ba8f0592aa2e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:44.061730 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-67025e2c-df9d-4668-a4b2-ba8f0592aa2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2c39a81769c403d8719be7e6d249425', 'request_id': 'req-67025e2c-df9d-4668-a4b2-ba8f0592aa2e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:44.070041 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-67025e2c-df9d-4668-a4b2-ba8f0592aa2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2c39a81769c403d8719be7e6d249425', 'request_id': 'req-67025e2c-df9d-4668-a4b2-ba8f0592aa2e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:44.081111 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-67025e2c-df9d-4668-a4b2-ba8f0592aa2e admin admin] The token cache is being invalidate because project d2c39a81769c403d8719be7e6d249425 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:49:44.081480 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-67025e2c-df9d-4668-a4b2-ba8f0592aa2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:44.082230 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-67025e2c-df9d-4668-a4b2-ba8f0592aa2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:44.084530 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1092/2148] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:49:43 2022] DELETE /identity/v3/projects/d2c39a81769c403d8719be7e6d249425 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:44.089727 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f9a1c-15ab-4cd9-9cc4-10c971035b8e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:44.090264 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f9a1c-15ab-4cd9-9cc4-10c971035b8e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:44.090264 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f9a1c-15ab-4cd9-9cc4-10c971035b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:44.114953 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-980f9a1c-15ab-4cd9-9cc4-10c971035b8e None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:44.116326 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-980f9a1c-15ab-4cd9-9cc4-10c971035b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:44.186163 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1057/2149] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:44.194365 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a7f77-2d87-4361-b759-f5df243d3fbc None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:44.194652 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a7f77-2d87-4361-b759-f5df243d3fbc None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:44.195036 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a7f77-2d87-4361-b759-f5df243d3fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:44.215657 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e77a7f77-2d87-4361-b759-f5df243d3fbc None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:44.216936 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e77a7f77-2d87-4361-b759-f5df243d3fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:44.225013 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1093/2150] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:44.232637 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f9a1c-15ab-4cd9-9cc4-10c971035b8e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:44.242362 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f9a1c-15ab-4cd9-9cc4-10c971035b8e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:44.246963 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4cd0e-0071-4d07-aff7-6b25bffa9cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:44.247594 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4cd0e-0071-4d07-aff7-6b25bffa9cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:44.247877 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4cd0e-0071-4d07-aff7-6b25bffa9cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:44.248153 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4cd0e-0071-4d07-aff7-6b25bffa9cc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:44.248823 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b4cd0e-0071-4d07-aff7-6b25bffa9cc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:49:44.249127 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b4cd0e-0071-4d07-aff7-6b25bffa9cc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:44.250754 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b4cd0e-0071-4d07-aff7-6b25bffa9cc1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:44.262965 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1058/2151] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:49:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:49:44.267695 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a7f77-2d87-4361-b759-f5df243d3fbc None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:44.281855 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a7f77-2d87-4361-b759-f5df243d3fbc None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:44.286884 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bda94e-e4aa-459d-adae-7a0a5266495f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:44.287677 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bda94e-e4aa-459d-adae-7a0a5266495f admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:44.287957 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bda94e-e4aa-459d-adae-7a0a5266495f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:44.288377 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bda94e-e4aa-459d-adae-7a0a5266495f admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:44.289300 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bda94e-e4aa-459d-adae-7a0a5266495f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:44.291306 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bda94e-e4aa-459d-adae-7a0a5266495f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:44.431440 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1094/2152] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:49:44 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:49:44.435438 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4cd0e-0071-4d07-aff7-6b25bffa9cc1 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:44.449486 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4cd0e-0071-4d07-aff7-6b25bffa9cc1 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:44.550060 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de6f7b-ad53-4c58-84a9-62f4e4f207d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:44.550837 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de6f7b-ad53-4c58-84a9-62f4e4f207d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:44.551214 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de6f7b-ad53-4c58-84a9-62f4e4f207d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:44.551541 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de6f7b-ad53-4c58-84a9-62f4e4f207d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:44.552311 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81de6f7b-ad53-4c58-84a9-62f4e4f207d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:44.554918 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81de6f7b-ad53-4c58-84a9-62f4e4f207d3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:44.719754 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1059/2153] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:49:44 2022] POST /identity/v3/users => generated 289 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:49:44.724945 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bda94e-e4aa-459d-adae-7a0a5266495f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:44.736818 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bda94e-e4aa-459d-adae-7a0a5266495f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:44.742429 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef01705-8896-4ae8-b60b-447bbb1e335a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:44.743189 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef01705-8896-4ae8-b60b-447bbb1e335a admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:44.743622 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef01705-8896-4ae8-b60b-447bbb1e335a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:44.743965 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef01705-8896-4ae8-b60b-447bbb1e335a admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:44.744685 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef01705-8896-4ae8-b60b-447bbb1e335a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:44.746638 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef01705-8896-4ae8-b60b-447bbb1e335a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:44.759916 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1095/2154] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:49:44.763882 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de6f7b-ad53-4c58-84a9-62f4e4f207d3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:44.774932 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de6f7b-ad53-4c58-84a9-62f4e4f207d3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:44.781082 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb8a2c2-2f25-4376-955a-52f3d5f8189d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:44.781082 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8a2c2-2f25-4376-955a-52f3d5f8189d admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:44.781082 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8a2c2-2f25-4376-955a-52f3d5f8189d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:44.781082 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8a2c2-2f25-4376-955a-52f3d5f8189d admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:44.781836 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb8a2c2-2f25-4376-955a-52f3d5f8189d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:44.783429 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb8a2c2-2f25-4376-955a-52f3d5f8189d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:44.795412 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1060/2155] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:49:44.799600 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef01705-8896-4ae8-b60b-447bbb1e335a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:44.810834 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef01705-8896-4ae8-b60b-447bbb1e335a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:44.815646 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee68b0-30b7-45a3-8ac8-1d52ff1b9123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:44.816323 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee68b0-30b7-45a3-8ac8-1d52ff1b9123 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:44.816759 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee68b0-30b7-45a3-8ac8-1d52ff1b9123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:44.817036 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee68b0-30b7-45a3-8ac8-1d52ff1b9123 admin admin] PATH_INFO: `/v3/projects/ceddf35502ad4291931be17a6131bd37/users/c6c983fc7e6f4aaf80fd353a6b93c5fb/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:44.831781 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee68b0-30b7-45a3-8ac8-1d52ff1b9123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceddf35502ad4291931be17a6131bd37, user_id=c6c983fc7e6f4aaf80fd353a6b93c5fb, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:44.834516 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee68b0-30b7-45a3-8ac8-1d52ff1b9123 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:44.944188 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1096/2156] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:49:44 2022] PUT /identity/v3/projects/ceddf35502ad4291931be17a6131bd37/users/c6c983fc7e6f4aaf80fd353a6b93c5fb/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:49:44.955431 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32f9df-e859-4dad-b0a9-d51778c491af None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:44.955679 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32f9df-e859-4dad-b0a9-d51778c491af None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:44.955949 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32f9df-e859-4dad-b0a9-d51778c491af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:45.001701 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3e32f9df-e859-4dad-b0a9-d51778c491af None None] MFA Rules not processed for user `c6c983fc7e6f4aaf80fd353a6b93c5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:45.003360 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3e32f9df-e859-4dad-b0a9-d51778c491af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:45.064661 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee68b0-30b7-45a3-8ac8-1d52ff1b9123 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:45.068143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e9ee68b0-30b7-45a3-8ac8-1d52ff1b9123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:45.087657 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1061/2157] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:45.093006 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32f9df-e859-4dad-b0a9-d51778c491af None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:45.150842 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee68b0-30b7-45a3-8ac8-1d52ff1b9123 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:45.159581 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7433f5-ec17-4378-981b-00731e9e8462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:45.160541 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7433f5-ec17-4378-981b-00731e9e8462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:45.160978 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7433f5-ec17-4378-981b-00731e9e8462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:45.161394 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7433f5-ec17-4378-981b-00731e9e8462 admin admin] PATH_INFO: `/v3/users/8c051bf284e9481eba693c497e46453c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:45.164020 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7433f5-ec17-4378-981b-00731e9e8462 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c051bf284e9481eba693c497e46453c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:45.166988 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7433f5-ec17-4378-981b-00731e9e8462 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:45.185605 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32f9df-e859-4dad-b0a9-d51778c491af None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:45.191139 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3de271-180e-4705-8785-50d2cf146d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:45.192175 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3de271-180e-4705-8785-50d2cf146d2b admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:45.192666 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3de271-180e-4705-8785-50d2cf146d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:45.193684 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3de271-180e-4705-8785-50d2cf146d2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:45.200767 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3de271-180e-4705-8785-50d2cf146d2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:45.200767 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3de271-180e-4705-8785-50d2cf146d2b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:45.404213 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1062/2158] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:49:45 2022] POST /identity/v3/projects => generated 375 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:49:45.408880 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3de271-180e-4705-8785-50d2cf146d2b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:45.442165 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-da7433f5-ec17-4378-981b-00731e9e8462 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c051bf284e9481eba693c497e46453c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:45.444009 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-da7433f5-ec17-4378-981b-00731e9e8462 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c051bf284e9481eba693c497e46453c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:45.465163 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-da7433f5-ec17-4378-981b-00731e9e8462 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c051bf284e9481eba693c497e46453c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:45.481725 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-da7433f5-ec17-4378-981b-00731e9e8462 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c051bf284e9481eba693c497e46453c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:45.482718 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-da7433f5-ec17-4378-981b-00731e9e8462 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c051bf284e9481eba693c497e46453c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:45.528981 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3de271-180e-4705-8785-50d2cf146d2b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:45.532217 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc0417-ed4b-4adf-b199-9101ced4d65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:45.533109 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc0417-ed4b-4adf-b199-9101ced4d65b admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:45.534134 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc0417-ed4b-4adf-b199-9101ced4d65b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:45.534664 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc0417-ed4b-4adf-b199-9101ced4d65b admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:45.535452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc0417-ed4b-4adf-b199-9101ced4d65b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:45.538144 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc0417-ed4b-4adf-b199-9101ced4d65b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:45.646504 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1097/2159] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:49:45 2022] DELETE /identity/v3/users/8c051bf284e9481eba693c497e46453c => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:49:45.649830 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1063/2160] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:49:45 2022] POST /identity/v3/users => generated 288 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:49:45.651287 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc0417-ed4b-4adf-b199-9101ced4d65b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:45.651442 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a0065-ffa1-4667-9df8-04be60801504 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:45.651693 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a0065-ffa1-4667-9df8-04be60801504 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:45.651886 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a0065-ffa1-4667-9df8-04be60801504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:45.654903 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-95bc0417-ed4b-4adf-b199-9101ced4d65b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:45.677230 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-908a0065-ffa1-4667-9df8-04be60801504 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:45.679397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-908a0065-ffa1-4667-9df8-04be60801504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:45.685021 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc0417-ed4b-4adf-b199-9101ced4d65b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:45.776753 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1098/2161] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:49:45.785467 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a0065-ffa1-4667-9df8-04be60801504 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:45.788951 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-908a0065-ffa1-4667-9df8-04be60801504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:45.798910 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4495640-eb56-4429-a6f8-40cc75e99bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:45.800228 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4495640-eb56-4429-a6f8-40cc75e99bdd admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:45.800228 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4495640-eb56-4429-a6f8-40cc75e99bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:45.800228 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4495640-eb56-4429-a6f8-40cc75e99bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:45.804897 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4495640-eb56-4429-a6f8-40cc75e99bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:45.807104 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4495640-eb56-4429-a6f8-40cc75e99bdd admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:45.818579 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1064/2162] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:49:45.823262 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4495640-eb56-4429-a6f8-40cc75e99bdd admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:45.842011 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4495640-eb56-4429-a6f8-40cc75e99bdd admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:45.846626 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a0ce2-40a8-44d7-8434-d6da9d15f8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:45.847394 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a0ce2-40a8-44d7-8434-d6da9d15f8a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:45.847677 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a0ce2-40a8-44d7-8434-d6da9d15f8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:45.848232 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a0ce2-40a8-44d7-8434-d6da9d15f8a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:45.848903 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a0ce2-40a8-44d7-8434-d6da9d15f8a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:45.851612 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a0ce2-40a8-44d7-8434-d6da9d15f8a8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:45.867115 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1065/2163] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:49:45.868759 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a0ce2-40a8-44d7-8434-d6da9d15f8a8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:45.878508 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a0065-ffa1-4667-9df8-04be60801504 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:45.887273 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1aef7-06fa-417f-9b8a-6bd223b0162b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:45.888284 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1aef7-06fa-417f-9b8a-6bd223b0162b service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:45.888720 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1aef7-06fa-417f-9b8a-6bd223b0162b service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:45.889133 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1aef7-06fa-417f-9b8a-6bd223b0162b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:45.905647 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1aef7-06fa-417f-9b8a-6bd223b0162b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:45.906205 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a0ce2-40a8-44d7-8434-d6da9d15f8a8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:45.907643 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1aef7-06fa-417f-9b8a-6bd223b0162b service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:45.914317 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31860744-2b5b-4cff-a0fd-8fe8a669b2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:45.915176 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31860744-2b5b-4cff-a0fd-8fe8a669b2af admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:45.915546 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31860744-2b5b-4cff-a0fd-8fe8a669b2af admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:45.916694 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31860744-2b5b-4cff-a0fd-8fe8a669b2af admin admin] PATH_INFO: `/v3/projects/f741b46e22a64d579084cf34940ad884/users/50fd3cfa3a704808bec32ede28b437f4/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:45.924347 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1099/2164] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:49:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:49:45.936300 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31860744-2b5b-4cff-a0fd-8fe8a669b2af admin admin] RBAC: Authorizing `identity:create_grant(project_id=f741b46e22a64d579084cf34940ad884, user_id=50fd3cfa3a704808bec32ede28b437f4, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:45.939027 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31860744-2b5b-4cff-a0fd-8fe8a669b2af admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:46.114195 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1066/2165] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:49:45 2022] PUT /identity/v3/projects/f741b46e22a64d579084cf34940ad884/users/50fd3cfa3a704808bec32ede28b437f4/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:49:46.124652 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71bfe0-32cd-402a-ad3b-9fedfd1e6cd8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:46.125110 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71bfe0-32cd-402a-ad3b-9fedfd1e6cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:46.125228 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71bfe0-32cd-402a-ad3b-9fedfd1e6cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:46.154726 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4e71bfe0-32cd-402a-ad3b-9fedfd1e6cd8 None None] MFA Rules not processed for user `50fd3cfa3a704808bec32ede28b437f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:46.156022 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4e71bfe0-32cd-402a-ad3b-9fedfd1e6cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:46.223984 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1100/2166] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:46.229089 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31860744-2b5b-4cff-a0fd-8fe8a669b2af admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:46.302772 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31860744-2b5b-4cff-a0fd-8fe8a669b2af admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:46.302877 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c228b20-3f33-4e88-8bb8-0ac36e8aa235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:46.303979 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c228b20-3f33-4e88-8bb8-0ac36e8aa235 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:46.304258 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c228b20-3f33-4e88-8bb8-0ac36e8aa235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:46.304918 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c228b20-3f33-4e88-8bb8-0ac36e8aa235 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:46.305209 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c228b20-3f33-4e88-8bb8-0ac36e8aa235 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:46.307078 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c228b20-3f33-4e88-8bb8-0ac36e8aa235 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:46.424152 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1067/2167] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:49:46 2022] POST /identity/v3/projects => generated 377 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:49:46.428509 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71bfe0-32cd-402a-ad3b-9fedfd1e6cd8 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:46.445878 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71bfe0-32cd-402a-ad3b-9fedfd1e6cd8 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:46.539907 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf52096-d8ca-4610-9068-e25e6e40b4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:46.540652 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf52096-d8ca-4610-9068-e25e6e40b4f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:46.540982 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf52096-d8ca-4610-9068-e25e6e40b4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:46.541318 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf52096-d8ca-4610-9068-e25e6e40b4f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:46.542055 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf52096-d8ca-4610-9068-e25e6e40b4f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:46.544258 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf52096-d8ca-4610-9068-e25e6e40b4f8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:46.594461 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c228b20-3f33-4e88-8bb8-0ac36e8aa235 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:46.597015 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9c228b20-3f33-4e88-8bb8-0ac36e8aa235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:46.609967 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c228b20-3f33-4e88-8bb8-0ac36e8aa235 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:46.615555 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c990d-6d4a-442d-8ded-847c3053afb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:46.616468 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c990d-6d4a-442d-8ded-847c3053afb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:46.616754 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c990d-6d4a-442d-8ded-847c3053afb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:46.617031 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c990d-6d4a-442d-8ded-847c3053afb5 admin admin] PATH_INFO: `/v3/projects/e72f5c5c88fb4a3f857e4d767bde6852` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:46.618332 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c990d-6d4a-442d-8ded-847c3053afb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e72f5c5c88fb4a3f857e4d767bde6852)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:46.620238 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c990d-6d4a-442d-8ded-847c3053afb5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:46.688470 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1101/2168] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:49:46 2022] POST /identity/v3/users => generated 295 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:49:46.689802 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf52096-d8ca-4610-9068-e25e6e40b4f8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:46.705040 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf52096-d8ca-4610-9068-e25e6e40b4f8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:46.710215 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc419b-d576-44b3-b2e8-9d0c6fefada2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:46.714252 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc419b-d576-44b3-b2e8-9d0c6fefada2 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:46.714252 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc419b-d576-44b3-b2e8-9d0c6fefada2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:46.714252 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc419b-d576-44b3-b2e8-9d0c6fefada2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:46.714252 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc419b-d576-44b3-b2e8-9d0c6fefada2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:46.714252 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc419b-d576-44b3-b2e8-9d0c6fefada2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:46.725032 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1102/2169] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:49:46.729226 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc419b-d576-44b3-b2e8-9d0c6fefada2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:46.741466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc419b-d576-44b3-b2e8-9d0c6fefada2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:46.756193 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b23c990d-6d4a-442d-8ded-847c3053afb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e72f5c5c88fb4a3f857e4d767bde6852', 'request_id': 'req-b23c990d-6d4a-442d-8ded-847c3053afb5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:46.801901 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b0b75-dbef-4b41-b825-ee841052a979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:46.803394 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b0b75-dbef-4b41-b825-ee841052a979 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:46.803672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b0b75-dbef-4b41-b825-ee841052a979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:46.803963 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b0b75-dbef-4b41-b825-ee841052a979 admin admin] PATH_INFO: `/v3/projects/337709e58b144b04b1908dfc01077de9/users/fef91cf05d304fcf8de1acea755674d1/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:46.819091 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b0b75-dbef-4b41-b825-ee841052a979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=337709e58b144b04b1908dfc01077de9, user_id=fef91cf05d304fcf8de1acea755674d1, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:46.821775 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b0b75-dbef-4b41-b825-ee841052a979 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:46.862917 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:46.864756 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b23c990d-6d4a-442d-8ded-847c3053afb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e72f5c5c88fb4a3f857e4d767bde6852', 'request_id': 'req-b23c990d-6d4a-442d-8ded-847c3053afb5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:46.874334 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b23c990d-6d4a-442d-8ded-847c3053afb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e72f5c5c88fb4a3f857e4d767bde6852', 'request_id': 'req-b23c990d-6d4a-442d-8ded-847c3053afb5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:46.888396 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b23c990d-6d4a-442d-8ded-847c3053afb5 admin admin] The token cache is being invalidate because project e72f5c5c88fb4a3f857e4d767bde6852 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:49:46.888396 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b23c990d-6d4a-442d-8ded-847c3053afb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:46.889371 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b23c990d-6d4a-442d-8ded-847c3053afb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:46.892321 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1068/2170] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:49:46 2022] DELETE /identity/v3/projects/e72f5c5c88fb4a3f857e4d767bde6852 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:49:46.899153 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c990d-6d4a-442d-8ded-847c3053afb5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:46.902896 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b23c990d-6d4a-442d-8ded-847c3053afb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:46.920059 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c990d-6d4a-442d-8ded-847c3053afb5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:46.925499 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8b905-2ef6-4a81-977c-631ac70bfd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:46.926258 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8b905-2ef6-4a81-977c-631ac70bfd3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:46.926729 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8b905-2ef6-4a81-977c-631ac70bfd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:46.927510 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8b905-2ef6-4a81-977c-631ac70bfd3a admin admin] PATH_INFO: `/v3/users/395c7b4b34954df79d60cbaf5ea42156` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:46.928830 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a8b905-2ef6-4a81-977c-631ac70bfd3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=395c7b4b34954df79d60cbaf5ea42156)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:46.931700 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a8b905-2ef6-4a81-977c-631ac70bfd3a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:46.971483 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1103/2171] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:49:46 2022] PUT /identity/v3/projects/337709e58b144b04b1908dfc01077de9/users/fef91cf05d304fcf8de1acea755674d1/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:49:46.975923 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b0b75-dbef-4b41-b825-ee841052a979 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:46.977555 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-048b0b75-dbef-4b41-b825-ee841052a979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:47.042283 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b0b75-dbef-4b41-b825-ee841052a979 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:47.049836 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4088072-0bb8-4583-ba99-b933a6cbdf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:47.049836 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4088072-0bb8-4583-ba99-b933a6cbdf1e admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:47.049836 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4088072-0bb8-4583-ba99-b933a6cbdf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:47.049836 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4088072-0bb8-4583-ba99-b933a6cbdf1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:47.050437 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4088072-0bb8-4583-ba99-b933a6cbdf1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:47.051476 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4088072-0bb8-4583-ba99-b933a6cbdf1e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:47.061463 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1104/2172] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:49:47.062292 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4088072-0bb8-4583-ba99-b933a6cbdf1e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:47.064285 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c4088072-0bb8-4583-ba99-b933a6cbdf1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:47.090283 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4088072-0bb8-4583-ba99-b933a6cbdf1e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:47.095933 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302064a6-ea0c-414c-ba0a-c2578e797051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:47.096699 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302064a6-ea0c-414c-ba0a-c2578e797051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:47.097054 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302064a6-ea0c-414c-ba0a-c2578e797051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:47.097490 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302064a6-ea0c-414c-ba0a-c2578e797051 admin admin] PATH_INFO: `/v3/users/60f880db178d4fd78e6492e91e9e02c5` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:47.098729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302064a6-ea0c-414c-ba0a-c2578e797051 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60f880db178d4fd78e6492e91e9e02c5)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:47.100960 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302064a6-ea0c-414c-ba0a-c2578e797051 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:47.183892 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-51a8b905-2ef6-4a81-977c-631ac70bfd3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '395c7b4b34954df79d60cbaf5ea42156'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:47.185120 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-51a8b905-2ef6-4a81-977c-631ac70bfd3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '395c7b4b34954df79d60cbaf5ea42156'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:47.194964 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-51a8b905-2ef6-4a81-977c-631ac70bfd3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '395c7b4b34954df79d60cbaf5ea42156'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:47.213580 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-51a8b905-2ef6-4a81-977c-631ac70bfd3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '395c7b4b34954df79d60cbaf5ea42156'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:47.214559 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-51a8b905-2ef6-4a81-977c-631ac70bfd3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '395c7b4b34954df79d60cbaf5ea42156'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:47.328586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-302064a6-ea0c-414c-ba0a-c2578e797051 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60f880db178d4fd78e6492e91e9e02c5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:47.329278 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-302064a6-ea0c-414c-ba0a-c2578e797051 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60f880db178d4fd78e6492e91e9e02c5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:47.336374 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-302064a6-ea0c-414c-ba0a-c2578e797051 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60f880db178d4fd78e6492e91e9e02c5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:47.351643 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-302064a6-ea0c-414c-ba0a-c2578e797051 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60f880db178d4fd78e6492e91e9e02c5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:47.353562 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-302064a6-ea0c-414c-ba0a-c2578e797051 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60f880db178d4fd78e6492e91e9e02c5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:47.357408 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1069/2173] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:49:46 2022] DELETE /identity/v3/users/395c7b4b34954df79d60cbaf5ea42156 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:47.358335 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8b905-2ef6-4a81-977c-631ac70bfd3a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:47.360057 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-51a8b905-2ef6-4a81-977c-631ac70bfd3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:47.443017 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8b905-2ef6-4a81-977c-631ac70bfd3a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:47.448304 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124bf423-3cac-4bb7-9085-cd494c908d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:47.448982 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bf423-3cac-4bb7-9085-cd494c908d9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:47.449267 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bf423-3cac-4bb7-9085-cd494c908d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:47.449537 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bf423-3cac-4bb7-9085-cd494c908d9d admin admin] PATH_INFO: `/v3/projects/337709e58b144b04b1908dfc01077de9/users/fef91cf05d304fcf8de1acea755674d1/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:47.452114 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124bf423-3cac-4bb7-9085-cd494c908d9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=337709e58b144b04b1908dfc01077de9, user_id=fef91cf05d304fcf8de1acea755674d1, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:47.454662 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124bf423-3cac-4bb7-9085-cd494c908d9d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:47.478599 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1070/2174] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:49:47 2022] PUT /identity/v3/projects/337709e58b144b04b1908dfc01077de9/users/fef91cf05d304fcf8de1acea755674d1/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:47.478790 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1105/2175] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:49:47 2022] DELETE /identity/v3/users/60f880db178d4fd78e6492e91e9e02c5 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:47.478873 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77d355-08dc-4dc6-8da4-1e062e79aed3 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:47.478873 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77d355-08dc-4dc6-8da4-1e062e79aed3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:47.478873 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77d355-08dc-4dc6-8da4-1e062e79aed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:47.481948 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4852cd2-02ac-4379-9656-333fed0f3960 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:47.482258 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4852cd2-02ac-4379-9656-333fed0f3960 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:47.482538 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4852cd2-02ac-4379-9656-333fed0f3960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:47.494518 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1f77d355-08dc-4dc6-8da4-1e062e79aed3 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:47.495817 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1f77d355-08dc-4dc6-8da4-1e062e79aed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:47.541295 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a4852cd2-02ac-4379-9656-333fed0f3960 None None] MFA Rules not processed for user `fef91cf05d304fcf8de1acea755674d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:47.543054 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a4852cd2-02ac-4379-9656-333fed0f3960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:47.575431 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1071/2176] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:47.585908 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77d355-08dc-4dc6-8da4-1e062e79aed3 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:47.587363 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1f77d355-08dc-4dc6-8da4-1e062e79aed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:47.641348 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1106/2177] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:49:47.655220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4852cd2-02ac-4379-9656-333fed0f3960 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:47.657132 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a4852cd2-02ac-4379-9656-333fed0f3960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:47.684316 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77d355-08dc-4dc6-8da4-1e062e79aed3 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:47.687408 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215aaaae-07c2-4322-a799-1f8c7346d6c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:47.688216 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215aaaae-07c2-4322-a799-1f8c7346d6c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:47.688654 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215aaaae-07c2-4322-a799-1f8c7346d6c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:47.689132 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215aaaae-07c2-4322-a799-1f8c7346d6c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:47.706928 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215aaaae-07c2-4322-a799-1f8c7346d6c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:47.709027 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215aaaae-07c2-4322-a799-1f8c7346d6c4 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:47.736535 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1072/2178] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:49:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 03:49:47.818619 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4852cd2-02ac-4379-9656-333fed0f3960 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:47.830821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd9ac9-3aff-4514-9888-2fe6cda0bd6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:47.831811 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd9ac9-3aff-4514-9888-2fe6cda0bd6d service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:47.831811 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd9ac9-3aff-4514-9888-2fe6cda0bd6d service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:47.832201 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd9ac9-3aff-4514-9888-2fe6cda0bd6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:47.834229 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a3bd9ac9-3aff-4514-9888-2fe6cda0bd6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:47.930573 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd9ac9-3aff-4514-9888-2fe6cda0bd6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:47.932096 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd9ac9-3aff-4514-9888-2fe6cda0bd6d service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:47.941588 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1107/2179] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:49:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 03:49:48.055032 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:48.163417 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215aaaae-07c2-4322-a799-1f8c7346d6c4 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:48.165035 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-215aaaae-07c2-4322-a799-1f8c7346d6c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:48.183200 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215aaaae-07c2-4322-a799-1f8c7346d6c4 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:48.197821 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f321b3-38df-4837-83b7-8b5e629420d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:48.197821 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f321b3-38df-4837-83b7-8b5e629420d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:48.197821 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f321b3-38df-4837-83b7-8b5e629420d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:48.197821 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f321b3-38df-4837-83b7-8b5e629420d8 admin admin] PATH_INFO: `/v3/projects/18bae2f09a7a4b2fa8d32d37f59d1a3e` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:48.198622 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f321b3-38df-4837-83b7-8b5e629420d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18bae2f09a7a4b2fa8d32d37f59d1a3e)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:48.199653 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f321b3-38df-4837-83b7-8b5e629420d8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:48.342298 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c9f321b3-38df-4837-83b7-8b5e629420d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18bae2f09a7a4b2fa8d32d37f59d1a3e', 'request_id': 'req-c9f321b3-38df-4837-83b7-8b5e629420d8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:48.444548 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c9f321b3-38df-4837-83b7-8b5e629420d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18bae2f09a7a4b2fa8d32d37f59d1a3e', 'request_id': 'req-c9f321b3-38df-4837-83b7-8b5e629420d8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:48.451832 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c9f321b3-38df-4837-83b7-8b5e629420d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18bae2f09a7a4b2fa8d32d37f59d1a3e', 'request_id': 'req-c9f321b3-38df-4837-83b7-8b5e629420d8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:48.479391 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c9f321b3-38df-4837-83b7-8b5e629420d8 admin admin] The token cache is being invalidate because project 18bae2f09a7a4b2fa8d32d37f59d1a3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:49:48.479891 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c9f321b3-38df-4837-83b7-8b5e629420d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:48.485028 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c9f321b3-38df-4837-83b7-8b5e629420d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:48.485028 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1073/2180] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:49:48 2022] DELETE /identity/v3/projects/18bae2f09a7a4b2fa8d32d37f59d1a3e => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:48.487564 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd9ac9-3aff-4514-9888-2fe6cda0bd6d service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:48.489827 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a3bd9ac9-3aff-4514-9888-2fe6cda0bd6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:48.490623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44507e-cb61-4bbc-b3f3-f26c27bae088 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:48.490918 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44507e-cb61-4bbc-b3f3-f26c27bae088 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:48.491206 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44507e-cb61-4bbc-b3f3-f26c27bae088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:48.520712 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd9ac9-3aff-4514-9888-2fe6cda0bd6d service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:48.524620 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-5b44507e-cb61-4bbc-b3f3-f26c27bae088 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:48.526057 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5b44507e-cb61-4bbc-b3f3-f26c27bae088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:48.595969 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b465f98-f63f-4548-9fe1-fdf1b29ab8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:48.596648 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b465f98-f63f-4548-9fe1-fdf1b29ab8de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:48.597042 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b465f98-f63f-4548-9fe1-fdf1b29ab8de admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:48.597324 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b465f98-f63f-4548-9fe1-fdf1b29ab8de admin admin] PATH_INFO: `/v3/projects/8b1b9bc9f39c4c9eb8a3bd7a6488fd62` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:48.598514 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b465f98-f63f-4548-9fe1-fdf1b29ab8de admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b1b9bc9f39c4c9eb8a3bd7a6488fd62)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:48.606296 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1074/2181] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:48.606470 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b465f98-f63f-4548-9fe1-fdf1b29ab8de admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:48.608584 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94070a4c-eb84-49c7-98a2-14a623c688a8 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:48.608945 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94070a4c-eb84-49c7-98a2-14a623c688a8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:48.609521 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94070a4c-eb84-49c7-98a2-14a623c688a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:48.633087 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-94070a4c-eb84-49c7-98a2-14a623c688a8 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:48.634407 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-94070a4c-eb84-49c7-98a2-14a623c688a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:48.643424 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1075/2182] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:48.651560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94070a4c-eb84-49c7-98a2-14a623c688a8 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:48.661220 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94070a4c-eb84-49c7-98a2-14a623c688a8 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:48.665945 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a632808-5591-4176-bd42-3eb879faf428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:48.666638 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a632808-5591-4176-bd42-3eb879faf428 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:48.666925 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a632808-5591-4176-bd42-3eb879faf428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:48.667225 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a632808-5591-4176-bd42-3eb879faf428 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:48.667902 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a632808-5591-4176-bd42-3eb879faf428 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:49:48.668255 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a632808-5591-4176-bd42-3eb879faf428 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:48.669909 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a632808-5591-4176-bd42-3eb879faf428 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:48.685336 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1076/2183] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:49:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:49:48.686441 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a632808-5591-4176-bd42-3eb879faf428 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:48.697039 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a632808-5591-4176-bd42-3eb879faf428 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:48.703028 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b45147-5d5e-4a91-90a3-031a1dbbaf45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:48.703651 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b45147-5d5e-4a91-90a3-031a1dbbaf45 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:48.704246 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b45147-5d5e-4a91-90a3-031a1dbbaf45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:48.704246 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b45147-5d5e-4a91-90a3-031a1dbbaf45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:48.705174 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b45147-5d5e-4a91-90a3-031a1dbbaf45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:48.706931 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b45147-5d5e-4a91-90a3-031a1dbbaf45 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:48.780107 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4b465f98-f63f-4548-9fe1-fdf1b29ab8de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b1b9bc9f39c4c9eb8a3bd7a6488fd62', 'request_id': 'req-4b465f98-f63f-4548-9fe1-fdf1b29ab8de'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:48.821696 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1077/2184] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:49:48 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:49:48.828449 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b45147-5d5e-4a91-90a3-031a1dbbaf45 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:48.875411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4b465f98-f63f-4548-9fe1-fdf1b29ab8de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b1b9bc9f39c4c9eb8a3bd7a6488fd62', 'request_id': 'req-4b465f98-f63f-4548-9fe1-fdf1b29ab8de'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:48.886895 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4b465f98-f63f-4548-9fe1-fdf1b29ab8de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b1b9bc9f39c4c9eb8a3bd7a6488fd62', 'request_id': 'req-4b465f98-f63f-4548-9fe1-fdf1b29ab8de'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:48.899069 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b45147-5d5e-4a91-90a3-031a1dbbaf45 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:48.903301 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4b465f98-f63f-4548-9fe1-fdf1b29ab8de admin admin] The token cache is being invalidate because project 8b1b9bc9f39c4c9eb8a3bd7a6488fd62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:49:48.903738 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4b465f98-f63f-4548-9fe1-fdf1b29ab8de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:48.904840 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4b465f98-f63f-4548-9fe1-fdf1b29ab8de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:48.906301 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32063bbd-1310-4acb-b7ca-4a055b66bed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:48.906445 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1108/2185] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:49:48 2022] DELETE /identity/v3/projects/8b1b9bc9f39c4c9eb8a3bd7a6488fd62 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:48.907807 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbec65-cfea-4406-ae89-cbdaec175cd4 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:48.908102 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbec65-cfea-4406-ae89-cbdaec175cd4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:48.908381 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbec65-cfea-4406-ae89-cbdaec175cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:48.910153 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32063bbd-1310-4acb-b7ca-4a055b66bed9 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:48.910447 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32063bbd-1310-4acb-b7ca-4a055b66bed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:48.910729 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32063bbd-1310-4acb-b7ca-4a055b66bed9 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:48.912304 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32063bbd-1310-4acb-b7ca-4a055b66bed9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:48.914407 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32063bbd-1310-4acb-b7ca-4a055b66bed9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:48.933570 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c2cbec65-cfea-4406-ae89-cbdaec175cd4 None None] MFA Rules not processed for user `b612217c1da94e9db3bab736c2c85c59`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:48.935051 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c2cbec65-cfea-4406-ae89-cbdaec175cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:49.012191 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1109/2186] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:49.013269 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cbec65-cfea-4406-ae89-cbdaec175cd4 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:49.014445 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c2cbec65-cfea-4406-ae89-cbdaec175cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:49.029434 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cbec65-cfea-4406-ae89-cbdaec175cd4 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:49.034767 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e885b2-8d74-4018-96e1-7ad4d8271151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:49.035641 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e885b2-8d74-4018-96e1-7ad4d8271151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:49.035875 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e885b2-8d74-4018-96e1-7ad4d8271151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:49.036209 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e885b2-8d74-4018-96e1-7ad4d8271151 admin admin] PATH_INFO: `/v3/users/8f9ad49a80af4a3e82c266686ebc639a` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:49.037622 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e885b2-8d74-4018-96e1-7ad4d8271151 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f9ad49a80af4a3e82c266686ebc639a)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:49.039637 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e885b2-8d74-4018-96e1-7ad4d8271151 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:49.057703 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1078/2187] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:49:48 2022] POST /identity/v3/users => generated 293 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:49:49.061896 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32063bbd-1310-4acb-b7ca-4a055b66bed9 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:49.064047 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-32063bbd-1310-4acb-b7ca-4a055b66bed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:49.094620 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32063bbd-1310-4acb-b7ca-4a055b66bed9 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:49.107403 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685efda7-32a8-4003-9997-0437740153f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:49.108040 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685efda7-32a8-4003-9997-0437740153f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:49.108323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685efda7-32a8-4003-9997-0437740153f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:49.108601 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685efda7-32a8-4003-9997-0437740153f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:49.109287 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685efda7-32a8-4003-9997-0437740153f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:49.110881 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685efda7-32a8-4003-9997-0437740153f6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:49.124539 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1079/2188] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:49:49.128516 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685efda7-32a8-4003-9997-0437740153f6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:49.139849 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685efda7-32a8-4003-9997-0437740153f6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:49.145086 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a68bf-a3ab-4bd6-9f66-6d1f08c3caa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:49.145816 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a68bf-a3ab-4bd6-9f66-6d1f08c3caa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:49.146202 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a68bf-a3ab-4bd6-9f66-6d1f08c3caa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:49.146596 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a68bf-a3ab-4bd6-9f66-6d1f08c3caa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:49.147356 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0a68bf-a3ab-4bd6-9f66-6d1f08c3caa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:49.149163 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0a68bf-a3ab-4bd6-9f66-6d1f08c3caa8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:49.162516 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1080/2189] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:49:49.172192 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a68bf-a3ab-4bd6-9f66-6d1f08c3caa8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:49.182999 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a68bf-a3ab-4bd6-9f66-6d1f08c3caa8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:49.187848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f8249-05b6-4308-9644-616e99480565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:49.188510 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f8249-05b6-4308-9644-616e99480565 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:49.188790 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f8249-05b6-4308-9644-616e99480565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:49.189056 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f8249-05b6-4308-9644-616e99480565 admin admin] PATH_INFO: `/v3/projects/0b7bc657f9b84cfd911f03399e9692f1/users/06eef0a14f7c406e9eaf4c78d4fceea4/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:49.211323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f8249-05b6-4308-9644-616e99480565 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b7bc657f9b84cfd911f03399e9692f1, user_id=06eef0a14f7c406e9eaf4c78d4fceea4, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:49.214902 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f8249-05b6-4308-9644-616e99480565 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:49.321038 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1081/2190] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:49:49 2022] PUT /identity/v3/projects/0b7bc657f9b84cfd911f03399e9692f1/users/06eef0a14f7c406e9eaf4c78d4fceea4/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:49:49.341040 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-30e885b2-8d74-4018-96e1-7ad4d8271151 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f9ad49a80af4a3e82c266686ebc639a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:49.347255 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-30e885b2-8d74-4018-96e1-7ad4d8271151 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f9ad49a80af4a3e82c266686ebc639a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:49.347413 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d149a-f1b6-4b47-8226-39742aa7670c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:49.347707 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d149a-f1b6-4b47-8226-39742aa7670c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:49.348986 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d149a-f1b6-4b47-8226-39742aa7670c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:49.359837 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-30e885b2-8d74-4018-96e1-7ad4d8271151 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f9ad49a80af4a3e82c266686ebc639a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:49.379166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-30e885b2-8d74-4018-96e1-7ad4d8271151 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f9ad49a80af4a3e82c266686ebc639a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:49.379985 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-30e885b2-8d74-4018-96e1-7ad4d8271151 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f9ad49a80af4a3e82c266686ebc639a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:49.390972 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-6d3d149a-f1b6-4b47-8226-39742aa7670c None None] MFA Rules not processed for user `06eef0a14f7c406e9eaf4c78d4fceea4`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:49.392532 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6d3d149a-f1b6-4b47-8226-39742aa7670c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:49.460865 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1110/2191] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:49:49 2022] DELETE /identity/v3/users/8f9ad49a80af4a3e82c266686ebc639a => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:49.495818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1082/2192] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:49:49.502274 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e885b2-8d74-4018-96e1-7ad4d8271151 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:49.506260 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-30e885b2-8d74-4018-96e1-7ad4d8271151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:49.589505 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e885b2-8d74-4018-96e1-7ad4d8271151 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:49.594045 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:49.598784 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8edf7-bad3-4a47-97ff-c7c38b42767b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:49.598784 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8edf7-bad3-4a47-97ff-c7c38b42767b admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:49.598784 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8edf7-bad3-4a47-97ff-c7c38b42767b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:49.598784 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8edf7-bad3-4a47-97ff-c7c38b42767b admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:49.599739 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec8edf7-bad3-4a47-97ff-c7c38b42767b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:49.601004 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec8edf7-bad3-4a47-97ff-c7c38b42767b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:49.757096 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d149a-f1b6-4b47-8226-39742aa7670c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:49.757270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1111/2193] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:49:49 2022] POST /identity/v3/projects => generated 383 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:49:49.878328 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d149a-f1b6-4b47-8226-39742aa7670c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:49.973132 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf948682-bd2c-4044-bbb4-08cb4e0ab83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:49.973832 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf948682-bd2c-4044-bbb4-08cb4e0ab83b admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:49.974198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf948682-bd2c-4044-bbb4-08cb4e0ab83b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:49.974490 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf948682-bd2c-4044-bbb4-08cb4e0ab83b admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:49.975148 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf948682-bd2c-4044-bbb4-08cb4e0ab83b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:49.977294 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf948682-bd2c-4044-bbb4-08cb4e0ab83b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:50.101313 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:50.108646 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1083/2194] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:49:49 2022] POST /identity/v3/users => generated 298 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:49:50.112787 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8edf7-bad3-4a47-97ff-c7c38b42767b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:50.124466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8edf7-bad3-4a47-97ff-c7c38b42767b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:50.129797 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0cda4-3347-41d7-9df6-f3a3cdcd8e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:50.130515 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0cda4-3347-41d7-9df6-f3a3cdcd8e48 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:50.130869 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0cda4-3347-41d7-9df6-f3a3cdcd8e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:50.131146 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0cda4-3347-41d7-9df6-f3a3cdcd8e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:50.131881 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0cda4-3347-41d7-9df6-f3a3cdcd8e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:50.133654 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0cda4-3347-41d7-9df6-f3a3cdcd8e48 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:50.147452 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1112/2195] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:49:50.153203 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf948682-bd2c-4044-bbb4-08cb4e0ab83b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:50.166319 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf948682-bd2c-4044-bbb4-08cb4e0ab83b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:50.171131 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892cbed-cd9a-4075-868a-c8d8a47e0a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:50.171794 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892cbed-cd9a-4075-868a-c8d8a47e0a76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:50.172080 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892cbed-cd9a-4075-868a-c8d8a47e0a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:50.172333 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892cbed-cd9a-4075-868a-c8d8a47e0a76 admin admin] PATH_INFO: `/v3/projects/1eca3428b9a84f0f90e8b822d3514bb0/users/125db037f633478b838d7406db740a49/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:50.178890 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0cda4-3347-41d7-9df6-f3a3cdcd8e48 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:50.180918 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1ae0cda4-3347-41d7-9df6-f3a3cdcd8e48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:50.190797 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892cbed-cd9a-4075-868a-c8d8a47e0a76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eca3428b9a84f0f90e8b822d3514bb0, user_id=125db037f633478b838d7406db740a49, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:50.194525 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892cbed-cd9a-4075-868a-c8d8a47e0a76 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:50.262004 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0cda4-3347-41d7-9df6-f3a3cdcd8e48 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:50.266808 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8b864-37c4-4995-b77c-de42a555d797 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:50.267433 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8b864-37c4-4995-b77c-de42a555d797 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:50.268193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8b864-37c4-4995-b77c-de42a555d797 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:50.268468 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8b864-37c4-4995-b77c-de42a555d797 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:50.270473 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-55f8b864-37c4-4995-b77c-de42a555d797 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:50.281148 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1084/2196] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:49:50 2022] PUT /identity/v3/projects/1eca3428b9a84f0f90e8b822d3514bb0/users/125db037f633478b838d7406db740a49/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:50.288794 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892cbed-cd9a-4075-868a-c8d8a47e0a76 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:50.292114 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e892cbed-cd9a-4075-868a-c8d8a47e0a76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:50.371777 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f8b864-37c4-4995-b77c-de42a555d797 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:50.374236 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f8b864-37c4-4995-b77c-de42a555d797 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:50.393368 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1113/2197] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:49:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 03:49:50.394386 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8b864-37c4-4995-b77c-de42a555d797 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:50.412988 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8b864-37c4-4995-b77c-de42a555d797 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:50.418788 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a857bf-edf0-4772-b7aa-f1ce06fbe9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:50.419085 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892cbed-cd9a-4075-868a-c8d8a47e0a76 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:50.419823 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a857bf-edf0-4772-b7aa-f1ce06fbe9ad admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:50.420384 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a857bf-edf0-4772-b7aa-f1ce06fbe9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:50.420699 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a857bf-edf0-4772-b7aa-f1ce06fbe9ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:50.421534 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a857bf-edf0-4772-b7aa-f1ce06fbe9ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:50.423246 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a857bf-edf0-4772-b7aa-f1ce06fbe9ad admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:50.426364 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4abdc8d-ba2c-4384-b283-f113e3fe5c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:50.426364 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abdc8d-ba2c-4384-b283-f113e3fe5c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:50.426364 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abdc8d-ba2c-4384-b283-f113e3fe5c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:50.426364 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abdc8d-ba2c-4384-b283-f113e3fe5c17 admin admin] PATH_INFO: `/v3/projects/d92ab8315f2f4621a26ded57e2a129f7` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:50.426715 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4abdc8d-ba2c-4384-b283-f113e3fe5c17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d92ab8315f2f4621a26ded57e2a129f7)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:50.428616 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4abdc8d-ba2c-4384-b283-f113e3fe5c17 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:50.437314 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1114/2198] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:49:50.443937 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a857bf-edf0-4772-b7aa-f1ce06fbe9ad admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:50.455542 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a857bf-edf0-4772-b7aa-f1ce06fbe9ad admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:50.462230 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dabc462-e7c3-474d-a1dc-5609e6dbbc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:50.462797 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabc462-e7c3-474d-a1dc-5609e6dbbc5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:50.463149 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabc462-e7c3-474d-a1dc-5609e6dbbc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:50.463500 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabc462-e7c3-474d-a1dc-5609e6dbbc5f admin admin] PATH_INFO: `/v3/projects/1eca3428b9a84f0f90e8b822d3514bb0/users/125db037f633478b838d7406db740a49/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:50.465475 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dabc462-e7c3-474d-a1dc-5609e6dbbc5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eca3428b9a84f0f90e8b822d3514bb0, user_id=125db037f633478b838d7406db740a49, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:50.469844 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dabc462-e7c3-474d-a1dc-5609e6dbbc5f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:50.502850 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1115/2199] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:49:50 2022] PUT /identity/v3/projects/1eca3428b9a84f0f90e8b822d3514bb0/users/125db037f633478b838d7406db740a49/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:50.505150 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160a45a-65a8-4a3f-b6da-25b429392038 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:50.505614 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160a45a-65a8-4a3f-b6da-25b429392038 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:50.506614 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160a45a-65a8-4a3f-b6da-25b429392038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:50.566256 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f4abdc8d-ba2c-4384-b283-f113e3fe5c17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd92ab8315f2f4621a26ded57e2a129f7', 'request_id': 'req-f4abdc8d-ba2c-4384-b283-f113e3fe5c17'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:50.575105 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1160a45a-65a8-4a3f-b6da-25b429392038 None None] MFA Rules not processed for user `125db037f633478b838d7406db740a49`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:50.576349 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1160a45a-65a8-4a3f-b6da-25b429392038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:50.665724 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1116/2200] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:50 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:50.713429 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f4abdc8d-ba2c-4384-b283-f113e3fe5c17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd92ab8315f2f4621a26ded57e2a129f7', 'request_id': 'req-f4abdc8d-ba2c-4384-b283-f113e3fe5c17'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:50.720305 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f4abdc8d-ba2c-4384-b283-f113e3fe5c17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd92ab8315f2f4621a26ded57e2a129f7', 'request_id': 'req-f4abdc8d-ba2c-4384-b283-f113e3fe5c17'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:50.730723 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f4abdc8d-ba2c-4384-b283-f113e3fe5c17 admin admin] The token cache is being invalidate because project d92ab8315f2f4621a26ded57e2a129f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:49:50.731012 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f4abdc8d-ba2c-4384-b283-f113e3fe5c17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:50.731675 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f4abdc8d-ba2c-4384-b283-f113e3fe5c17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:50.733663 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1085/2201] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:49:50 2022] DELETE /identity/v3/projects/d92ab8315f2f4621a26ded57e2a129f7 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:50.738325 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6019e0b-2d9a-454f-b93a-63219f44c569 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:50.738615 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6019e0b-2d9a-454f-b93a-63219f44c569 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:50.738896 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6019e0b-2d9a-454f-b93a-63219f44c569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:50.765058 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f6019e0b-2d9a-454f-b93a-63219f44c569 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:50.765352 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f6019e0b-2d9a-454f-b93a-63219f44c569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:50.835081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1117/2202] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:50.843842 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2c478-82d6-43bf-97fa-dc0b69e83f73 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:50.844105 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2c478-82d6-43bf-97fa-dc0b69e83f73 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:50.844671 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2c478-82d6-43bf-97fa-dc0b69e83f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:50.866877 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-23b2c478-82d6-43bf-97fa-dc0b69e83f73 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:50.868120 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-23b2c478-82d6-43bf-97fa-dc0b69e83f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:50.877503 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1086/2203] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:50.882491 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6019e0b-2d9a-454f-b93a-63219f44c569 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:50.892729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6019e0b-2d9a-454f-b93a-63219f44c569 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:50.898260 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df0280-81cd-4843-9a7f-313c1df1b628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:50.899028 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df0280-81cd-4843-9a7f-313c1df1b628 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:50.899304 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df0280-81cd-4843-9a7f-313c1df1b628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:50.899580 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df0280-81cd-4843-9a7f-313c1df1b628 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:50.900233 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df0280-81cd-4843-9a7f-313c1df1b628 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:49:50.900567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df0280-81cd-4843-9a7f-313c1df1b628 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:50.902206 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df0280-81cd-4843-9a7f-313c1df1b628 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:50.915719 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1118/2204] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:49:50.920163 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2c478-82d6-43bf-97fa-dc0b69e83f73 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:50.944002 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2c478-82d6-43bf-97fa-dc0b69e83f73 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:50.948712 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7cb4f-e02f-418b-b15c-8d68d162ab1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:50.949324 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7cb4f-e02f-418b-b15c-8d68d162ab1d admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:50.949603 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7cb4f-e02f-418b-b15c-8d68d162ab1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:50.953861 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7cb4f-e02f-418b-b15c-8d68d162ab1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:50.954638 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c7cb4f-e02f-418b-b15c-8d68d162ab1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:50.960155 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c7cb4f-e02f-418b-b15c-8d68d162ab1d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:51.121882 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1087/2205] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:49:50 2022] POST /identity/v3/projects => generated 385 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:49:51.125974 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df0280-81cd-4843-9a7f-313c1df1b628 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:51.136285 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df0280-81cd-4843-9a7f-313c1df1b628 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:51.190473 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96fa658-b79f-44bd-8605-c4fc7cff9f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:51.191075 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fa658-b79f-44bd-8605-c4fc7cff9f49 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:51.191390 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fa658-b79f-44bd-8605-c4fc7cff9f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:51.191684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fa658-b79f-44bd-8605-c4fc7cff9f49 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:51.192316 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96fa658-b79f-44bd-8605-c4fc7cff9f49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:51.194275 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96fa658-b79f-44bd-8605-c4fc7cff9f49 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:51.260476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7cb4f-e02f-418b-b15c-8d68d162ab1d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:51.262294 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b0c7cb4f-e02f-418b-b15c-8d68d162ab1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:51.302354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1119/2206] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:49:51 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:49:51.306234 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96fa658-b79f-44bd-8605-c4fc7cff9f49 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:51.316499 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96fa658-b79f-44bd-8605-c4fc7cff9f49 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:51.321293 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d2dfd-fca5-4016-9e4e-8399efff1660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:51.321935 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d2dfd-fca5-4016-9e4e-8399efff1660 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:51.322214 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d2dfd-fca5-4016-9e4e-8399efff1660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:51.322510 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d2dfd-fca5-4016-9e4e-8399efff1660 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:51.322639 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7cb4f-e02f-418b-b15c-8d68d162ab1d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:51.323901 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61d2dfd-fca5-4016-9e4e-8399efff1660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:51.325586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61d2dfd-fca5-4016-9e4e-8399efff1660 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:51.327107 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341979a-bb3c-49b3-8142-66dd60b30810 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:51.328192 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341979a-bb3c-49b3-8142-66dd60b30810 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:51.328576 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341979a-bb3c-49b3-8142-66dd60b30810 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:51.329068 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341979a-bb3c-49b3-8142-66dd60b30810 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:51.331502 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f341979a-bb3c-49b3-8142-66dd60b30810 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:51.337031 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1120/2207] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:49:51.341022 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d2dfd-fca5-4016-9e4e-8399efff1660 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:51.351714 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d2dfd-fca5-4016-9e4e-8399efff1660 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:51.356647 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22df3e-4221-48b2-a4c9-bf0404ac6c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:51.357275 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22df3e-4221-48b2-a4c9-bf0404ac6c18 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:51.357581 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22df3e-4221-48b2-a4c9-bf0404ac6c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:51.357892 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22df3e-4221-48b2-a4c9-bf0404ac6c18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:51.358540 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22df3e-4221-48b2-a4c9-bf0404ac6c18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:51.360489 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22df3e-4221-48b2-a4c9-bf0404ac6c18 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:51.372865 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1121/2208] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:49:51.376641 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22df3e-4221-48b2-a4c9-bf0404ac6c18 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:51.386759 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22df3e-4221-48b2-a4c9-bf0404ac6c18 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:51.391373 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d19c7d-49bb-4f9c-9e37-af8166a57b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:51.392037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d19c7d-49bb-4f9c-9e37-af8166a57b88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:51.392322 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d19c7d-49bb-4f9c-9e37-af8166a57b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:51.392595 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d19c7d-49bb-4f9c-9e37-af8166a57b88 admin admin] PATH_INFO: `/v3/projects/20a15a57cec04e2c82e5f52c4eb86234/users/8ea10f87467e4f6e98e3da1d2340cac8/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:51.405732 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f341979a-bb3c-49b3-8142-66dd60b30810 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:51.407165 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f341979a-bb3c-49b3-8142-66dd60b30810 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:51.410079 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d19c7d-49bb-4f9c-9e37-af8166a57b88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20a15a57cec04e2c82e5f52c4eb86234, user_id=8ea10f87467e4f6e98e3da1d2340cac8, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:51.413715 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d19c7d-49bb-4f9c-9e37-af8166a57b88 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:51.416586 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1088/2209] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:49:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 03:49:51.528868 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1122/2210] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:49:51 2022] PUT /identity/v3/projects/20a15a57cec04e2c82e5f52c4eb86234/users/8ea10f87467e4f6e98e3da1d2340cac8/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:51.540377 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974f331-3547-4d5c-8abf-3a8580f27a3a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:51.540739 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974f331-3547-4d5c-8abf-3a8580f27a3a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:51.541022 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974f331-3547-4d5c-8abf-3a8580f27a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:51.572784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2974f331-3547-4d5c-8abf-3a8580f27a3a None None] MFA Rules not processed for user `8ea10f87467e4f6e98e3da1d2340cac8`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:51.574040 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2974f331-3547-4d5c-8abf-3a8580f27a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:51.643065 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1089/2211] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:51.648498 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d19c7d-49bb-4f9c-9e37-af8166a57b88 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:51.730831 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d19c7d-49bb-4f9c-9e37-af8166a57b88 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:51.735624 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec88c6-a7d7-4255-bda5-79c5ef298d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:51.739087 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec88c6-a7d7-4255-bda5-79c5ef298d83 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:51.739087 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec88c6-a7d7-4255-bda5-79c5ef298d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:51.739087 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec88c6-a7d7-4255-bda5-79c5ef298d83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:51.739087 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ec88c6-a7d7-4255-bda5-79c5ef298d83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:51.739437 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ec88c6-a7d7-4255-bda5-79c5ef298d83 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:51.838741 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1123/2212] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:49:51 2022] POST /identity/v3/projects => generated 387 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:49:51.844506 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974f331-3547-4d5c-8abf-3a8580f27a3a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:51.858226 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974f331-3547-4d5c-8abf-3a8580f27a3a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:51.931320 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d4704-f36a-44a0-a20b-4e44e20a588d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:51.931933 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d4704-f36a-44a0-a20b-4e44e20a588d admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:51.932265 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d4704-f36a-44a0-a20b-4e44e20a588d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:51.932544 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d4704-f36a-44a0-a20b-4e44e20a588d admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:51.933176 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d4704-f36a-44a0-a20b-4e44e20a588d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:51.935261 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d4704-f36a-44a0-a20b-4e44e20a588d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:52.082990 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1090/2213] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:49:51 2022] POST /identity/v3/users => generated 300 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:49:52.087510 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec88c6-a7d7-4255-bda5-79c5ef298d83 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:52.102664 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec88c6-a7d7-4255-bda5-79c5ef298d83 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:52.111086 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4f737-31a3-436d-854f-92bc2d2795d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:52.111968 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4f737-31a3-436d-854f-92bc2d2795d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:52.112088 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4f737-31a3-436d-854f-92bc2d2795d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:52.112305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4f737-31a3-436d-854f-92bc2d2795d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:52.115705 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4f737-31a3-436d-854f-92bc2d2795d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:52.117496 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4f737-31a3-436d-854f-92bc2d2795d6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:52.131249 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1124/2214] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:49:52.135529 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d4704-f36a-44a0-a20b-4e44e20a588d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:52.145498 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d4704-f36a-44a0-a20b-4e44e20a588d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:52.150809 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e22632-7f41-4845-b0db-63f25888bbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:52.151499 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e22632-7f41-4845-b0db-63f25888bbd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:52.151877 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e22632-7f41-4845-b0db-63f25888bbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:52.152154 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e22632-7f41-4845-b0db-63f25888bbd1 admin admin] PATH_INFO: `/v3/projects/dc0bb514a448401281f23ac7c98e8729/users/b970593798d94e8a8467477cf5d2279d/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:52.168215 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e22632-7f41-4845-b0db-63f25888bbd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc0bb514a448401281f23ac7c98e8729, user_id=b970593798d94e8a8467477cf5d2279d, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:52.170885 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e22632-7f41-4845-b0db-63f25888bbd1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:52.290733 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1091/2215] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:49:52 2022] PUT /identity/v3/projects/dc0bb514a448401281f23ac7c98e8729/users/b970593798d94e8a8467477cf5d2279d/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:52.294753 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4f737-31a3-436d-854f-92bc2d2795d6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:52.304661 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4f737-31a3-436d-854f-92bc2d2795d6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:52.381494 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd62a3-3f8c-41da-bc3c-1f44db7e88cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:52.382472 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd62a3-3f8c-41da-bc3c-1f44db7e88cf admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:52.382754 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd62a3-3f8c-41da-bc3c-1f44db7e88cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:52.383722 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd62a3-3f8c-41da-bc3c-1f44db7e88cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:52.384382 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cd62a3-3f8c-41da-bc3c-1f44db7e88cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:52.386218 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cd62a3-3f8c-41da-bc3c-1f44db7e88cf admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:52.398674 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1125/2216] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:49:52.402563 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e22632-7f41-4845-b0db-63f25888bbd1 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:52.413685 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e22632-7f41-4845-b0db-63f25888bbd1 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:52.426314 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784d8b3-d277-4e1b-ab6a-8fb093c45bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:52.427031 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784d8b3-d277-4e1b-ab6a-8fb093c45bb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:52.427455 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784d8b3-d277-4e1b-ab6a-8fb093c45bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:52.427635 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784d8b3-d277-4e1b-ab6a-8fb093c45bb5 admin admin] PATH_INFO: `/v3/projects/dc0bb514a448401281f23ac7c98e8729/users/b970593798d94e8a8467477cf5d2279d/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:52.429775 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784d8b3-d277-4e1b-ab6a-8fb093c45bb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc0bb514a448401281f23ac7c98e8729, user_id=b970593798d94e8a8467477cf5d2279d, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:52.432678 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784d8b3-d277-4e1b-ab6a-8fb093c45bb5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:52.454073 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1092/2217] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:49:52 2022] PUT /identity/v3/projects/dc0bb514a448401281f23ac7c98e8729/users/b970593798d94e8a8467477cf5d2279d/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:52.467067 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0308b-bb9d-45fa-8ab8-0d9027b2b913 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:52.468002 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0308b-bb9d-45fa-8ab8-0d9027b2b913 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:52.468290 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0308b-bb9d-45fa-8ab8-0d9027b2b913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:52.504180 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-55a0308b-bb9d-45fa-8ab8-0d9027b2b913 None None] MFA Rules not processed for user `b970593798d94e8a8467477cf5d2279d`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:52.505221 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-55a0308b-bb9d-45fa-8ab8-0d9027b2b913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:52.660412 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1126/2218] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:52 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:49:52.670954 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784d8b3-d277-4e1b-ab6a-8fb093c45bb5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:52.806969 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784d8b3-d277-4e1b-ab6a-8fb093c45bb5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:52.811815 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c141c6-5d14-4dc9-b24e-66d8802d4ce6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:52.812502 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c141c6-5d14-4dc9-b24e-66d8802d4ce6 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:52.812787 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c141c6-5d14-4dc9-b24e-66d8802d4ce6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:52.813777 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c141c6-5d14-4dc9-b24e-66d8802d4ce6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:52.826564 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c141c6-5d14-4dc9-b24e-66d8802d4ce6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:52.828615 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c141c6-5d14-4dc9-b24e-66d8802d4ce6 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:52.850110 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1093/2219] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:49:52 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:49:52.948788 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a0308b-bb9d-45fa-8ab8-0d9027b2b913 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:52.950201 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c141c6-5d14-4dc9-b24e-66d8802d4ce6 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:52.959191 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c141c6-5d14-4dc9-b24e-66d8802d4ce6 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:52.963510 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac421e-3581-437e-8dc0-f08cc3a5defa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:52.964123 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac421e-3581-437e-8dc0-f08cc3a5defa service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:52.964406 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac421e-3581-437e-8dc0-f08cc3a5defa service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:52.964681 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac421e-3581-437e-8dc0-f08cc3a5defa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:52.967377 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-08ac421e-3581-437e-8dc0-f08cc3a5defa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:53.027634 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a0308b-bb9d-45fa-8ab8-0d9027b2b913 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:53.033277 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0e028-a792-4239-b6a0-a5780ba1d489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:53.033995 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0e028-a792-4239-b6a0-a5780ba1d489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:53.034234 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0e028-a792-4239-b6a0-a5780ba1d489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:53.035186 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0e028-a792-4239-b6a0-a5780ba1d489 admin admin] PATH_INFO: `/v3/users/8ea10f87467e4f6e98e3da1d2340cac8` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:53.036162 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0e028-a792-4239-b6a0-a5780ba1d489 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ea10f87467e4f6e98e3da1d2340cac8)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:53.038709 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0e028-a792-4239-b6a0-a5780ba1d489 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:53.045589 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ac421e-3581-437e-8dc0-f08cc3a5defa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:53.045935 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ac421e-3581-437e-8dc0-f08cc3a5defa service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:53.056707 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1094/2220] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:49:52 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 03:49:53.278628 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-dfa0e028-a792-4239-b6a0-a5780ba1d489 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ea10f87467e4f6e98e3da1d2340cac8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:53.279304 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-dfa0e028-a792-4239-b6a0-a5780ba1d489 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ea10f87467e4f6e98e3da1d2340cac8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:53.287836 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-dfa0e028-a792-4239-b6a0-a5780ba1d489 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ea10f87467e4f6e98e3da1d2340cac8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:53.314351 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-dfa0e028-a792-4239-b6a0-a5780ba1d489 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ea10f87467e4f6e98e3da1d2340cac8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:53.316810 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-dfa0e028-a792-4239-b6a0-a5780ba1d489 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ea10f87467e4f6e98e3da1d2340cac8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:53.541994 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1127/2221] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:49:52 2022] DELETE /identity/v3/users/8ea10f87467e4f6e98e3da1d2340cac8 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:53.546786 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c5bee-a5b5-436c-841e-d72009108e9c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:53.549730 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c5bee-a5b5-436c-841e-d72009108e9c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:53.549730 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c5bee-a5b5-436c-841e-d72009108e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:53.600589 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d95c5bee-a5b5-436c-841e-d72009108e9c None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:53.603517 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d95c5bee-a5b5-436c-841e-d72009108e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:53.711902 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1095/2222] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:53.725074 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0e028-a792-4239-b6a0-a5780ba1d489 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:53.725074 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-dfa0e028-a792-4239-b6a0-a5780ba1d489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:53.794376 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0e028-a792-4239-b6a0-a5780ba1d489 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:53.798600 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd03ba-9609-4d7a-8c60-f1ac448016e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:53.799245 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd03ba-9609-4d7a-8c60-f1ac448016e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:53.799531 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd03ba-9609-4d7a-8c60-f1ac448016e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:53.799990 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd03ba-9609-4d7a-8c60-f1ac448016e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:53.815094 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd03ba-9609-4d7a-8c60-f1ac448016e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:53.816678 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd03ba-9609-4d7a-8c60-f1ac448016e6 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:53.828135 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1128/2223] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:49:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 03:49:54.142919 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:54.342766 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:54.583697 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c5bee-a5b5-436c-841e-d72009108e9c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:54.586295 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d95c5bee-a5b5-436c-841e-d72009108e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:54.603707 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c5bee-a5b5-436c-841e-d72009108e9c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:54.611619 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c666a83-7431-4e00-ae13-55165595237d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:54.616291 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c666a83-7431-4e00-ae13-55165595237d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:54.616291 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c666a83-7431-4e00-ae13-55165595237d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:54.616291 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c666a83-7431-4e00-ae13-55165595237d admin admin] PATH_INFO: `/v3/projects/20a15a57cec04e2c82e5f52c4eb86234` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:54.623590 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c666a83-7431-4e00-ae13-55165595237d admin admin] RBAC: Authorizing `identity:delete_project(project_id=20a15a57cec04e2c82e5f52c4eb86234)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:54.626273 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c666a83-7431-4e00-ae13-55165595237d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:54.792650 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0c666a83-7431-4e00-ae13-55165595237d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20a15a57cec04e2c82e5f52c4eb86234', 'request_id': 'req-0c666a83-7431-4e00-ae13-55165595237d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:54.940087 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0c666a83-7431-4e00-ae13-55165595237d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20a15a57cec04e2c82e5f52c4eb86234', 'request_id': 'req-0c666a83-7431-4e00-ae13-55165595237d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:54.947249 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0c666a83-7431-4e00-ae13-55165595237d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20a15a57cec04e2c82e5f52c4eb86234', 'request_id': 'req-0c666a83-7431-4e00-ae13-55165595237d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:54.958006 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0c666a83-7431-4e00-ae13-55165595237d admin admin] The token cache is being invalidate because project 20a15a57cec04e2c82e5f52c4eb86234 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:49:54.958472 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0c666a83-7431-4e00-ae13-55165595237d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:54.959644 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0c666a83-7431-4e00-ae13-55165595237d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:54.961129 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1096/2224] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:49:54 2022] DELETE /identity/v3/projects/20a15a57cec04e2c82e5f52c4eb86234 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:54.965237 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd03ba-9609-4d7a-8c60-f1ac448016e6 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:54.975705 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd03ba-9609-4d7a-8c60-f1ac448016e6 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:55.034152 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0804f3-d64a-4ac3-ab1e-fca3d7271fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:55.035021 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0804f3-d64a-4ac3-ab1e-fca3d7271fde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:55.035639 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0804f3-d64a-4ac3-ab1e-fca3d7271fde admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:55.035783 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0804f3-d64a-4ac3-ab1e-fca3d7271fde admin admin] PATH_INFO: `/v3/users/b970593798d94e8a8467477cf5d2279d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:55.039085 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0804f3-d64a-4ac3-ab1e-fca3d7271fde admin admin] RBAC: Authorizing `identity:delete_user(user_id=b970593798d94e8a8467477cf5d2279d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:55.041077 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0804f3-d64a-4ac3-ab1e-fca3d7271fde admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:55.402953 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cf0804f3-d64a-4ac3-ab1e-fca3d7271fde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b970593798d94e8a8467477cf5d2279d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:55.403561 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cf0804f3-d64a-4ac3-ab1e-fca3d7271fde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b970593798d94e8a8467477cf5d2279d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:55.410730 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cf0804f3-d64a-4ac3-ab1e-fca3d7271fde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b970593798d94e8a8467477cf5d2279d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:55.422327 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cf0804f3-d64a-4ac3-ab1e-fca3d7271fde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b970593798d94e8a8467477cf5d2279d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:55.423039 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cf0804f3-d64a-4ac3-ab1e-fca3d7271fde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b970593798d94e8a8467477cf5d2279d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:55.570416 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1129/2225] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:49:54 2022] DELETE /identity/v3/users/b970593798d94e8a8467477cf5d2279d => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:49:56.126970 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c666a83-7431-4e00-ae13-55165595237d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:56.126970 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0c666a83-7431-4e00-ae13-55165595237d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:56.142213 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c666a83-7431-4e00-ae13-55165595237d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:56.211046 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d99fd-f61a-4e60-8672-97c1b813ac90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:56.211710 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d99fd-f61a-4e60-8672-97c1b813ac90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:56.211999 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d99fd-f61a-4e60-8672-97c1b813ac90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:56.212278 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d99fd-f61a-4e60-8672-97c1b813ac90 admin admin] PATH_INFO: `/v3/projects/dc0bb514a448401281f23ac7c98e8729` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:56.213444 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d99fd-f61a-4e60-8672-97c1b813ac90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc0bb514a448401281f23ac7c98e8729)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:56.215485 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d99fd-f61a-4e60-8672-97c1b813ac90 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:56.342773 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-385d99fd-f61a-4e60-8672-97c1b813ac90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc0bb514a448401281f23ac7c98e8729', 'request_id': 'req-385d99fd-f61a-4e60-8672-97c1b813ac90'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:56.415002 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-385d99fd-f61a-4e60-8672-97c1b813ac90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc0bb514a448401281f23ac7c98e8729', 'request_id': 'req-385d99fd-f61a-4e60-8672-97c1b813ac90'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:56.422120 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-385d99fd-f61a-4e60-8672-97c1b813ac90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc0bb514a448401281f23ac7c98e8729', 'request_id': 'req-385d99fd-f61a-4e60-8672-97c1b813ac90'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:56.433030 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-385d99fd-f61a-4e60-8672-97c1b813ac90 admin admin] The token cache is being invalidate because project dc0bb514a448401281f23ac7c98e8729 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:49:56.433324 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-385d99fd-f61a-4e60-8672-97c1b813ac90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:56.434014 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-385d99fd-f61a-4e60-8672-97c1b813ac90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:56.435504 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1097/2226] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:49:56 2022] DELETE /identity/v3/projects/dc0bb514a448401281f23ac7c98e8729 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:56.440489 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc414d6b-1228-4678-bb3d-103a6eb3e092 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:56.440964 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc414d6b-1228-4678-bb3d-103a6eb3e092 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:56.441057 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc414d6b-1228-4678-bb3d-103a6eb3e092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:56.461675 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-bc414d6b-1228-4678-bb3d-103a6eb3e092 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:56.462893 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bc414d6b-1228-4678-bb3d-103a6eb3e092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:56.550145 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1130/2227] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:56.563045 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d07436-ea05-46a2-a760-ff6a45a83ca5 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:56.563329 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d07436-ea05-46a2-a760-ff6a45a83ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:56.563602 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d07436-ea05-46a2-a760-ff6a45a83ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:56.586306 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-83d07436-ea05-46a2-a760-ff6a45a83ca5 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:56.587844 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-83d07436-ea05-46a2-a760-ff6a45a83ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:56.602062 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1098/2228] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:49:56.602954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc414d6b-1228-4678-bb3d-103a6eb3e092 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:56.623567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc414d6b-1228-4678-bb3d-103a6eb3e092 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:56.631596 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83615d5-6649-45d2-a8d8-384ffb820360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:56.632264 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83615d5-6649-45d2-a8d8-384ffb820360 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:56.632549 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83615d5-6649-45d2-a8d8-384ffb820360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:56.637407 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83615d5-6649-45d2-a8d8-384ffb820360 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:56.637407 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83615d5-6649-45d2-a8d8-384ffb820360 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:49:56.637407 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83615d5-6649-45d2-a8d8-384ffb820360 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:56.637407 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83615d5-6649-45d2-a8d8-384ffb820360 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:56.650275 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1131/2229] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:49:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:49:56.654551 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d07436-ea05-46a2-a760-ff6a45a83ca5 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:56.685206 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d07436-ea05-46a2-a760-ff6a45a83ca5 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:56.692135 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31824e-7b0d-4165-b847-d17a3bdca95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:56.693543 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31824e-7b0d-4165-b847-d17a3bdca95c admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:56.694086 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31824e-7b0d-4165-b847-d17a3bdca95c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:56.694824 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31824e-7b0d-4165-b847-d17a3bdca95c admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:56.695660 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31824e-7b0d-4165-b847-d17a3bdca95c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:56.698961 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31824e-7b0d-4165-b847-d17a3bdca95c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:56.830268 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1099/2230] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:49:56 2022] POST /identity/v3/projects => generated 367 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:49:56.834205 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83615d5-6649-45d2-a8d8-384ffb820360 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:56.857008 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83615d5-6649-45d2-a8d8-384ffb820360 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:56.930370 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1c5af-0dab-450a-9521-47e1f1bc5b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:56.930982 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1c5af-0dab-450a-9521-47e1f1bc5b18 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:56.931264 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1c5af-0dab-450a-9521-47e1f1bc5b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:56.931548 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1c5af-0dab-450a-9521-47e1f1bc5b18 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:56.932248 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e1c5af-0dab-450a-9521-47e1f1bc5b18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:56.934312 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e1c5af-0dab-450a-9521-47e1f1bc5b18 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:57.085568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1132/2231] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:49:56 2022] POST /identity/v3/users => generated 284 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:49:57.090183 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31824e-7b0d-4165-b847-d17a3bdca95c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:57.104880 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31824e-7b0d-4165-b847-d17a3bdca95c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:57.112763 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6576a82-29df-4000-959e-8c4ad0d909c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:57.112901 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6576a82-29df-4000-959e-8c4ad0d909c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:57.113194 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6576a82-29df-4000-959e-8c4ad0d909c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:57.113471 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6576a82-29df-4000-959e-8c4ad0d909c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:57.114216 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6576a82-29df-4000-959e-8c4ad0d909c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:57.116531 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6576a82-29df-4000-959e-8c4ad0d909c9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:57.128777 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1100/2232] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:49:57.133531 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1c5af-0dab-450a-9521-47e1f1bc5b18 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:57.174318 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1c5af-0dab-450a-9521-47e1f1bc5b18 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:57.199908 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6498c0b3-5b24-4ee0-b023-095fbe843f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:57.201659 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498c0b3-5b24-4ee0-b023-095fbe843f3e admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:57.201659 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498c0b3-5b24-4ee0-b023-095fbe843f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:57.202893 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498c0b3-5b24-4ee0-b023-095fbe843f3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:57.203659 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6498c0b3-5b24-4ee0-b023-095fbe843f3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:57.205234 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6498c0b3-5b24-4ee0-b023-095fbe843f3e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:57.240437 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1133/2233] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:49:57.245529 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6576a82-29df-4000-959e-8c4ad0d909c9 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:57.261532 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6576a82-29df-4000-959e-8c4ad0d909c9 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:57.267445 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa27c2-6e99-4562-b724-043aed214503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:57.268119 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa27c2-6e99-4562-b724-043aed214503 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:57.268600 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa27c2-6e99-4562-b724-043aed214503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:57.269105 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa27c2-6e99-4562-b724-043aed214503 admin admin] PATH_INFO: `/v3/projects/a9ea34a1fbff46ae8d2b494157209525/users/26b4aa5f61a14886b20d4ba5ce0b073a/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:57.293225 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa27c2-6e99-4562-b724-043aed214503 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9ea34a1fbff46ae8d2b494157209525, user_id=26b4aa5f61a14886b20d4ba5ce0b073a, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:57.296282 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa27c2-6e99-4562-b724-043aed214503 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:57.546096 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1101/2234] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:49:57 2022] PUT /identity/v3/projects/a9ea34a1fbff46ae8d2b494157209525/users/26b4aa5f61a14886b20d4ba5ce0b073a/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:57.579142 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b44b8-17c4-40dd-8a18-9502e0647781 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:57.579695 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b44b8-17c4-40dd-8a18-9502e0647781 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:57.579695 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b44b8-17c4-40dd-8a18-9502e0647781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:57.614323 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c84b44b8-17c4-40dd-8a18-9502e0647781 None None] MFA Rules not processed for user `26b4aa5f61a14886b20d4ba5ce0b073a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:57.616128 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c84b44b8-17c4-40dd-8a18-9502e0647781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:57.711026 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1134/2235] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:57.711695 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa27c2-6e99-4562-b724-043aed214503 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:57.787632 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa27c2-6e99-4562-b724-043aed214503 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:57.792522 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec99acc-74fd-440d-ba69-fa34c7ca7de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:57.793257 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec99acc-74fd-440d-ba69-fa34c7ca7de0 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:57.793741 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec99acc-74fd-440d-ba69-fa34c7ca7de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:57.793977 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec99acc-74fd-440d-ba69-fa34c7ca7de0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:57.795007 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec99acc-74fd-440d-ba69-fa34c7ca7de0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:57.796878 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec99acc-74fd-440d-ba69-fa34c7ca7de0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:57.824436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b44b8-17c4-40dd-8a18-9502e0647781 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:57.825977 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c84b44b8-17c4-40dd-8a18-9502e0647781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:57.883912 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b44b8-17c4-40dd-8a18-9502e0647781 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:57.887489 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0173997-bfc9-41af-9e21-66dbe58ef844 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:57.888101 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0173997-bfc9-41af-9e21-66dbe58ef844 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:57.888375 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0173997-bfc9-41af-9e21-66dbe58ef844 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:57.888668 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0173997-bfc9-41af-9e21-66dbe58ef844 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:57.890448 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c0173997-bfc9-41af-9e21-66dbe58ef844 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:57.965912 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1102/2236] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:49:57 2022] POST /identity/v3/projects => generated 365 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:49:57.966929 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec99acc-74fd-440d-ba69-fa34c7ca7de0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:57.986656 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0173997-bfc9-41af-9e21-66dbe58ef844 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:57.988549 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0173997-bfc9-41af-9e21-66dbe58ef844 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:57.999434 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1135/2237] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:49:57 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 03:49:58.050315 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec99acc-74fd-440d-ba69-fa34c7ca7de0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:58.059696 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04bcbe-3710-48c0-8d1a-7724564a75c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:58.060379 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04bcbe-3710-48c0-8d1a-7724564a75c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:58.060662 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04bcbe-3710-48c0-8d1a-7724564a75c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:58.060952 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04bcbe-3710-48c0-8d1a-7724564a75c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:58.064727 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b04bcbe-3710-48c0-8d1a-7724564a75c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:58.067859 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b04bcbe-3710-48c0-8d1a-7724564a75c0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:58.263479 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1103/2238] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:49:57 2022] POST /identity/v3/users => generated 289 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:49:58.267564 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0173997-bfc9-41af-9e21-66dbe58ef844 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:58.278535 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0173997-bfc9-41af-9e21-66dbe58ef844 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:58.283534 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801043f-6fad-468c-b8a7-53a7c4f668fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:58.284134 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801043f-6fad-468c-b8a7-53a7c4f668fd admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:58.284444 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801043f-6fad-468c-b8a7-53a7c4f668fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:58.284692 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801043f-6fad-468c-b8a7-53a7c4f668fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:58.285356 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f801043f-6fad-468c-b8a7-53a7c4f668fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:58.287042 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f801043f-6fad-468c-b8a7-53a7c4f668fd admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:58.297382 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1136/2239] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:49:58.301203 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04bcbe-3710-48c0-8d1a-7724564a75c0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:58.311169 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04bcbe-3710-48c0-8d1a-7724564a75c0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:58.315914 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce797da-ac03-41bb-8ad0-d357a2cb69c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:58.325176 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce797da-ac03-41bb-8ad0-d357a2cb69c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:58.325176 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce797da-ac03-41bb-8ad0-d357a2cb69c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:58.325176 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce797da-ac03-41bb-8ad0-d357a2cb69c2 admin admin] PATH_INFO: `/v3/projects/50c6c58f2ae54fe1b3836766533a749b/users/9dbc23c684ce411b81db4cbf51fa7050/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:58.332533 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce797da-ac03-41bb-8ad0-d357a2cb69c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50c6c58f2ae54fe1b3836766533a749b, user_id=9dbc23c684ce411b81db4cbf51fa7050, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:58.335778 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce797da-ac03-41bb-8ad0-d357a2cb69c2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:58.433437 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1104/2240] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:49:58 2022] PUT /identity/v3/projects/50c6c58f2ae54fe1b3836766533a749b/users/9dbc23c684ce411b81db4cbf51fa7050/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:58.437561 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801043f-6fad-468c-b8a7-53a7c4f668fd admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:58.449587 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801043f-6fad-468c-b8a7-53a7c4f668fd admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:58.511049 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43325a65-153b-4f62-89f0-21463c6a74da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:58.512279 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43325a65-153b-4f62-89f0-21463c6a74da admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:58.512709 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43325a65-153b-4f62-89f0-21463c6a74da admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:58.512988 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43325a65-153b-4f62-89f0-21463c6a74da admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:58.513808 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43325a65-153b-4f62-89f0-21463c6a74da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:58.515842 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43325a65-153b-4f62-89f0-21463c6a74da admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:58.529208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1137/2241] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:49:58.533624 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce797da-ac03-41bb-8ad0-d357a2cb69c2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:58.546596 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce797da-ac03-41bb-8ad0-d357a2cb69c2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:58.553325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acdf5c2-1c3f-46b9-be21-733991ff03f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:58.553325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdf5c2-1c3f-46b9-be21-733991ff03f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:58.553325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdf5c2-1c3f-46b9-be21-733991ff03f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:58.553903 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdf5c2-1c3f-46b9-be21-733991ff03f1 admin admin] PATH_INFO: `/v3/projects/50c6c58f2ae54fe1b3836766533a749b/users/9dbc23c684ce411b81db4cbf51fa7050/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:58.556128 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acdf5c2-1c3f-46b9-be21-733991ff03f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50c6c58f2ae54fe1b3836766533a749b, user_id=9dbc23c684ce411b81db4cbf51fa7050, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:58.559086 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acdf5c2-1c3f-46b9-be21-733991ff03f1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:58.580513 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1105/2242] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:49:58 2022] PUT /identity/v3/projects/50c6c58f2ae54fe1b3836766533a749b/users/9dbc23c684ce411b81db4cbf51fa7050/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:49:58.582002 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba68fad-7a3a-4757-ae39-f68e389bc9a0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:58.582826 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba68fad-7a3a-4757-ae39-f68e389bc9a0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:58.583116 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba68fad-7a3a-4757-ae39-f68e389bc9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:58.600537 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=85,keystone:INSERT=4,keystone:DELETE=11 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:58.613615 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0ba68fad-7a3a-4757-ae39-f68e389bc9a0 None None] MFA Rules not processed for user `9dbc23c684ce411b81db4cbf51fa7050`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:58.614855 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0ba68fad-7a3a-4757-ae39-f68e389bc9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:58.682070 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1138/2243] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:58 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:58.693804 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acdf5c2-1c3f-46b9-be21-733991ff03f1 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:58.695626 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8acdf5c2-1c3f-46b9-be21-733991ff03f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:58.754114 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acdf5c2-1c3f-46b9-be21-733991ff03f1 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:58.758402 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e47b9-fd8b-4e9b-8dd7-5412450cffa0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:58.759105 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e47b9-fd8b-4e9b-8dd7-5412450cffa0 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:58.759338 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e47b9-fd8b-4e9b-8dd7-5412450cffa0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:58.759611 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e47b9-fd8b-4e9b-8dd7-5412450cffa0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:58.768563 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e47b9-fd8b-4e9b-8dd7-5412450cffa0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:58.770027 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e47b9-fd8b-4e9b-8dd7-5412450cffa0 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:58.780852 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1106/2244] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:49:58 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:49:58.912797 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:49:59.077044 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba68fad-7a3a-4757-ae39-f68e389bc9a0 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:59.086560 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba68fad-7a3a-4757-ae39-f68e389bc9a0 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:59.090391 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4fdc4-b46d-4de3-94ab-4ed748e4f91f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:59.091022 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4fdc4-b46d-4de3-94ab-4ed748e4f91f service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:59.091310 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4fdc4-b46d-4de3-94ab-4ed748e4f91f service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:59.091590 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4fdc4-b46d-4de3-94ab-4ed748e4f91f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:59.149590 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c4fdc4-b46d-4de3-94ab-4ed748e4f91f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:59.151186 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c4fdc4-b46d-4de3-94ab-4ed748e4f91f service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:59.160535 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1139/2245] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:49:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:49:59.257072 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e47b9-fd8b-4e9b-8dd7-5412450cffa0 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:59.259601 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2b9e47b9-fd8b-4e9b-8dd7-5412450cffa0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:59.340019 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e47b9-fd8b-4e9b-8dd7-5412450cffa0 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:59.344848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38efcee0-6ea9-4ae8-83f9-b79d265615fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:59.345506 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efcee0-6ea9-4ae8-83f9-b79d265615fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:59.346010 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efcee0-6ea9-4ae8-83f9-b79d265615fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:59.346290 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efcee0-6ea9-4ae8-83f9-b79d265615fc admin admin] PATH_INFO: `/v3/users/c6c983fc7e6f4aaf80fd353a6b93c5fb` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:59.347465 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38efcee0-6ea9-4ae8-83f9-b79d265615fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6c983fc7e6f4aaf80fd353a6b93c5fb)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:59.349436 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38efcee0-6ea9-4ae8-83f9-b79d265615fc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:59.647792 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-38efcee0-6ea9-4ae8-83f9-b79d265615fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6c983fc7e6f4aaf80fd353a6b93c5fb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:59.648448 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-38efcee0-6ea9-4ae8-83f9-b79d265615fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6c983fc7e6f4aaf80fd353a6b93c5fb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:59.655936 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-38efcee0-6ea9-4ae8-83f9-b79d265615fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6c983fc7e6f4aaf80fd353a6b93c5fb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:59.667930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-38efcee0-6ea9-4ae8-83f9-b79d265615fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6c983fc7e6f4aaf80fd353a6b93c5fb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:59.668644 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-38efcee0-6ea9-4ae8-83f9-b79d265615fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6c983fc7e6f4aaf80fd353a6b93c5fb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:49:59.765870 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1107/2246] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:49:59 2022] DELETE /identity/v3/users/c6c983fc7e6f4aaf80fd353a6b93c5fb => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:49:59.775676 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21a32f-2051-496b-9cc8-58256a46f013 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:59.775676 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21a32f-2051-496b-9cc8-58256a46f013 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:59.775676 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21a32f-2051-496b-9cc8-58256a46f013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:59.792770 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-fd21a32f-2051-496b-9cc8-58256a46f013 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:49:59.794084 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fd21a32f-2051-496b-9cc8-58256a46f013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:59.852136 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1140/2247] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:49:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:49:59.862203 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38efcee0-6ea9-4ae8-83f9-b79d265615fc admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:49:59.863701 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-38efcee0-6ea9-4ae8-83f9-b79d265615fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:49:59.933413 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38efcee0-6ea9-4ae8-83f9-b79d265615fc admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:49:59.937256 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b956d89-12ea-4e7b-9bdc-a95ad44eb8b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:49:59.937893 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b956d89-12ea-4e7b-9bdc-a95ad44eb8b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:49:59.938175 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b956d89-12ea-4e7b-9bdc-a95ad44eb8b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:49:59.938480 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b956d89-12ea-4e7b-9bdc-a95ad44eb8b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:49:59.947925 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b956d89-12ea-4e7b-9bdc-a95ad44eb8b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:49:59.949379 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b956d89-12ea-4e7b-9bdc-a95ad44eb8b1 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:49:59.961402 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1108/2248] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:49:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 03:50:00.697827 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21a32f-2051-496b-9cc8-58256a46f013 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:00.699524 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fd21a32f-2051-496b-9cc8-58256a46f013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:00.716369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21a32f-2051-496b-9cc8-58256a46f013 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:00.723743 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a344be-33a8-47c5-8b98-b86572cd3c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:00.725539 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a344be-33a8-47c5-8b98-b86572cd3c6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:00.726407 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a344be-33a8-47c5-8b98-b86572cd3c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:00.726836 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a344be-33a8-47c5-8b98-b86572cd3c6c admin admin] PATH_INFO: `/v3/projects/ceddf35502ad4291931be17a6131bd37` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:00.728227 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a344be-33a8-47c5-8b98-b86572cd3c6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ceddf35502ad4291931be17a6131bd37)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:00.734865 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a344be-33a8-47c5-8b98-b86572cd3c6c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:00.886473 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-84a344be-33a8-47c5-8b98-b86572cd3c6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ceddf35502ad4291931be17a6131bd37', 'request_id': 'req-84a344be-33a8-47c5-8b98-b86572cd3c6c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:01.106000 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-84a344be-33a8-47c5-8b98-b86572cd3c6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ceddf35502ad4291931be17a6131bd37', 'request_id': 'req-84a344be-33a8-47c5-8b98-b86572cd3c6c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:01.115524 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-84a344be-33a8-47c5-8b98-b86572cd3c6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ceddf35502ad4291931be17a6131bd37', 'request_id': 'req-84a344be-33a8-47c5-8b98-b86572cd3c6c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:01.139568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-84a344be-33a8-47c5-8b98-b86572cd3c6c admin admin] The token cache is being invalidate because project ceddf35502ad4291931be17a6131bd37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:50:01.139926 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-84a344be-33a8-47c5-8b98-b86572cd3c6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:01.141008 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-84a344be-33a8-47c5-8b98-b86572cd3c6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:01.143065 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1141/2249] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:50:00 2022] DELETE /identity/v3/projects/ceddf35502ad4291931be17a6131bd37 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:50:01.147566 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b956d89-12ea-4e7b-9bdc-a95ad44eb8b1 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:01.157551 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b956d89-12ea-4e7b-9bdc-a95ad44eb8b1 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:01.216772 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dbabd6-b0de-4ae2-b5db-8ab2cb6a949f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:01.217416 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbabd6-b0de-4ae2-b5db-8ab2cb6a949f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:01.217737 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbabd6-b0de-4ae2-b5db-8ab2cb6a949f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:01.218093 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbabd6-b0de-4ae2-b5db-8ab2cb6a949f admin admin] PATH_INFO: `/v3/users/50fd3cfa3a704808bec32ede28b437f4` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:01.219224 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dbabd6-b0de-4ae2-b5db-8ab2cb6a949f admin admin] RBAC: Authorizing `identity:delete_user(user_id=50fd3cfa3a704808bec32ede28b437f4)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:01.221230 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dbabd6-b0de-4ae2-b5db-8ab2cb6a949f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:01.384392 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c940d11-6dd5-4fa3-a6d7-948fc4376ae2 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:01.384670 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c940d11-6dd5-4fa3-a6d7-948fc4376ae2 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:01.384944 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c940d11-6dd5-4fa3-a6d7-948fc4376ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:01.407476 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1c940d11-6dd5-4fa3-a6d7-948fc4376ae2 None None] MFA Rules not processed for user `6efa7a654e2d4e3e9066aa361460729d`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:50:01.409086 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1c940d11-6dd5-4fa3-a6d7-948fc4376ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:01.421770 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-18dbabd6-b0de-4ae2-b5db-8ab2cb6a949f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50fd3cfa3a704808bec32ede28b437f4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:01.422479 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-18dbabd6-b0de-4ae2-b5db-8ab2cb6a949f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50fd3cfa3a704808bec32ede28b437f4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:01.430515 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-18dbabd6-b0de-4ae2-b5db-8ab2cb6a949f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50fd3cfa3a704808bec32ede28b437f4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:01.448284 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-18dbabd6-b0de-4ae2-b5db-8ab2cb6a949f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50fd3cfa3a704808bec32ede28b437f4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:01.449788 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-18dbabd6-b0de-4ae2-b5db-8ab2cb6a949f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50fd3cfa3a704808bec32ede28b437f4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:01.475193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1142/2250] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:50:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:50:01.577786 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1109/2251] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:50:01 2022] DELETE /identity/v3/users/50fd3cfa3a704808bec32ede28b437f4 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:50:01.874527 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:02.320036 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c940d11-6dd5-4fa3-a6d7-948fc4376ae2 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:02.322162 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1c940d11-6dd5-4fa3-a6d7-948fc4376ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:02.337406 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c940d11-6dd5-4fa3-a6d7-948fc4376ae2 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:02.400196 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1842b8-6ea6-4389-a11e-c9cfa6055761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:02.401012 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1842b8-6ea6-4389-a11e-c9cfa6055761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:02.401948 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1842b8-6ea6-4389-a11e-c9cfa6055761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:02.411323 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1842b8-6ea6-4389-a11e-c9cfa6055761 admin admin] PATH_INFO: `/v3/projects/f741b46e22a64d579084cf34940ad884` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:02.411323 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1842b8-6ea6-4389-a11e-c9cfa6055761 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f741b46e22a64d579084cf34940ad884)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:02.411323 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1842b8-6ea6-4389-a11e-c9cfa6055761 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:02.509768 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0b1842b8-6ea6-4389-a11e-c9cfa6055761 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f741b46e22a64d579084cf34940ad884', 'request_id': 'req-0b1842b8-6ea6-4389-a11e-c9cfa6055761'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:02.585537 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0b1842b8-6ea6-4389-a11e-c9cfa6055761 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f741b46e22a64d579084cf34940ad884', 'request_id': 'req-0b1842b8-6ea6-4389-a11e-c9cfa6055761'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:02.592270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0b1842b8-6ea6-4389-a11e-c9cfa6055761 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f741b46e22a64d579084cf34940ad884', 'request_id': 'req-0b1842b8-6ea6-4389-a11e-c9cfa6055761'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:02.602488 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0b1842b8-6ea6-4389-a11e-c9cfa6055761 admin admin] The token cache is being invalidate because project f741b46e22a64d579084cf34940ad884 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:50:02.602783 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0b1842b8-6ea6-4389-a11e-c9cfa6055761 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:02.603407 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0b1842b8-6ea6-4389-a11e-c9cfa6055761 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:02.604887 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1143/2252] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:50:02 2022] DELETE /identity/v3/projects/f741b46e22a64d579084cf34940ad884 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:50:02.608891 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dbabd6-b0de-4ae2-b5db-8ab2cb6a949f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:02.619815 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dbabd6-b0de-4ae2-b5db-8ab2cb6a949f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:02.676017 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c6380-17b8-45e4-86bd-03597d802e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:02.676653 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c6380-17b8-45e4-86bd-03597d802e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:02.676936 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c6380-17b8-45e4-86bd-03597d802e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:02.677210 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c6380-17b8-45e4-86bd-03597d802e77 admin admin] PATH_INFO: `/v3/users/fef91cf05d304fcf8de1acea755674d1` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:02.678866 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c6380-17b8-45e4-86bd-03597d802e77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fef91cf05d304fcf8de1acea755674d1)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:02.680831 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c6380-17b8-45e4-86bd-03597d802e77 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:03.032295 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e90c6380-17b8-45e4-86bd-03597d802e77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fef91cf05d304fcf8de1acea755674d1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:03.032959 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e90c6380-17b8-45e4-86bd-03597d802e77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fef91cf05d304fcf8de1acea755674d1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:03.041459 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e90c6380-17b8-45e4-86bd-03597d802e77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fef91cf05d304fcf8de1acea755674d1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:03.057217 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e90c6380-17b8-45e4-86bd-03597d802e77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fef91cf05d304fcf8de1acea755674d1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:03.058198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e90c6380-17b8-45e4-86bd-03597d802e77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fef91cf05d304fcf8de1acea755674d1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:03.196991 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1110/2253] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:50:02 2022] DELETE /identity/v3/users/fef91cf05d304fcf8de1acea755674d1 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:50:03.323730 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:03.790917 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1842b8-6ea6-4389-a11e-c9cfa6055761 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:03.792413 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0b1842b8-6ea6-4389-a11e-c9cfa6055761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:03.812633 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1842b8-6ea6-4389-a11e-c9cfa6055761 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:03.895162 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9c589-f8e8-41f0-a51c-dcb7e578bcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:03.895826 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9c589-f8e8-41f0-a51c-dcb7e578bcf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:03.900992 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9c589-f8e8-41f0-a51c-dcb7e578bcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:03.900992 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9c589-f8e8-41f0-a51c-dcb7e578bcf9 admin admin] PATH_INFO: `/v3/projects/337709e58b144b04b1908dfc01077de9` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:03.900992 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9c589-f8e8-41f0-a51c-dcb7e578bcf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=337709e58b144b04b1908dfc01077de9)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:03.900992 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9c589-f8e8-41f0-a51c-dcb7e578bcf9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:04.123858 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b6e9c589-f8e8-41f0-a51c-dcb7e578bcf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '337709e58b144b04b1908dfc01077de9', 'request_id': 'req-b6e9c589-f8e8-41f0-a51c-dcb7e578bcf9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:04.265920 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b6e9c589-f8e8-41f0-a51c-dcb7e578bcf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '337709e58b144b04b1908dfc01077de9', 'request_id': 'req-b6e9c589-f8e8-41f0-a51c-dcb7e578bcf9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:04.273793 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b6e9c589-f8e8-41f0-a51c-dcb7e578bcf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '337709e58b144b04b1908dfc01077de9', 'request_id': 'req-b6e9c589-f8e8-41f0-a51c-dcb7e578bcf9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:04.287696 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b6e9c589-f8e8-41f0-a51c-dcb7e578bcf9 admin admin] The token cache is being invalidate because project 337709e58b144b04b1908dfc01077de9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:50:04.287994 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b6e9c589-f8e8-41f0-a51c-dcb7e578bcf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:04.288662 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b6e9c589-f8e8-41f0-a51c-dcb7e578bcf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:04.295191 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1144/2254] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:50:03 2022] DELETE /identity/v3/projects/337709e58b144b04b1908dfc01077de9 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:50:04.297068 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338ab1d-677c-44a0-a611-7f293b46e4ae None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:04.297541 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338ab1d-677c-44a0-a611-7f293b46e4ae None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:04.297692 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338ab1d-677c-44a0-a611-7f293b46e4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:04.319511 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-7338ab1d-677c-44a0-a611-7f293b46e4ae None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:50:04.320803 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7338ab1d-677c-44a0-a611-7f293b46e4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:04.382926 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1111/2255] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:50:04.390721 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99daa70f-aaa0-4956-9d6c-d449e57ccfe8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:04.391006 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99daa70f-aaa0-4956-9d6c-d449e57ccfe8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:04.391279 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99daa70f-aaa0-4956-9d6c-d449e57ccfe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:04.413023 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-99daa70f-aaa0-4956-9d6c-d449e57ccfe8 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:50:04.414659 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-99daa70f-aaa0-4956-9d6c-d449e57ccfe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:04.423667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1145/2256] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:50:04.428414 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338ab1d-677c-44a0-a611-7f293b46e4ae None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:04.438752 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338ab1d-677c-44a0-a611-7f293b46e4ae None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:04.445113 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2789a08-4d88-42a5-b0cd-d0c59596da86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:04.445955 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2789a08-4d88-42a5-b0cd-d0c59596da86 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:04.446478 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2789a08-4d88-42a5-b0cd-d0c59596da86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:04.446850 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2789a08-4d88-42a5-b0cd-d0c59596da86 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:04.447750 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2789a08-4d88-42a5-b0cd-d0c59596da86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:50:04.450062 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2789a08-4d88-42a5-b0cd-d0c59596da86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:04.452357 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2789a08-4d88-42a5-b0cd-d0c59596da86 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:04.466534 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1112/2257] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:50:04.471444 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99daa70f-aaa0-4956-9d6c-d449e57ccfe8 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:04.484871 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99daa70f-aaa0-4956-9d6c-d449e57ccfe8 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:04.491457 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4cea0-6f57-44a1-9e5c-39dd380dbb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:04.492141 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4cea0-6f57-44a1-9e5c-39dd380dbb1a admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:04.492611 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4cea0-6f57-44a1-9e5c-39dd380dbb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:04.493065 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4cea0-6f57-44a1-9e5c-39dd380dbb1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:04.493933 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc4cea0-6f57-44a1-9e5c-39dd380dbb1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:04.496096 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc4cea0-6f57-44a1-9e5c-39dd380dbb1a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:04.621778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1146/2258] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:50:04 2022] POST /identity/v3/projects => generated 375 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:50:04.625939 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2789a08-4d88-42a5-b0cd-d0c59596da86 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:04.637930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2789a08-4d88-42a5-b0cd-d0c59596da86 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:04.734498 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca23c7-c6d7-4302-beeb-ec3e2175eb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:04.735243 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca23c7-c6d7-4302-beeb-ec3e2175eb29 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:04.735702 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca23c7-c6d7-4302-beeb-ec3e2175eb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:04.735995 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca23c7-c6d7-4302-beeb-ec3e2175eb29 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:04.736704 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca23c7-c6d7-4302-beeb-ec3e2175eb29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:04.738743 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca23c7-c6d7-4302-beeb-ec3e2175eb29 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:04.864978 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1113/2259] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:50:04 2022] POST /identity/v3/users => generated 288 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:50:04.869106 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4cea0-6f57-44a1-9e5c-39dd380dbb1a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:04.881864 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4cea0-6f57-44a1-9e5c-39dd380dbb1a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:04.887078 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2f897-2b3b-45c7-9718-eb0a31f3826e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:04.887756 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2f897-2b3b-45c7-9718-eb0a31f3826e admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:04.888073 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2f897-2b3b-45c7-9718-eb0a31f3826e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:04.888378 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2f897-2b3b-45c7-9718-eb0a31f3826e admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:04.889032 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb2f897-2b3b-45c7-9718-eb0a31f3826e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:04.890917 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb2f897-2b3b-45c7-9718-eb0a31f3826e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:04.901763 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1147/2260] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:50:04.905974 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca23c7-c6d7-4302-beeb-ec3e2175eb29 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:04.917011 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca23c7-c6d7-4302-beeb-ec3e2175eb29 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:04.921914 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f16d44-14e8-4ceb-9ffe-601f7538ad5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:04.922521 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f16d44-14e8-4ceb-9ffe-601f7538ad5c admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:04.922826 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f16d44-14e8-4ceb-9ffe-601f7538ad5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:04.923099 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f16d44-14e8-4ceb-9ffe-601f7538ad5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:04.923742 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f16d44-14e8-4ceb-9ffe-601f7538ad5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:04.925333 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f16d44-14e8-4ceb-9ffe-601f7538ad5c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:04.936361 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1114/2261] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:50:04.940909 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2f897-2b3b-45c7-9718-eb0a31f3826e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:04.951446 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2f897-2b3b-45c7-9718-eb0a31f3826e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:04.956432 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2e1cd5-3507-4bd0-b28a-0b9c0a0262d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:04.957091 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e1cd5-3507-4bd0-b28a-0b9c0a0262d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:04.957374 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e1cd5-3507-4bd0-b28a-0b9c0a0262d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:04.957676 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e1cd5-3507-4bd0-b28a-0b9c0a0262d6 admin admin] PATH_INFO: `/v3/projects/cc9d436570584c3b82d6063c45de818b/users/64b32275f6234051bd0e6aaa71ab3b5a/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:04.972924 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2e1cd5-3507-4bd0-b28a-0b9c0a0262d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc9d436570584c3b82d6063c45de818b, user_id=64b32275f6234051bd0e6aaa71ab3b5a, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:04.976374 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2e1cd5-3507-4bd0-b28a-0b9c0a0262d6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:05.003523 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f16d44-14e8-4ceb-9ffe-601f7538ad5c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:05.006108 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a1f16d44-14e8-4ceb-9ffe-601f7538ad5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:05.019298 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f16d44-14e8-4ceb-9ffe-601f7538ad5c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:05.026862 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb323a18-65cb-4e4f-b83d-fc90bc0d8f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:05.027685 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb323a18-65cb-4e4f-b83d-fc90bc0d8f87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:05.028114 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb323a18-65cb-4e4f-b83d-fc90bc0d8f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:05.028520 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb323a18-65cb-4e4f-b83d-fc90bc0d8f87 admin admin] PATH_INFO: `/v3/users/06eef0a14f7c406e9eaf4c78d4fceea4` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:05.029976 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb323a18-65cb-4e4f-b83d-fc90bc0d8f87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06eef0a14f7c406e9eaf4c78d4fceea4)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:05.033102 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb323a18-65cb-4e4f-b83d-fc90bc0d8f87 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:05.140659 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1148/2262] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:50:04 2022] PUT /identity/v3/projects/cc9d436570584c3b82d6063c45de818b/users/64b32275f6234051bd0e6aaa71ab3b5a/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:50:05.150799 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ca63b-8cf1-41da-b326-76236b586e04 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:05.151087 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ca63b-8cf1-41da-b326-76236b586e04 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:05.151365 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ca63b-8cf1-41da-b326-76236b586e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:05.180699 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-419ca63b-8cf1-41da-b326-76236b586e04 None None] MFA Rules not processed for user `64b32275f6234051bd0e6aaa71ab3b5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:50:05.181988 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-419ca63b-8cf1-41da-b326-76236b586e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:05.247159 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1149/2263] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:50:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:50:05.285162 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ca63b-8cf1-41da-b326-76236b586e04 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:05.287413 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-419ca63b-8cf1-41da-b326-76236b586e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:05.289683 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fb323a18-65cb-4e4f-b83d-fc90bc0d8f87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06eef0a14f7c406e9eaf4c78d4fceea4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:05.290340 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fb323a18-65cb-4e4f-b83d-fc90bc0d8f87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06eef0a14f7c406e9eaf4c78d4fceea4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:05.300061 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fb323a18-65cb-4e4f-b83d-fc90bc0d8f87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06eef0a14f7c406e9eaf4c78d4fceea4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:05.318153 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fb323a18-65cb-4e4f-b83d-fc90bc0d8f87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06eef0a14f7c406e9eaf4c78d4fceea4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:05.318981 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fb323a18-65cb-4e4f-b83d-fc90bc0d8f87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06eef0a14f7c406e9eaf4c78d4fceea4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:05.359813 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ca63b-8cf1-41da-b326-76236b586e04 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:05.363699 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca54e4-4101-443b-850a-25061fec1931 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:05.364338 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca54e4-4101-443b-850a-25061fec1931 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:05.364621 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca54e4-4101-443b-850a-25061fec1931 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:05.366522 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca54e4-4101-443b-850a-25061fec1931 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:05.368717 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5cca54e4-4101-443b-850a-25061fec1931 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:05.381531 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca54e4-4101-443b-850a-25061fec1931 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:05.384396 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca54e4-4101-443b-850a-25061fec1931 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:05.394417 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1150/2264] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:50:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:50:05.419278 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1115/2265] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:50:05 2022] DELETE /identity/v3/users/06eef0a14f7c406e9eaf4c78d4fceea4 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:50:05.431542 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4918f8-dfc1-4330-a121-c055248282cd None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:05.431912 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4918f8-dfc1-4330-a121-c055248282cd None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:05.432162 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4918f8-dfc1-4330-a121-c055248282cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:05.459937 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0f4918f8-dfc1-4330-a121-c055248282cd None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:50:05.461308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0f4918f8-dfc1-4330-a121-c055248282cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:05.524042 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb323a18-65cb-4e4f-b83d-fc90bc0d8f87 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:05.525859 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fb323a18-65cb-4e4f-b83d-fc90bc0d8f87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:05.558397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1151/2266] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:50:05.559529 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4918f8-dfc1-4330-a121-c055248282cd None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:05.561045 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0f4918f8-dfc1-4330-a121-c055248282cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:05.619924 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb323a18-65cb-4e4f-b83d-fc90bc0d8f87 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:05.634769 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a9c9f-f617-4cf2-a5c2-0673183c9bb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:05.635426 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a9c9f-f617-4cf2-a5c2-0673183c9bb4 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:05.635701 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a9c9f-f617-4cf2-a5c2-0673183c9bb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:05.636922 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a9c9f-f617-4cf2-a5c2-0673183c9bb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:05.647357 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-845a9c9f-f617-4cf2-a5c2-0673183c9bb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:05.667000 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4918f8-dfc1-4330-a121-c055248282cd None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:05.678694 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c1658-581a-4134-a6e2-10388405b29d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:05.679372 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c1658-581a-4134-a6e2-10388405b29d service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:05.679648 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c1658-581a-4134-a6e2-10388405b29d service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:05.680270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c1658-581a-4134-a6e2-10388405b29d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:05.693939 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c1658-581a-4134-a6e2-10388405b29d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:05.695414 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c1658-581a-4134-a6e2-10388405b29d service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:05.713901 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1152/2267] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:50:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:50:05.738952 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a9c9f-f617-4cf2-a5c2-0673183c9bb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:05.741398 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a9c9f-f617-4cf2-a5c2-0673183c9bb4 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:05.753798 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1116/2268] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:50:05 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 03:50:06.055433 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:06.262064 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c1658-581a-4134-a6e2-10388405b29d service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:06.263527 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-dd3c1658-581a-4134-a6e2-10388405b29d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:06.277391 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c1658-581a-4134-a6e2-10388405b29d service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:06.282448 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4cc172-c762-4d7b-924a-bcbabc87c82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:06.283076 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cc172-c762-4d7b-924a-bcbabc87c82c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:06.283368 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cc172-c762-4d7b-924a-bcbabc87c82c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:06.283653 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cc172-c762-4d7b-924a-bcbabc87c82c admin admin] PATH_INFO: `/v3/projects/0b7bc657f9b84cfd911f03399e9692f1` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:06.284767 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4cc172-c762-4d7b-924a-bcbabc87c82c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b7bc657f9b84cfd911f03399e9692f1)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:06.286698 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4cc172-c762-4d7b-924a-bcbabc87c82c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:06.443966 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ed4cc172-c762-4d7b-924a-bcbabc87c82c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b7bc657f9b84cfd911f03399e9692f1', 'request_id': 'req-ed4cc172-c762-4d7b-924a-bcbabc87c82c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:06.536562 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ed4cc172-c762-4d7b-924a-bcbabc87c82c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b7bc657f9b84cfd911f03399e9692f1', 'request_id': 'req-ed4cc172-c762-4d7b-924a-bcbabc87c82c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:06.543611 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ed4cc172-c762-4d7b-924a-bcbabc87c82c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b7bc657f9b84cfd911f03399e9692f1', 'request_id': 'req-ed4cc172-c762-4d7b-924a-bcbabc87c82c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:06.563687 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ed4cc172-c762-4d7b-924a-bcbabc87c82c admin admin] The token cache is being invalidate because project 0b7bc657f9b84cfd911f03399e9692f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:50:06.564163 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ed4cc172-c762-4d7b-924a-bcbabc87c82c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:06.570816 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ed4cc172-c762-4d7b-924a-bcbabc87c82c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:06.578091 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1153/2269] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:50:06 2022] DELETE /identity/v3/projects/0b7bc657f9b84cfd911f03399e9692f1 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:50:06.578617 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a9c9f-f617-4cf2-a5c2-0673183c9bb4 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:06.595826 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a9c9f-f617-4cf2-a5c2-0673183c9bb4 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:06.686806 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636756a5-cd35-48ee-93ff-070cc9f07620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:06.687770 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636756a5-cd35-48ee-93ff-070cc9f07620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:06.688122 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636756a5-cd35-48ee-93ff-070cc9f07620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:06.688459 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636756a5-cd35-48ee-93ff-070cc9f07620 admin admin] PATH_INFO: `/v3/users/125db037f633478b838d7406db740a49` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:06.690453 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636756a5-cd35-48ee-93ff-070cc9f07620 admin admin] RBAC: Authorizing `identity:delete_user(user_id=125db037f633478b838d7406db740a49)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:06.696216 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636756a5-cd35-48ee-93ff-070cc9f07620 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:06.728214 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:06.853747 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4cc172-c762-4d7b-924a-bcbabc87c82c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:06.855334 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ed4cc172-c762-4d7b-924a-bcbabc87c82c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:06.869717 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4cc172-c762-4d7b-924a-bcbabc87c82c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:06.874436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db538d-6ac0-43d7-970e-08c30c72ea34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:06.875063 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db538d-6ac0-43d7-970e-08c30c72ea34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:06.875339 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db538d-6ac0-43d7-970e-08c30c72ea34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:06.875616 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db538d-6ac0-43d7-970e-08c30c72ea34 admin admin] PATH_INFO: `/v3/users/26b4aa5f61a14886b20d4ba5ce0b073a` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:06.876918 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db538d-6ac0-43d7-970e-08c30c72ea34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26b4aa5f61a14886b20d4ba5ce0b073a)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:06.878898 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db538d-6ac0-43d7-970e-08c30c72ea34 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:06.922583 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-636756a5-cd35-48ee-93ff-070cc9f07620 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '125db037f633478b838d7406db740a49'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:06.923249 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-636756a5-cd35-48ee-93ff-070cc9f07620 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '125db037f633478b838d7406db740a49'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:06.930412 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-636756a5-cd35-48ee-93ff-070cc9f07620 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '125db037f633478b838d7406db740a49'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:06.942963 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-636756a5-cd35-48ee-93ff-070cc9f07620 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '125db037f633478b838d7406db740a49'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:06.943704 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-636756a5-cd35-48ee-93ff-070cc9f07620 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '125db037f633478b838d7406db740a49'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:07.124397 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1117/2270] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:50:06 2022] DELETE /identity/v3/users/125db037f633478b838d7406db740a49 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:50:07.126956 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-03db538d-6ac0-43d7-970e-08c30c72ea34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26b4aa5f61a14886b20d4ba5ce0b073a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:07.127443 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-03db538d-6ac0-43d7-970e-08c30c72ea34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26b4aa5f61a14886b20d4ba5ce0b073a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:07.136406 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-03db538d-6ac0-43d7-970e-08c30c72ea34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26b4aa5f61a14886b20d4ba5ce0b073a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:07.151257 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-03db538d-6ac0-43d7-970e-08c30c72ea34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26b4aa5f61a14886b20d4ba5ce0b073a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:07.152042 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-03db538d-6ac0-43d7-970e-08c30c72ea34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26b4aa5f61a14886b20d4ba5ce0b073a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:07.248820 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1154/2271] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:50:06 2022] DELETE /identity/v3/users/26b4aa5f61a14886b20d4ba5ce0b073a => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:50:07.253597 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bdd3d1-e16c-4577-9aa1-04c3597bce1a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:07.253995 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bdd3d1-e16c-4577-9aa1-04c3597bce1a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:07.254367 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bdd3d1-e16c-4577-9aa1-04c3597bce1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:07.277054 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-08bdd3d1-e16c-4577-9aa1-04c3597bce1a None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:50:07.278781 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-08bdd3d1-e16c-4577-9aa1-04c3597bce1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:07.367923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1118/2272] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:50:07.398450 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db538d-6ac0-43d7-970e-08c30c72ea34 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:07.400171 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-03db538d-6ac0-43d7-970e-08c30c72ea34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:07.486646 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:07.492243 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db538d-6ac0-43d7-970e-08c30c72ea34 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:07.498782 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599b842-94c1-4f3c-aa53-b9f0e6fdb323 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:07.500367 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599b842-94c1-4f3c-aa53-b9f0e6fdb323 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:07.500999 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599b842-94c1-4f3c-aa53-b9f0e6fdb323 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:07.501432 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599b842-94c1-4f3c-aa53-b9f0e6fdb323 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:07.516699 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7599b842-94c1-4f3c-aa53-b9f0e6fdb323 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:07.520150 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7599b842-94c1-4f3c-aa53-b9f0e6fdb323 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:07.534322 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1155/2273] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:50:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:50:07.575343 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:07.762869 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bdd3d1-e16c-4577-9aa1-04c3597bce1a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:07.764706 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-08bdd3d1-e16c-4577-9aa1-04c3597bce1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:07.791865 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bdd3d1-e16c-4577-9aa1-04c3597bce1a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:07.806815 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec4304-f90e-45c6-a7b3-a8ebe8461f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:07.808304 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec4304-f90e-45c6-a7b3-a8ebe8461f46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:07.808893 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec4304-f90e-45c6-a7b3-a8ebe8461f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:07.809673 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec4304-f90e-45c6-a7b3-a8ebe8461f46 admin admin] PATH_INFO: `/v3/projects/1eca3428b9a84f0f90e8b822d3514bb0` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:07.811112 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec4304-f90e-45c6-a7b3-a8ebe8461f46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eca3428b9a84f0f90e8b822d3514bb0)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:07.822475 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec4304-f90e-45c6-a7b3-a8ebe8461f46 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:07.956163 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-41ec4304-f90e-45c6-a7b3-a8ebe8461f46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eca3428b9a84f0f90e8b822d3514bb0', 'request_id': 'req-41ec4304-f90e-45c6-a7b3-a8ebe8461f46'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:08.052009 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-41ec4304-f90e-45c6-a7b3-a8ebe8461f46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eca3428b9a84f0f90e8b822d3514bb0', 'request_id': 'req-41ec4304-f90e-45c6-a7b3-a8ebe8461f46'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:08.060846 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-41ec4304-f90e-45c6-a7b3-a8ebe8461f46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eca3428b9a84f0f90e8b822d3514bb0', 'request_id': 'req-41ec4304-f90e-45c6-a7b3-a8ebe8461f46'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:08.073956 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-41ec4304-f90e-45c6-a7b3-a8ebe8461f46 admin admin] The token cache is being invalidate because project 1eca3428b9a84f0f90e8b822d3514bb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:50:08.074572 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-41ec4304-f90e-45c6-a7b3-a8ebe8461f46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:08.075331 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-41ec4304-f90e-45c6-a7b3-a8ebe8461f46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:08.076962 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1119/2274] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:50:07 2022] DELETE /identity/v3/projects/1eca3428b9a84f0f90e8b822d3514bb0 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:50:08.083029 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d8068-c494-4039-bb3c-a1b43146deac None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:08.083526 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d8068-c494-4039-bb3c-a1b43146deac None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:08.083662 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d8068-c494-4039-bb3c-a1b43146deac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:08.106924 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-633d8068-c494-4039-bb3c-a1b43146deac None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:50:08.108603 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-633d8068-c494-4039-bb3c-a1b43146deac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:08.188311 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1156/2275] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:50:08.198213 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226622a-e802-473e-9c25-3c3f750d5028 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:08.198502 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226622a-e802-473e-9c25-3c3f750d5028 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:08.198786 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226622a-e802-473e-9c25-3c3f750d5028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:08.221454 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4226622a-e802-473e-9c25-3c3f750d5028 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:50:08.222692 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4226622a-e802-473e-9c25-3c3f750d5028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:08.234788 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1120/2276] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:50:08.239223 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d8068-c494-4039-bb3c-a1b43146deac None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:08.251793 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d8068-c494-4039-bb3c-a1b43146deac None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:08.258107 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d328b70b-c638-401b-8c53-3c4eba420a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:08.258796 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328b70b-c638-401b-8c53-3c4eba420a80 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:08.259141 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328b70b-c638-401b-8c53-3c4eba420a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:08.259479 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328b70b-c638-401b-8c53-3c4eba420a80 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:08.260276 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d328b70b-c638-401b-8c53-3c4eba420a80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:50:08.266968 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d328b70b-c638-401b-8c53-3c4eba420a80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:08.266968 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d328b70b-c638-401b-8c53-3c4eba420a80 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:08.277133 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1157/2277] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:50:08.289940 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4226622a-e802-473e-9c25-3c3f750d5028 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:08.290929 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d328b70b-c638-401b-8c53-3c4eba420a80 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:08.291622 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4226622a-e802-473e-9c25-3c3f750d5028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:08.303794 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d328b70b-c638-401b-8c53-3c4eba420a80 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:08.312173 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4226622a-e802-473e-9c25-3c3f750d5028 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:08.320485 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a422b8-ef49-48b4-aed3-7b9709625306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:08.321137 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a422b8-ef49-48b4-aed3-7b9709625306 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:08.321578 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a422b8-ef49-48b4-aed3-7b9709625306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:08.326632 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a422b8-ef49-48b4-aed3-7b9709625306 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:08.326632 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a422b8-ef49-48b4-aed3-7b9709625306 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:08.326632 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a422b8-ef49-48b4-aed3-7b9709625306 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:08.331998 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0437385-6378-48f8-a714-90ece7adfefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:08.333050 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0437385-6378-48f8-a714-90ece7adfefb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:08.334493 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0437385-6378-48f8-a714-90ece7adfefb admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:08.335062 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0437385-6378-48f8-a714-90ece7adfefb admin admin] PATH_INFO: `/v3/projects/a9ea34a1fbff46ae8d2b494157209525` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:08.339624 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0437385-6378-48f8-a714-90ece7adfefb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9ea34a1fbff46ae8d2b494157209525)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:08.342124 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0437385-6378-48f8-a714-90ece7adfefb admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:08.496392 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1158/2278] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:50:08 2022] POST /identity/v3/projects => generated 383 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:50:08.497604 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a422b8-ef49-48b4-aed3-7b9709625306 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:08.509025 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b0437385-6378-48f8-a714-90ece7adfefb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9ea34a1fbff46ae8d2b494157209525', 'request_id': 'req-b0437385-6378-48f8-a714-90ece7adfefb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:08.566062 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a422b8-ef49-48b4-aed3-7b9709625306 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:08.571402 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139ee6d-af5b-4a4c-a3a1-920c295cd42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:08.572011 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139ee6d-af5b-4a4c-a3a1-920c295cd42f admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:08.572317 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139ee6d-af5b-4a4c-a3a1-920c295cd42f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:08.572594 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139ee6d-af5b-4a4c-a3a1-920c295cd42f admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:08.573233 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d139ee6d-af5b-4a4c-a3a1-920c295cd42f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:08.575199 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d139ee6d-af5b-4a4c-a3a1-920c295cd42f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:08.654660 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b0437385-6378-48f8-a714-90ece7adfefb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9ea34a1fbff46ae8d2b494157209525', 'request_id': 'req-b0437385-6378-48f8-a714-90ece7adfefb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:08.662851 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1159/2279] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:50:08 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:50:08.666705 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139ee6d-af5b-4a4c-a3a1-920c295cd42f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:08.668303 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b0437385-6378-48f8-a714-90ece7adfefb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9ea34a1fbff46ae8d2b494157209525', 'request_id': 'req-b0437385-6378-48f8-a714-90ece7adfefb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:08.681215 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139ee6d-af5b-4a4c-a3a1-920c295cd42f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:08.686831 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b0437385-6378-48f8-a714-90ece7adfefb admin admin] The token cache is being invalidate because project a9ea34a1fbff46ae8d2b494157209525 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:50:08.687315 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b0437385-6378-48f8-a714-90ece7adfefb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:08.687648 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00223979-5978-4372-9728-f175ca148820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:08.688318 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00223979-5978-4372-9728-f175ca148820 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:08.691607 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00223979-5978-4372-9728-f175ca148820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:08.691607 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00223979-5978-4372-9728-f175ca148820 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:08.691607 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00223979-5978-4372-9728-f175ca148820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:08.691607 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00223979-5978-4372-9728-f175ca148820 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:08.703851 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1160/2280] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:50:08.707659 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b0437385-6378-48f8-a714-90ece7adfefb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:08.708681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00223979-5978-4372-9728-f175ca148820 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:08.709521 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1121/2281] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:50:08 2022] DELETE /identity/v3/projects/a9ea34a1fbff46ae8d2b494157209525 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:50:08.712791 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-00223979-5978-4372-9728-f175ca148820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:08.714344 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0437385-6378-48f8-a714-90ece7adfefb admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:08.716345 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b0437385-6378-48f8-a714-90ece7adfefb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:08.726186 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00223979-5978-4372-9728-f175ca148820 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:08.732412 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794d8e2-806a-4f6e-a5ed-748c8021154b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:08.733536 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794d8e2-806a-4f6e-a5ed-748c8021154b admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:08.734528 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794d8e2-806a-4f6e-a5ed-748c8021154b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:08.735051 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794d8e2-806a-4f6e-a5ed-748c8021154b admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:08.736202 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a794d8e2-806a-4f6e-a5ed-748c8021154b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:08.738764 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a794d8e2-806a-4f6e-a5ed-748c8021154b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:08.751865 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1161/2282] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:50:08.758111 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794d8e2-806a-4f6e-a5ed-748c8021154b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:08.770553 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794d8e2-806a-4f6e-a5ed-748c8021154b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:08.778125 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da411b58-a967-4cb8-9fa5-86d3db421779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:08.779366 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da411b58-a967-4cb8-9fa5-86d3db421779 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:08.780003 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da411b58-a967-4cb8-9fa5-86d3db421779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:08.780782 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da411b58-a967-4cb8-9fa5-86d3db421779 admin admin] PATH_INFO: `/v3/projects/d653fec7a2fb4e369a99a66a157616a3/users/8e674a783232432283c2a6fffe1a949f/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:08.808978 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da411b58-a967-4cb8-9fa5-86d3db421779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d653fec7a2fb4e369a99a66a157616a3, user_id=8e674a783232432283c2a6fffe1a949f, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:08.818890 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da411b58-a967-4cb8-9fa5-86d3db421779 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:08.832405 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0437385-6378-48f8-a714-90ece7adfefb admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:08.840234 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58418988-325a-4dfa-970a-b45f3dd14b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:08.840914 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58418988-325a-4dfa-970a-b45f3dd14b7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:08.841248 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58418988-325a-4dfa-970a-b45f3dd14b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:08.841555 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58418988-325a-4dfa-970a-b45f3dd14b7d admin admin] PATH_INFO: `/v3/users/9dbc23c684ce411b81db4cbf51fa7050` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:08.843594 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58418988-325a-4dfa-970a-b45f3dd14b7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dbc23c684ce411b81db4cbf51fa7050)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:08.847125 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58418988-325a-4dfa-970a-b45f3dd14b7d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:08.948502 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1162/2283] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:50:08 2022] PUT /identity/v3/projects/d653fec7a2fb4e369a99a66a157616a3/users/8e674a783232432283c2a6fffe1a949f/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:50:08.960311 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda19d7b-50e2-47da-ae21-584e8832e1c9 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:08.960602 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda19d7b-50e2-47da-ae21-584e8832e1c9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:08.960896 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda19d7b-50e2-47da-ae21-584e8832e1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:08.992941 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-eda19d7b-50e2-47da-ae21-584e8832e1c9 None None] MFA Rules not processed for user `8e674a783232432283c2a6fffe1a949f`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:50:08.994303 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-eda19d7b-50e2-47da-ae21-584e8832e1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:09.074748 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1163/2284] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:50:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:50:09.087333 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda19d7b-50e2-47da-ae21-584e8832e1c9 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:09.088792 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-eda19d7b-50e2-47da-ae21-584e8832e1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:09.151755 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda19d7b-50e2-47da-ae21-584e8832e1c9 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:09.155926 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d2b1e-fcd0-4fe8-a3e9-8f390a1ead98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:09.156681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d2b1e-fcd0-4fe8-a3e9-8f390a1ead98 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:09.156966 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d2b1e-fcd0-4fe8-a3e9-8f390a1ead98 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:09.157242 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d2b1e-fcd0-4fe8-a3e9-8f390a1ead98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:09.166143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d2b1e-fcd0-4fe8-a3e9-8f390a1ead98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:09.167532 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d2b1e-fcd0-4fe8-a3e9-8f390a1ead98 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:09.177046 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1164/2285] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:50:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:50:09.184527 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-58418988-325a-4dfa-970a-b45f3dd14b7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dbc23c684ce411b81db4cbf51fa7050'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:09.185572 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-58418988-325a-4dfa-970a-b45f3dd14b7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dbc23c684ce411b81db4cbf51fa7050'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:09.194613 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-58418988-325a-4dfa-970a-b45f3dd14b7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dbc23c684ce411b81db4cbf51fa7050'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:09.210127 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-58418988-325a-4dfa-970a-b45f3dd14b7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dbc23c684ce411b81db4cbf51fa7050'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:09.215047 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d2b1e-fcd0-4fe8-a3e9-8f390a1ead98 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:09.218513 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-58418988-325a-4dfa-970a-b45f3dd14b7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dbc23c684ce411b81db4cbf51fa7050'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:09.291319 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d2b1e-fcd0-4fe8-a3e9-8f390a1ead98 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:09.297676 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1cb9a1-29c7-4cc7-b9d8-b9b32dd8d0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:09.298420 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1cb9a1-29c7-4cc7-b9d8-b9b32dd8d0a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:09.299028 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1cb9a1-29c7-4cc7-b9d8-b9b32dd8d0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:09.299311 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1cb9a1-29c7-4cc7-b9d8-b9b32dd8d0a5 admin admin] PATH_INFO: `/v3/users/8e674a783232432283c2a6fffe1a949f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:09.300526 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1cb9a1-29c7-4cc7-b9d8-b9b32dd8d0a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e674a783232432283c2a6fffe1a949f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:09.303184 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1cb9a1-29c7-4cc7-b9d8-b9b32dd8d0a5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:09.307471 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1122/2286] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:50:08 2022] DELETE /identity/v3/users/9dbc23c684ce411b81db4cbf51fa7050 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:50:09.547335 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5c1cb9a1-29c7-4cc7-b9d8-b9b32dd8d0a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e674a783232432283c2a6fffe1a949f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:09.548029 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5c1cb9a1-29c7-4cc7-b9d8-b9b32dd8d0a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e674a783232432283c2a6fffe1a949f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:09.565747 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5c1cb9a1-29c7-4cc7-b9d8-b9b32dd8d0a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e674a783232432283c2a6fffe1a949f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:09.585172 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5c1cb9a1-29c7-4cc7-b9d8-b9b32dd8d0a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e674a783232432283c2a6fffe1a949f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:09.586127 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5c1cb9a1-29c7-4cc7-b9d8-b9b32dd8d0a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e674a783232432283c2a6fffe1a949f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:09.665898 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1165/2287] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:50:09 2022] DELETE /identity/v3/users/8e674a783232432283c2a6fffe1a949f => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:50:09.670701 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3065f-c867-471d-a7c3-6dfb4e8f28e8 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:09.671014 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3065f-c867-471d-a7c3-6dfb4e8f28e8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:09.671294 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3065f-c867-471d-a7c3-6dfb4e8f28e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:09.690720 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0ea3065f-c867-471d-a7c3-6dfb4e8f28e8 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:50:09.691853 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0ea3065f-c867-471d-a7c3-6dfb4e8f28e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:09.754371 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1123/2288] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:50:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:50:09.764604 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1cb9a1-29c7-4cc7-b9d8-b9b32dd8d0a5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:09.766055 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5c1cb9a1-29c7-4cc7-b9d8-b9b32dd8d0a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:09.819094 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3065f-c867-471d-a7c3-6dfb4e8f28e8 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:09.822600 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0ea3065f-c867-471d-a7c3-6dfb4e8f28e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:09.829955 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1cb9a1-29c7-4cc7-b9d8-b9b32dd8d0a5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:09.838620 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c7f28-843a-4f32-8782-a86b0e579dcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:09.839255 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c7f28-843a-4f32-8782-a86b0e579dcb service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:09.839537 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c7f28-843a-4f32-8782-a86b0e579dcb service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:09.839811 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c7f28-843a-4f32-8782-a86b0e579dcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:09.852765 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3065f-c867-471d-a7c3-6dfb4e8f28e8 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:09.859115 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c7f28-843a-4f32-8782-a86b0e579dcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:09.859475 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a09924-f27e-48a6-be41-3480dcb9f85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:09.860174 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a09924-f27e-48a6-be41-3480dcb9f85d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:09.860589 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a09924-f27e-48a6-be41-3480dcb9f85d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:09.860864 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a09924-f27e-48a6-be41-3480dcb9f85d admin admin] PATH_INFO: `/v3/projects/50c6c58f2ae54fe1b3836766533a749b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:09.861192 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c7f28-843a-4f32-8782-a86b0e579dcb service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:09.862477 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a09924-f27e-48a6-be41-3480dcb9f85d admin admin] RBAC: Authorizing `identity:delete_project(project_id=50c6c58f2ae54fe1b3836766533a749b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:09.864001 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a09924-f27e-48a6-be41-3480dcb9f85d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:09.873088 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1166/2289] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:50:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:50:10.064895 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-84a09924-f27e-48a6-be41-3480dcb9f85d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50c6c58f2ae54fe1b3836766533a749b', 'request_id': 'req-84a09924-f27e-48a6-be41-3480dcb9f85d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:10.188698 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-84a09924-f27e-48a6-be41-3480dcb9f85d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50c6c58f2ae54fe1b3836766533a749b', 'request_id': 'req-84a09924-f27e-48a6-be41-3480dcb9f85d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:10.199155 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-84a09924-f27e-48a6-be41-3480dcb9f85d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50c6c58f2ae54fe1b3836766533a749b', 'request_id': 'req-84a09924-f27e-48a6-be41-3480dcb9f85d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:10.211279 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-84a09924-f27e-48a6-be41-3480dcb9f85d admin admin] The token cache is being invalidate because project 50c6c58f2ae54fe1b3836766533a749b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:50:10.211572 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-84a09924-f27e-48a6-be41-3480dcb9f85d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:10.212245 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-84a09924-f27e-48a6-be41-3480dcb9f85d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:10.214041 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1124/2290] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:50:09 2022] DELETE /identity/v3/projects/50c6c58f2ae54fe1b3836766533a749b => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:50:10.218764 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26920908-d6ef-4af8-9625-71e0225b75d1 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:10.219220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26920908-d6ef-4af8-9625-71e0225b75d1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:10.219220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26920908-d6ef-4af8-9625-71e0225b75d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:10.248587 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-26920908-d6ef-4af8-9625-71e0225b75d1 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:50:10.248587 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-26920908-d6ef-4af8-9625-71e0225b75d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:10.328096 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145eca0b-60d5-4e74-9abe-e353a62a1330 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:10.328448 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145eca0b-60d5-4e74-9abe-e353a62a1330 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:10.329100 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145eca0b-60d5-4e74-9abe-e353a62a1330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:10.334131 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1167/2291] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:50:10.351804 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-145eca0b-60d5-4e74-9abe-e353a62a1330 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:50:10.353036 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-145eca0b-60d5-4e74-9abe-e353a62a1330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:10.361598 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1125/2292] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:50:10.366474 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26920908-d6ef-4af8-9625-71e0225b75d1 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:10.376483 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26920908-d6ef-4af8-9625-71e0225b75d1 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:10.406048 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b702d4-1603-499c-b7db-89376118787d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:10.406048 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b702d4-1603-499c-b7db-89376118787d admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:10.406048 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b702d4-1603-499c-b7db-89376118787d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:10.406048 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b702d4-1603-499c-b7db-89376118787d admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:10.406382 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b702d4-1603-499c-b7db-89376118787d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:50:10.406382 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b702d4-1603-499c-b7db-89376118787d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:10.406382 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b702d4-1603-499c-b7db-89376118787d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:10.414515 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1168/2293] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:50:10.419052 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145eca0b-60d5-4e74-9abe-e353a62a1330 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:10.428947 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145eca0b-60d5-4e74-9abe-e353a62a1330 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:10.433808 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b6c62-9e30-44c8-88b1-d2781b9964b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:10.437771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b6c62-9e30-44c8-88b1-d2781b9964b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:10.437771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b6c62-9e30-44c8-88b1-d2781b9964b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:10.437771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b6c62-9e30-44c8-88b1-d2781b9964b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:10.437771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b6c62-9e30-44c8-88b1-d2781b9964b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:10.437771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b6c62-9e30-44c8-88b1-d2781b9964b2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:10.499186 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b702d4-1603-499c-b7db-89376118787d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:10.500811 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e7b702d4-1603-499c-b7db-89376118787d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:10.515647 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b702d4-1603-499c-b7db-89376118787d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:10.520559 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb25f01-4a30-4b7d-b0fd-304bdf0da7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:10.521273 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb25f01-4a30-4b7d-b0fd-304bdf0da7bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:10.522273 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb25f01-4a30-4b7d-b0fd-304bdf0da7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:10.522564 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb25f01-4a30-4b7d-b0fd-304bdf0da7bc admin admin] PATH_INFO: `/v3/projects/d653fec7a2fb4e369a99a66a157616a3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:10.523819 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb25f01-4a30-4b7d-b0fd-304bdf0da7bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d653fec7a2fb4e369a99a66a157616a3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:10.525971 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb25f01-4a30-4b7d-b0fd-304bdf0da7bc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:10.595113 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1126/2294] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:50:10 2022] POST /identity/v3/projects => generated 373 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:50:10.600086 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b6c62-9e30-44c8-88b1-d2781b9964b2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:10.703750 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4fb25f01-4a30-4b7d-b0fd-304bdf0da7bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd653fec7a2fb4e369a99a66a157616a3', 'request_id': 'req-4fb25f01-4a30-4b7d-b0fd-304bdf0da7bc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:10.713324 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b6c62-9e30-44c8-88b1-d2781b9964b2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:10.782836 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0c647-3f71-45db-a64e-68cd1fbd935b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:10.783462 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0c647-3f71-45db-a64e-68cd1fbd935b admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:10.784380 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0c647-3f71-45db-a64e-68cd1fbd935b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:10.784666 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0c647-3f71-45db-a64e-68cd1fbd935b admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:10.785374 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0c647-3f71-45db-a64e-68cd1fbd935b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:10.787996 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0c647-3f71-45db-a64e-68cd1fbd935b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:10.804770 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:10.817276 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4fb25f01-4a30-4b7d-b0fd-304bdf0da7bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd653fec7a2fb4e369a99a66a157616a3', 'request_id': 'req-4fb25f01-4a30-4b7d-b0fd-304bdf0da7bc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:10.829866 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4fb25f01-4a30-4b7d-b0fd-304bdf0da7bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd653fec7a2fb4e369a99a66a157616a3', 'request_id': 'req-4fb25f01-4a30-4b7d-b0fd-304bdf0da7bc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:10.847725 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4fb25f01-4a30-4b7d-b0fd-304bdf0da7bc admin admin] The token cache is being invalidate because project d653fec7a2fb4e369a99a66a157616a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:50:10.848294 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4fb25f01-4a30-4b7d-b0fd-304bdf0da7bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:10.849071 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4fb25f01-4a30-4b7d-b0fd-304bdf0da7bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:10.850938 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1169/2295] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:50:10 2022] DELETE /identity/v3/projects/d653fec7a2fb4e369a99a66a157616a3 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:50:10.855689 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305619b-4743-477a-b16c-a671d2edea98 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:10.856039 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305619b-4743-477a-b16c-a671d2edea98 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:10.856414 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305619b-4743-477a-b16c-a671d2edea98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:10.876371 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e305619b-4743-477a-b16c-a671d2edea98 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:50:10.877767 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e305619b-4743-477a-b16c-a671d2edea98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:10.886658 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1170/2296] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:50:10.894554 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ef1fe-f656-48f8-a62c-8b05ff0d0a76 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:10.900975 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ef1fe-f656-48f8-a62c-8b05ff0d0a76 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:10.900975 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ef1fe-f656-48f8-a62c-8b05ff0d0a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:10.915168 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-685ef1fe-f656-48f8-a62c-8b05ff0d0a76 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:50:10.916362 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-685ef1fe-f656-48f8-a62c-8b05ff0d0a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:10.924361 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1171/2297] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:50:10.929305 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ef1fe-f656-48f8-a62c-8b05ff0d0a76 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:10.938146 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ef1fe-f656-48f8-a62c-8b05ff0d0a76 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:10.944137 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7bdd0-e5f8-4046-b42c-4cfa3eae6578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:10.944686 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1127/2298] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:50:10 2022] POST /identity/v3/users => generated 287 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:50:10.946338 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7bdd0-e5f8-4046-b42c-4cfa3eae6578 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:10.946722 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7bdd0-e5f8-4046-b42c-4cfa3eae6578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:10.947212 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7bdd0-e5f8-4046-b42c-4cfa3eae6578 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:10.947898 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7bdd0-e5f8-4046-b42c-4cfa3eae6578 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:50:10.948093 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0c647-3f71-45db-a64e-68cd1fbd935b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:10.948545 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7bdd0-e5f8-4046-b42c-4cfa3eae6578 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:10.949949 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-baf0c647-3f71-45db-a64e-68cd1fbd935b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:10.950412 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7bdd0-e5f8-4046-b42c-4cfa3eae6578 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:10.962523 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0c647-3f71-45db-a64e-68cd1fbd935b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:10.963842 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1172/2299] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:50:10.967974 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7bdd0-e5f8-4046-b42c-4cfa3eae6578 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:10.968543 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57604281-932e-447a-92dc-ede5386b48d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:10.969687 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57604281-932e-447a-92dc-ede5386b48d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:10.981311 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57604281-932e-447a-92dc-ede5386b48d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:10.981311 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57604281-932e-447a-92dc-ede5386b48d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:10.981311 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57604281-932e-447a-92dc-ede5386b48d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:10.981311 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57604281-932e-447a-92dc-ede5386b48d1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:10.981876 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7bdd0-e5f8-4046-b42c-4cfa3eae6578 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:10.983396 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338cdc36-406c-4735-81b5-c5f3fb3ce39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:10.984067 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cdc36-406c-4735-81b5-c5f3fb3ce39f admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:10.984410 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cdc36-406c-4735-81b5-c5f3fb3ce39f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:10.984742 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cdc36-406c-4735-81b5-c5f3fb3ce39f admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:10.988480 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1128/2300] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:50:10.988636 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338cdc36-406c-4735-81b5-c5f3fb3ce39f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:10.988636 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338cdc36-406c-4735-81b5-c5f3fb3ce39f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:10.989663 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57604281-932e-447a-92dc-ede5386b48d1 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:11.000291 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57604281-932e-447a-92dc-ede5386b48d1 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:11.005376 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:11.010994 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d52544-c472-4d45-ac63-7aa194cbebeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:11.011837 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d52544-c472-4d45-ac63-7aa194cbebeb admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:11.012117 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d52544-c472-4d45-ac63-7aa194cbebeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:11.012392 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d52544-c472-4d45-ac63-7aa194cbebeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:11.013092 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d52544-c472-4d45-ac63-7aa194cbebeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:11.014661 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d52544-c472-4d45-ac63-7aa194cbebeb admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:11.026602 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1129/2301] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:50:11.031613 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d52544-c472-4d45-ac63-7aa194cbebeb admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:11.042550 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d52544-c472-4d45-ac63-7aa194cbebeb admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:11.050323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c946d-af19-4118-8780-bb41ba9dcafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:11.050579 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c946d-af19-4118-8780-bb41ba9dcafe admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:11.050806 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c946d-af19-4118-8780-bb41ba9dcafe admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:11.051779 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c946d-af19-4118-8780-bb41ba9dcafe admin admin] PATH_INFO: `/v3/projects/ebcf95d7674442b5b56d8dea623cde7b/users/75eba0df0b8c4e82bc9a39b2a119d646/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:11.069401 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c946d-af19-4118-8780-bb41ba9dcafe admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebcf95d7674442b5b56d8dea623cde7b, user_id=75eba0df0b8c4e82bc9a39b2a119d646, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:11.072191 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c946d-af19-4118-8780-bb41ba9dcafe admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:11.121438 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1173/2302] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:50:10 2022] POST /identity/v3/projects => generated 375 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:50:11.125644 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338cdc36-406c-4735-81b5-c5f3fb3ce39f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:11.156198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1130/2303] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:50:11 2022] PUT /identity/v3/projects/ebcf95d7674442b5b56d8dea623cde7b/users/75eba0df0b8c4e82bc9a39b2a119d646/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:50:11.167671 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6039281-618e-4e6d-ac6d-e0c7b528ca00 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:11.168124 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6039281-618e-4e6d-ac6d-e0c7b528ca00 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:11.168551 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6039281-618e-4e6d-ac6d-e0c7b528ca00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:11.192943 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338cdc36-406c-4735-81b5-c5f3fb3ce39f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:11.207227 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f6039281-618e-4e6d-ac6d-e0c7b528ca00 None None] MFA Rules not processed for user `75eba0df0b8c4e82bc9a39b2a119d646`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:50:11.208511 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f6039281-618e-4e6d-ac6d-e0c7b528ca00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:11.295597 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1131/2304] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:50:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:50:11.306614 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6d4b9-1506-4af7-9c95-9e2e5e0bec92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:11.307509 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6d4b9-1506-4af7-9c95-9e2e5e0bec92 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:11.317853 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6d4b9-1506-4af7-9c95-9e2e5e0bec92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:11.317853 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6d4b9-1506-4af7-9c95-9e2e5e0bec92 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:11.317853 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6d4b9-1506-4af7-9c95-9e2e5e0bec92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:11.317853 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6d4b9-1506-4af7-9c95-9e2e5e0bec92 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:11.318845 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6039281-618e-4e6d-ac6d-e0c7b528ca00 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:11.318845 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f6039281-618e-4e6d-ac6d-e0c7b528ca00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:11.388391 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6039281-618e-4e6d-ac6d-e0c7b528ca00 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:11.392052 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26c685-9f49-4915-b563-0433e73b9218 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:11.392663 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26c685-9f49-4915-b563-0433e73b9218 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:11.392939 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26c685-9f49-4915-b563-0433e73b9218 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:11.393209 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26c685-9f49-4915-b563-0433e73b9218 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:11.403392 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c26c685-9f49-4915-b563-0433e73b9218 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:11.405155 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c26c685-9f49-4915-b563-0433e73b9218 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:11.457503 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1132/2305] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:50:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 03:50:11.462738 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26c685-9f49-4915-b563-0433e73b9218 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:11.472898 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1174/2306] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:50:11 2022] POST /identity/v3/users => generated 288 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:50:11.474853 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6d4b9-1506-4af7-9c95-9e2e5e0bec92 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:11.491471 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26c685-9f49-4915-b563-0433e73b9218 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:11.498621 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc51d2b-e8e4-4d85-b28b-07abaacda9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:11.505474 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc51d2b-e8e4-4d85-b28b-07abaacda9da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:11.506743 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc51d2b-e8e4-4d85-b28b-07abaacda9da admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:11.507293 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc51d2b-e8e4-4d85-b28b-07abaacda9da admin admin] PATH_INFO: `/v3/users/75eba0df0b8c4e82bc9a39b2a119d646` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:11.508884 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc51d2b-e8e4-4d85-b28b-07abaacda9da admin admin] RBAC: Authorizing `identity:delete_user(user_id=75eba0df0b8c4e82bc9a39b2a119d646)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:11.509295 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6d4b9-1506-4af7-9c95-9e2e5e0bec92 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:11.511478 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc51d2b-e8e4-4d85-b28b-07abaacda9da admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:11.524158 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ead797-d84d-4201-97bf-1fa74bda9ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:11.525240 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ead797-d84d-4201-97bf-1fa74bda9ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:11.525240 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ead797-d84d-4201-97bf-1fa74bda9ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:11.525437 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ead797-d84d-4201-97bf-1fa74bda9ae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:11.530070 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ead797-d84d-4201-97bf-1fa74bda9ae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:11.531749 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ead797-d84d-4201-97bf-1fa74bda9ae3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:11.554986 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1175/2307] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:50:11.560592 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ead797-d84d-4201-97bf-1fa74bda9ae3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:11.572425 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ead797-d84d-4201-97bf-1fa74bda9ae3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:11.578415 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15f429-1926-457c-bbe1-8a285a87c9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:11.579104 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15f429-1926-457c-bbe1-8a285a87c9c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:11.579795 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15f429-1926-457c-bbe1-8a285a87c9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:11.580198 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15f429-1926-457c-bbe1-8a285a87c9c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:11.580970 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15f429-1926-457c-bbe1-8a285a87c9c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:11.585510 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15f429-1926-457c-bbe1-8a285a87c9c7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:11.602272 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1176/2308] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:50:11.606644 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15f429-1926-457c-bbe1-8a285a87c9c7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:11.622508 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15f429-1926-457c-bbe1-8a285a87c9c7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:11.645308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cdb014-9cbd-4e6b-9f11-2b695c0e9f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:11.646194 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdb014-9cbd-4e6b-9f11-2b695c0e9f2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:11.646471 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdb014-9cbd-4e6b-9f11-2b695c0e9f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:11.646747 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdb014-9cbd-4e6b-9f11-2b695c0e9f2c admin admin] PATH_INFO: `/v3/projects/54b4523cdd05471b9a17219ad80b1bfd/users/644dbb5b97ba4c02959c2b1febc10052/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:11.666083 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cdb014-9cbd-4e6b-9f11-2b695c0e9f2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=54b4523cdd05471b9a17219ad80b1bfd, user_id=644dbb5b97ba4c02959c2b1febc10052, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:11.669674 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cdb014-9cbd-4e6b-9f11-2b695c0e9f2c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:11.729341 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1177/2309] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:50:11 2022] PUT /identity/v3/projects/54b4523cdd05471b9a17219ad80b1bfd/users/644dbb5b97ba4c02959c2b1febc10052/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:50:11.742354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00111fcd-b540-45d5-81b9-f7c88abd579b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:11.742892 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00111fcd-b540-45d5-81b9-f7c88abd579b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:11.743311 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00111fcd-b540-45d5-81b9-f7c88abd579b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:11.777914 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-00111fcd-b540-45d5-81b9-f7c88abd579b None None] MFA Rules not processed for user `644dbb5b97ba4c02959c2b1febc10052`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:50:11.779434 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-00111fcd-b540-45d5-81b9-f7c88abd579b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:11.852093 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fbc51d2b-e8e4-4d85-b28b-07abaacda9da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75eba0df0b8c4e82bc9a39b2a119d646'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:11.853752 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fbc51d2b-e8e4-4d85-b28b-07abaacda9da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75eba0df0b8c4e82bc9a39b2a119d646'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:11.867813 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1178/2310] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:50:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:50:11.879655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00111fcd-b540-45d5-81b9-f7c88abd579b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:11.881585 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-00111fcd-b540-45d5-81b9-f7c88abd579b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:11.881836 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fbc51d2b-e8e4-4d85-b28b-07abaacda9da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75eba0df0b8c4e82bc9a39b2a119d646'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:11.913417 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fbc51d2b-e8e4-4d85-b28b-07abaacda9da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75eba0df0b8c4e82bc9a39b2a119d646'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:11.926487 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fbc51d2b-e8e4-4d85-b28b-07abaacda9da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75eba0df0b8c4e82bc9a39b2a119d646'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:11.975672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00111fcd-b540-45d5-81b9-f7c88abd579b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:11.980521 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e4c25-aa3c-47cd-8bd5-80891e929338 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:11.981747 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e4c25-aa3c-47cd-8bd5-80891e929338 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:11.982525 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e4c25-aa3c-47cd-8bd5-80891e929338 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:11.983385 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e4c25-aa3c-47cd-8bd5-80891e929338 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:11.985480 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8c2e4c25-aa3c-47cd-8bd5-80891e929338 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:11.999230 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e4c25-aa3c-47cd-8bd5-80891e929338 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:12.000991 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e4c25-aa3c-47cd-8bd5-80891e929338 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:12.015664 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1179/2311] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:50:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:50:12.032509 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1133/2312] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:50:11 2022] DELETE /identity/v3/users/75eba0df0b8c4e82bc9a39b2a119d646 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:50:12.037780 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08a8f9-9954-4b92-9840-d7d19e015ab5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:12.038067 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08a8f9-9954-4b92-9840-d7d19e015ab5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:12.038336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08a8f9-9954-4b92-9840-d7d19e015ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:12.075048 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1b08a8f9-9954-4b92-9840-d7d19e015ab5 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:50:12.080876 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1b08a8f9-9954-4b92-9840-d7d19e015ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:12.183706 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1180/2313] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:50:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:50:12.202663 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc51d2b-e8e4-4d85-b28b-07abaacda9da admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:12.206280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fbc51d2b-e8e4-4d85-b28b-07abaacda9da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:12.308430 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc51d2b-e8e4-4d85-b28b-07abaacda9da admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:12.317421 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988d89d-7a10-49bc-8b15-4f72c7e2c480 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:12.318503 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988d89d-7a10-49bc-8b15-4f72c7e2c480 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:12.318794 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988d89d-7a10-49bc-8b15-4f72c7e2c480 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:12.319069 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988d89d-7a10-49bc-8b15-4f72c7e2c480 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:12.339507 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3988d89d-7a10-49bc-8b15-4f72c7e2c480 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:12.341073 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3988d89d-7a10-49bc-8b15-4f72c7e2c480 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:12.364620 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1134/2314] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:50:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 03:50:12.377891 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:12.475755 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:13.031129 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08a8f9-9954-4b92-9840-d7d19e015ab5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:13.033421 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1b08a8f9-9954-4b92-9840-d7d19e015ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:13.053203 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08a8f9-9954-4b92-9840-d7d19e015ab5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:13.059620 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dbcbd3-dc9c-4ddf-baf1-85cfcfd0a059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:13.060507 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbcbd3-dc9c-4ddf-baf1-85cfcfd0a059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:13.060906 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbcbd3-dc9c-4ddf-baf1-85cfcfd0a059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:13.061326 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbcbd3-dc9c-4ddf-baf1-85cfcfd0a059 admin admin] PATH_INFO: `/v3/projects/ebcf95d7674442b5b56d8dea623cde7b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:13.062843 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dbcbd3-dc9c-4ddf-baf1-85cfcfd0a059 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebcf95d7674442b5b56d8dea623cde7b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:13.065926 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dbcbd3-dc9c-4ddf-baf1-85cfcfd0a059 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:13.209556 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-97dbcbd3-dc9c-4ddf-baf1-85cfcfd0a059 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebcf95d7674442b5b56d8dea623cde7b', 'request_id': 'req-97dbcbd3-dc9c-4ddf-baf1-85cfcfd0a059'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:13.294766 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-97dbcbd3-dc9c-4ddf-baf1-85cfcfd0a059 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebcf95d7674442b5b56d8dea623cde7b', 'request_id': 'req-97dbcbd3-dc9c-4ddf-baf1-85cfcfd0a059'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:13.310583 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-97dbcbd3-dc9c-4ddf-baf1-85cfcfd0a059 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebcf95d7674442b5b56d8dea623cde7b', 'request_id': 'req-97dbcbd3-dc9c-4ddf-baf1-85cfcfd0a059'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:13.330460 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-97dbcbd3-dc9c-4ddf-baf1-85cfcfd0a059 admin admin] The token cache is being invalidate because project ebcf95d7674442b5b56d8dea623cde7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:50:13.330658 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-97dbcbd3-dc9c-4ddf-baf1-85cfcfd0a059 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:13.331310 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-97dbcbd3-dc9c-4ddf-baf1-85cfcfd0a059 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:13.332983 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1181/2315] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:50:13 2022] DELETE /identity/v3/projects/ebcf95d7674442b5b56d8dea623cde7b => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:50:13.338466 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd6b90-353e-410f-9c84-7100fbe75a21 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:13.340703 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd6b90-353e-410f-9c84-7100fbe75a21 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:13.341295 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd6b90-353e-410f-9c84-7100fbe75a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:13.363382 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-5bdd6b90-353e-410f-9c84-7100fbe75a21 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:50:13.364812 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5bdd6b90-353e-410f-9c84-7100fbe75a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:13.442311 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1135/2316] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:50:13.454133 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a48d1-ee00-46ac-ab25-65d2af57ed16 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:13.454509 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a48d1-ee00-46ac-ab25-65d2af57ed16 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:13.454696 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a48d1-ee00-46ac-ab25-65d2af57ed16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:13.477287 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a06a48d1-ee00-46ac-ab25-65d2af57ed16 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:50:13.478628 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a06a48d1-ee00-46ac-ab25-65d2af57ed16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:13.487316 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1182/2317] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:50:13.491617 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd6b90-353e-410f-9c84-7100fbe75a21 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:13.501518 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd6b90-353e-410f-9c84-7100fbe75a21 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:13.506920 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388cdd0-2cf2-48cb-9e20-1297bd99b00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:13.507535 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388cdd0-2cf2-48cb-9e20-1297bd99b00a admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:13.507834 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388cdd0-2cf2-48cb-9e20-1297bd99b00a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:13.508129 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388cdd0-2cf2-48cb-9e20-1297bd99b00a admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:13.508784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5388cdd0-2cf2-48cb-9e20-1297bd99b00a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:50:13.509096 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5388cdd0-2cf2-48cb-9e20-1297bd99b00a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:13.510724 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5388cdd0-2cf2-48cb-9e20-1297bd99b00a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:13.523214 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1136/2318] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:50:13.527845 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a48d1-ee00-46ac-ab25-65d2af57ed16 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:13.537565 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a48d1-ee00-46ac-ab25-65d2af57ed16 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:13.542478 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420606c0-7635-4f4c-990f-0c87bc6737b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:13.543104 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420606c0-7635-4f4c-990f-0c87bc6737b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:13.543385 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420606c0-7635-4f4c-990f-0c87bc6737b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:13.543660 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420606c0-7635-4f4c-990f-0c87bc6737b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:13.544290 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420606c0-7635-4f4c-990f-0c87bc6737b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:13.546254 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420606c0-7635-4f4c-990f-0c87bc6737b4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:13.682576 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1183/2319] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:50:13 2022] POST /identity/v3/projects => generated 369 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:50:13.687871 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388cdd0-2cf2-48cb-9e20-1297bd99b00a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:13.709142 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388cdd0-2cf2-48cb-9e20-1297bd99b00a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:13.769435 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea20dc-a358-49b3-beac-017ddb7ab1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:13.770081 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea20dc-a358-49b3-beac-017ddb7ab1da admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:13.770366 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea20dc-a358-49b3-beac-017ddb7ab1da admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:13.770638 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea20dc-a358-49b3-beac-017ddb7ab1da admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:13.771817 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ea20dc-a358-49b3-beac-017ddb7ab1da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:13.773735 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ea20dc-a358-49b3-beac-017ddb7ab1da admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:13.937987 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1137/2320] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:50:13 2022] POST /identity/v3/users => generated 285 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:50:13.942405 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420606c0-7635-4f4c-990f-0c87bc6737b4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:13.953942 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420606c0-7635-4f4c-990f-0c87bc6737b4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:13.959822 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c5c26-e082-4351-9842-fa45b314f2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:13.960575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c5c26-e082-4351-9842-fa45b314f2a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:13.960960 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c5c26-e082-4351-9842-fa45b314f2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:13.961340 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c5c26-e082-4351-9842-fa45b314f2a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:13.962133 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65c5c26-e082-4351-9842-fa45b314f2a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:13.964031 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65c5c26-e082-4351-9842-fa45b314f2a0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:13.980957 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1184/2321] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:50:13.981057 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea20dc-a358-49b3-beac-017ddb7ab1da admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:13.995556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea20dc-a358-49b3-beac-017ddb7ab1da admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:14.000800 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3a3cc-fc5e-49e5-bc30-52441b71d470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:14.001495 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3a3cc-fc5e-49e5-bc30-52441b71d470 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:14.001887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3a3cc-fc5e-49e5-bc30-52441b71d470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:14.002218 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3a3cc-fc5e-49e5-bc30-52441b71d470 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:14.002934 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3a3cc-fc5e-49e5-bc30-52441b71d470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:14.004634 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3a3cc-fc5e-49e5-bc30-52441b71d470 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:14.025680 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1138/2322] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:50:14.027405 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c5c26-e082-4351-9842-fa45b314f2a0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:14.039955 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c5c26-e082-4351-9842-fa45b314f2a0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:14.047186 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ecb416-616a-40cb-bf16-439e4f084afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:14.049905 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecb416-616a-40cb-bf16-439e4f084afc admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:14.056016 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecb416-616a-40cb-bf16-439e4f084afc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:14.056469 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecb416-616a-40cb-bf16-439e4f084afc admin admin] PATH_INFO: `/v3/projects/8c220c598b9b41af90088ea576b2edeb/users/bb502a5537ac43829d9c230ffe62f1c8/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:14.108476 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ecb416-616a-40cb-bf16-439e4f084afc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c220c598b9b41af90088ea576b2edeb, user_id=bb502a5537ac43829d9c230ffe62f1c8, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:14.114495 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ecb416-616a-40cb-bf16-439e4f084afc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:14.221124 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1185/2323] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:50:14 2022] PUT /identity/v3/projects/8c220c598b9b41af90088ea576b2edeb/users/bb502a5537ac43829d9c230ffe62f1c8/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:50:14.231734 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb389db-5e84-4709-b5ae-cfbc8011888a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:14.232198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb389db-5e84-4709-b5ae-cfbc8011888a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:14.232384 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb389db-5e84-4709-b5ae-cfbc8011888a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:14.292360 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-dbb389db-5e84-4709-b5ae-cfbc8011888a None None] MFA Rules not processed for user `bb502a5537ac43829d9c230ffe62f1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:50:14.306424 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dbb389db-5e84-4709-b5ae-cfbc8011888a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:14.445852 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1139/2324] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:50:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:50:14.454263 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ecb416-616a-40cb-bf16-439e4f084afc admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:14.456289 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-57ecb416-616a-40cb-bf16-439e4f084afc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:14.558501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ecb416-616a-40cb-bf16-439e4f084afc admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:14.562877 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494478e-3298-42a4-808d-6c1f3c604273 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aafb065e06c3481bbed8d98e893766ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:14.563494 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494478e-3298-42a4-808d-6c1f3c604273 service glance] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:14.563774 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494478e-3298-42a4-808d-6c1f3c604273 service glance] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:14.564049 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494478e-3298-42a4-808d-6c1f3c604273 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:14.593671 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1494478e-3298-42a4-808d-6c1f3c604273 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:14.595373 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1494478e-3298-42a4-808d-6c1f3c604273 service glance] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:14.609742 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1186/2325] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:50:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:50:14.741852 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:14.845052 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:17.640555 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:18.245550 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb389db-5e84-4709-b5ae-cfbc8011888a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:18.247016 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dbb389db-5e84-4709-b5ae-cfbc8011888a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:18.313095 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb389db-5e84-4709-b5ae-cfbc8011888a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:18.318004 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871be990-642f-45d8-9a03-ae3ac94c06d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:18.319240 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871be990-642f-45d8-9a03-ae3ac94c06d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:18.319523 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871be990-642f-45d8-9a03-ae3ac94c06d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:18.319795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871be990-642f-45d8-9a03-ae3ac94c06d2 admin admin] PATH_INFO: `/v3/users/644dbb5b97ba4c02959c2b1febc10052` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:18.320974 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871be990-642f-45d8-9a03-ae3ac94c06d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=644dbb5b97ba4c02959c2b1febc10052)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:18.323004 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871be990-642f-45d8-9a03-ae3ac94c06d2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:18.566276 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-871be990-642f-45d8-9a03-ae3ac94c06d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '644dbb5b97ba4c02959c2b1febc10052'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:18.566946 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-871be990-642f-45d8-9a03-ae3ac94c06d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '644dbb5b97ba4c02959c2b1febc10052'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:18.574344 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-871be990-642f-45d8-9a03-ae3ac94c06d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '644dbb5b97ba4c02959c2b1febc10052'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:18.587458 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-871be990-642f-45d8-9a03-ae3ac94c06d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '644dbb5b97ba4c02959c2b1febc10052'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:18.588116 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-871be990-642f-45d8-9a03-ae3ac94c06d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '644dbb5b97ba4c02959c2b1febc10052'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:18.705075 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1140/2326] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:50:18 2022] DELETE /identity/v3/users/644dbb5b97ba4c02959c2b1febc10052 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:50:18.709993 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd09eb-5759-49ea-985a-a3c479d0820e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:18.710414 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd09eb-5759-49ea-985a-a3c479d0820e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:18.710666 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd09eb-5759-49ea-985a-a3c479d0820e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:18.730311 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-05fd09eb-5759-49ea-985a-a3c479d0820e None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:50:18.731469 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-05fd09eb-5759-49ea-985a-a3c479d0820e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:18.790423 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1187/2327] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:50:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:50:18.800921 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871be990-642f-45d8-9a03-ae3ac94c06d2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:18.802613 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-871be990-642f-45d8-9a03-ae3ac94c06d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:18.851693 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:18.891902 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871be990-642f-45d8-9a03-ae3ac94c06d2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:18.896791 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d65f52-0079-4e49-9f97-a515d7fb0a3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:18.897733 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d65f52-0079-4e49-9f97-a515d7fb0a3f service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:18.898395 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d65f52-0079-4e49-9f97-a515d7fb0a3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:18.898927 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d65f52-0079-4e49-9f97-a515d7fb0a3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:18.918467 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d65f52-0079-4e49-9f97-a515d7fb0a3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:18.919941 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d65f52-0079-4e49-9f97-a515d7fb0a3f service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:18.932248 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1141/2328] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:50:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 03:50:18.995201 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:19.068418 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd09eb-5759-49ea-985a-a3c479d0820e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:19.070467 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-05fd09eb-5759-49ea-985a-a3c479d0820e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:19.095289 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62f4b0-f771-40c5-b0ff-dbe63b30f028 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:19.095289 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62f4b0-f771-40c5-b0ff-dbe63b30f028 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:19.095289 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62f4b0-f771-40c5-b0ff-dbe63b30f028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:19.095789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd09eb-5759-49ea-985a-a3c479d0820e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:19.103040 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15c2e5-8441-451d-8e88-d2c5bfb6f8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:19.103698 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15c2e5-8441-451d-8e88-d2c5bfb6f8b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:19.103977 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15c2e5-8441-451d-8e88-d2c5bfb6f8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:19.104252 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15c2e5-8441-451d-8e88-d2c5bfb6f8b8 admin admin] PATH_INFO: `/v3/users/64b32275f6234051bd0e6aaa71ab3b5a` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:19.105601 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15c2e5-8441-451d-8e88-d2c5bfb6f8b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64b32275f6234051bd0e6aaa71ab3b5a)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:19.107610 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15c2e5-8441-451d-8e88-d2c5bfb6f8b8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:19.112123 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-bd62f4b0-f771-40c5-b0ff-dbe63b30f028 None None] MFA Rules not processed for user `b0812002d7b14bcb81a42eb380231feb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:50:19.113816 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bd62f4b0-f771-40c5-b0ff-dbe63b30f028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:19.171741 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1142/2329] 10.222.0.33 () {58 vars in 1009 bytes} [Fri Sep 16 03:50:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:50:19.214671 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd62f4b0-f771-40c5-b0ff-dbe63b30f028 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:19.216201 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bd62f4b0-f771-40c5-b0ff-dbe63b30f028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:19.306745 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd62f4b0-f771-40c5-b0ff-dbe63b30f028 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:19.312467 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db904e0f-bf5b-46f0-a4bc-11453ede1124 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f784d98d5f440c681f53ae70f6d1cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:19.313151 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db904e0f-bf5b-46f0-a4bc-11453ede1124 service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:19.313429 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db904e0f-bf5b-46f0-a4bc-11453ede1124 service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:19.313728 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db904e0f-bf5b-46f0-a4bc-11453ede1124 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:19.322680 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db904e0f-bf5b-46f0-a4bc-11453ede1124 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:19.324275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db904e0f-bf5b-46f0-a4bc-11453ede1124 service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:19.333300 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1143/2330] 10.222.0.33 () {60 vars in 1384 bytes} [Fri Sep 16 03:50:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 03:50:19.455816 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0e15c2e5-8441-451d-8e88-d2c5bfb6f8b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64b32275f6234051bd0e6aaa71ab3b5a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:19.456974 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0e15c2e5-8441-451d-8e88-d2c5bfb6f8b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64b32275f6234051bd0e6aaa71ab3b5a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:19.467387 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0e15c2e5-8441-451d-8e88-d2c5bfb6f8b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64b32275f6234051bd0e6aaa71ab3b5a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:19.484162 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0e15c2e5-8441-451d-8e88-d2c5bfb6f8b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64b32275f6234051bd0e6aaa71ab3b5a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:19.484954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0e15c2e5-8441-451d-8e88-d2c5bfb6f8b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64b32275f6234051bd0e6aaa71ab3b5a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:19.542985 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db904e0f-bf5b-46f0-a4bc-11453ede1124 service swift] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:19.546687 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-db904e0f-bf5b-46f0-a4bc-11453ede1124 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:19.576080 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1188/2331] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:50:19 2022] DELETE /identity/v3/users/64b32275f6234051bd0e6aaa71ab3b5a => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:50:19.580784 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38d04e-6d6e-45eb-9637-dbccb25b269f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:19.581174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38d04e-6d6e-45eb-9637-dbccb25b269f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:19.581702 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38d04e-6d6e-45eb-9637-dbccb25b269f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:19.586855 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db904e0f-bf5b-46f0-a4bc-11453ede1124 service swift] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:19.612738 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6f38d04e-6d6e-45eb-9637-dbccb25b269f None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:50:19.614195 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6f38d04e-6d6e-45eb-9637-dbccb25b269f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:19.739073 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e53541-ffc0-44b7-8fe4-b6b1a7d71963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:19.739769 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e53541-ffc0-44b7-8fe4-b6b1a7d71963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:19.740589 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e53541-ffc0-44b7-8fe4-b6b1a7d71963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:19.741008 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e53541-ffc0-44b7-8fe4-b6b1a7d71963 admin admin] PATH_INFO: `/v3/projects/54b4523cdd05471b9a17219ad80b1bfd` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:19.742346 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e53541-ffc0-44b7-8fe4-b6b1a7d71963 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54b4523cdd05471b9a17219ad80b1bfd)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:19.744389 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e53541-ffc0-44b7-8fe4-b6b1a7d71963 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:19.790981 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1189/2332] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:50:19.801500 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38d04e-6d6e-45eb-9637-dbccb25b269f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:19.803131 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6f38d04e-6d6e-45eb-9637-dbccb25b269f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:19.876627 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38d04e-6d6e-45eb-9637-dbccb25b269f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:19.884045 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-46e53541-ffc0-44b7-8fe4-b6b1a7d71963 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54b4523cdd05471b9a17219ad80b1bfd', 'request_id': 'req-46e53541-ffc0-44b7-8fe4-b6b1a7d71963'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:19.924860 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490d33e-8091-4e86-80f6-9790d2cb03ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:19.925473 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490d33e-8091-4e86-80f6-9790d2cb03ba service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:19.925797 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490d33e-8091-4e86-80f6-9790d2cb03ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:19.926064 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490d33e-8091-4e86-80f6-9790d2cb03ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:19.990493 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490d33e-8091-4e86-80f6-9790d2cb03ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:19.991946 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490d33e-8091-4e86-80f6-9790d2cb03ba service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:20.001489 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1190/2333] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:50:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 03:50:20.011121 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-46e53541-ffc0-44b7-8fe4-b6b1a7d71963 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54b4523cdd05471b9a17219ad80b1bfd', 'request_id': 'req-46e53541-ffc0-44b7-8fe4-b6b1a7d71963'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:20.019052 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-46e53541-ffc0-44b7-8fe4-b6b1a7d71963 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54b4523cdd05471b9a17219ad80b1bfd', 'request_id': 'req-46e53541-ffc0-44b7-8fe4-b6b1a7d71963'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:20.032253 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-46e53541-ffc0-44b7-8fe4-b6b1a7d71963 admin admin] The token cache is being invalidate because project 54b4523cdd05471b9a17219ad80b1bfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:50:20.032577 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-46e53541-ffc0-44b7-8fe4-b6b1a7d71963 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:20.033772 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-46e53541-ffc0-44b7-8fe4-b6b1a7d71963 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:20.035818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1144/2334] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:50:19 2022] DELETE /identity/v3/projects/54b4523cdd05471b9a17219ad80b1bfd => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:50:20.659080 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490d33e-8091-4e86-80f6-9790d2cb03ba service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:20.661240 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8490d33e-8091-4e86-80f6-9790d2cb03ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:20.680674 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490d33e-8091-4e86-80f6-9790d2cb03ba service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:20.685823 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9e5c8-72a9-4c5f-811c-e37c7fe947c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:20.686473 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9e5c8-72a9-4c5f-811c-e37c7fe947c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:20.686755 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9e5c8-72a9-4c5f-811c-e37c7fe947c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:20.687032 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9e5c8-72a9-4c5f-811c-e37c7fe947c1 admin admin] PATH_INFO: `/v3/projects/cc9d436570584c3b82d6063c45de818b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:20.688309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9e5c8-72a9-4c5f-811c-e37c7fe947c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc9d436570584c3b82d6063c45de818b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:20.694611 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9e5c8-72a9-4c5f-811c-e37c7fe947c1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:20.930370 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-36f9e5c8-72a9-4c5f-811c-e37c7fe947c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc9d436570584c3b82d6063c45de818b', 'request_id': 'req-36f9e5c8-72a9-4c5f-811c-e37c7fe947c1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:21.078309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-36f9e5c8-72a9-4c5f-811c-e37c7fe947c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc9d436570584c3b82d6063c45de818b', 'request_id': 'req-36f9e5c8-72a9-4c5f-811c-e37c7fe947c1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:21.089121 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-36f9e5c8-72a9-4c5f-811c-e37c7fe947c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc9d436570584c3b82d6063c45de818b', 'request_id': 'req-36f9e5c8-72a9-4c5f-811c-e37c7fe947c1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:21.104389 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-36f9e5c8-72a9-4c5f-811c-e37c7fe947c1 admin admin] The token cache is being invalidate because project cc9d436570584c3b82d6063c45de818b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:50:21.104682 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-36f9e5c8-72a9-4c5f-811c-e37c7fe947c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:21.114652 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-36f9e5c8-72a9-4c5f-811c-e37c7fe947c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:21.114652 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1191/2335] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:50:20 2022] DELETE /identity/v3/projects/cc9d436570584c3b82d6063c45de818b => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:50:22.080357 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:22.108450 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:23.680070 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:23.741970 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:25.394335 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:26.114643 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:27.455077 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:28.165877 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:29.399922 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:30.445780 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:31.118755 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:32.127603 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:32.243833 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:33.765815 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:33.794521 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:34.817192 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:35.335811 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:36.080174 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:36.429447 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:36.981720 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:37.072327 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:37.654580 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e53541-ffc0-44b7-8fe4-b6b1a7d71963 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:37.657794 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-46e53541-ffc0-44b7-8fe4-b6b1a7d71963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:37.700961 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e53541-ffc0-44b7-8fe4-b6b1a7d71963 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:37.802541 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47eaaa-b8a5-4b4c-bd5f-a8dfd0e23fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:37.803387 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47eaaa-b8a5-4b4c-bd5f-a8dfd0e23fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:37.803680 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47eaaa-b8a5-4b4c-bd5f-a8dfd0e23fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:37.804081 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47eaaa-b8a5-4b4c-bd5f-a8dfd0e23fe2 admin admin] PATH_INFO: `/v3/users/66014603adea41d9ba27ec8ffd7f76d8` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:37.805305 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc47eaaa-b8a5-4b4c-bd5f-a8dfd0e23fe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66014603adea41d9ba27ec8ffd7f76d8)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:37.807508 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc47eaaa-b8a5-4b4c-bd5f-a8dfd0e23fe2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:38.038831 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dc47eaaa-b8a5-4b4c-bd5f-a8dfd0e23fe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66014603adea41d9ba27ec8ffd7f76d8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:38.040254 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dc47eaaa-b8a5-4b4c-bd5f-a8dfd0e23fe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66014603adea41d9ba27ec8ffd7f76d8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:38.052840 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dc47eaaa-b8a5-4b4c-bd5f-a8dfd0e23fe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66014603adea41d9ba27ec8ffd7f76d8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:38.076321 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dc47eaaa-b8a5-4b4c-bd5f-a8dfd0e23fe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66014603adea41d9ba27ec8ffd7f76d8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:38.077144 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dc47eaaa-b8a5-4b4c-bd5f-a8dfd0e23fe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66014603adea41d9ba27ec8ffd7f76d8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:38.172695 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1145/2336] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:50:37 2022] DELETE /identity/v3/users/66014603adea41d9ba27ec8ffd7f76d8 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:50:38.221135 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:38.263541 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:38.514656 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9e5c8-72a9-4c5f-811c-e37c7fe947c1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:38.516707 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-36f9e5c8-72a9-4c5f-811c-e37c7fe947c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:38.574507 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9e5c8-72a9-4c5f-811c-e37c7fe947c1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:38.669718 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e54d44-fb2a-4d45-b63c-92c7a7632d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:38.670613 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e54d44-fb2a-4d45-b63c-92c7a7632d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:38.670899 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e54d44-fb2a-4d45-b63c-92c7a7632d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:38.671176 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e54d44-fb2a-4d45-b63c-92c7a7632d7c admin admin] PATH_INFO: `/v3/projects/5a82c8dcc081412d90f1ccabc749f05c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:38.675216 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e54d44-fb2a-4d45-b63c-92c7a7632d7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a82c8dcc081412d90f1ccabc749f05c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:38.677581 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e54d44-fb2a-4d45-b63c-92c7a7632d7c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:38.962018 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-00e54d44-fb2a-4d45-b63c-92c7a7632d7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a82c8dcc081412d90f1ccabc749f05c', 'request_id': 'req-00e54d44-fb2a-4d45-b63c-92c7a7632d7c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:39.138161 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-00e54d44-fb2a-4d45-b63c-92c7a7632d7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a82c8dcc081412d90f1ccabc749f05c', 'request_id': 'req-00e54d44-fb2a-4d45-b63c-92c7a7632d7c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:39.149267 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-00e54d44-fb2a-4d45-b63c-92c7a7632d7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a82c8dcc081412d90f1ccabc749f05c', 'request_id': 'req-00e54d44-fb2a-4d45-b63c-92c7a7632d7c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:39.189926 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-00e54d44-fb2a-4d45-b63c-92c7a7632d7c admin admin] The token cache is being invalidate because project 5a82c8dcc081412d90f1ccabc749f05c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:50:39.189926 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-00e54d44-fb2a-4d45-b63c-92c7a7632d7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:39.189926 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-00e54d44-fb2a-4d45-b63c-92c7a7632d7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:39.189926 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1192/2337] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:50:38 2022] DELETE /identity/v3/projects/5a82c8dcc081412d90f1ccabc749f05c => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:50:39.191374 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47eaaa-b8a5-4b4c-bd5f-a8dfd0e23fe2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:39.195249 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dc47eaaa-b8a5-4b4c-bd5f-a8dfd0e23fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:39.212598 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47eaaa-b8a5-4b4c-bd5f-a8dfd0e23fe2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:39.289010 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55a5ae-5e9c-4028-9d00-91a2a45008bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:39.294049 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:39.295014 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55a5ae-5e9c-4028-9d00-91a2a45008bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:39.296179 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55a5ae-5e9c-4028-9d00-91a2a45008bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:39.296825 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55a5ae-5e9c-4028-9d00-91a2a45008bb admin admin] PATH_INFO: `/v3/users/fb0fdf3b1d3c48f0b3f4151e66ef15da` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:39.298645 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55a5ae-5e9c-4028-9d00-91a2a45008bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb0fdf3b1d3c48f0b3f4151e66ef15da)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:39.301339 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55a5ae-5e9c-4028-9d00-91a2a45008bb admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:39.377613 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:39.605389 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1e55a5ae-5e9c-4028-9d00-91a2a45008bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb0fdf3b1d3c48f0b3f4151e66ef15da'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:39.606356 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1e55a5ae-5e9c-4028-9d00-91a2a45008bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb0fdf3b1d3c48f0b3f4151e66ef15da'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:39.616164 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1e55a5ae-5e9c-4028-9d00-91a2a45008bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb0fdf3b1d3c48f0b3f4151e66ef15da'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:39.630311 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1e55a5ae-5e9c-4028-9d00-91a2a45008bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb0fdf3b1d3c48f0b3f4151e66ef15da'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:39.633581 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1e55a5ae-5e9c-4028-9d00-91a2a45008bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb0fdf3b1d3c48f0b3f4151e66ef15da'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:39.754605 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1146/2338] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:50:39 2022] DELETE /identity/v3/users/fb0fdf3b1d3c48f0b3f4151e66ef15da => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:50:40.141882 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e54d44-fb2a-4d45-b63c-92c7a7632d7c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:40.143221 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-00e54d44-fb2a-4d45-b63c-92c7a7632d7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:40.162687 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e54d44-fb2a-4d45-b63c-92c7a7632d7c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:40.241848 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4e661-2398-4cdf-a23f-066a8a9f2441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:40.242672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4e661-2398-4cdf-a23f-066a8a9f2441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:40.243049 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4e661-2398-4cdf-a23f-066a8a9f2441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:40.243573 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4e661-2398-4cdf-a23f-066a8a9f2441 admin admin] PATH_INFO: `/v3/projects/f87c76e7c86d46108f703a81c8fceb0f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:40.245139 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb4e661-2398-4cdf-a23f-066a8a9f2441 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f87c76e7c86d46108f703a81c8fceb0f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:40.247102 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb4e661-2398-4cdf-a23f-066a8a9f2441 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:40.385534 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ebb4e661-2398-4cdf-a23f-066a8a9f2441 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f87c76e7c86d46108f703a81c8fceb0f', 'request_id': 'req-ebb4e661-2398-4cdf-a23f-066a8a9f2441'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:40.480230 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ebb4e661-2398-4cdf-a23f-066a8a9f2441 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f87c76e7c86d46108f703a81c8fceb0f', 'request_id': 'req-ebb4e661-2398-4cdf-a23f-066a8a9f2441'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:40.487899 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ebb4e661-2398-4cdf-a23f-066a8a9f2441 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f87c76e7c86d46108f703a81c8fceb0f', 'request_id': 'req-ebb4e661-2398-4cdf-a23f-066a8a9f2441'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:40.510439 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ebb4e661-2398-4cdf-a23f-066a8a9f2441 admin admin] The token cache is being invalidate because project f87c76e7c86d46108f703a81c8fceb0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:50:40.511988 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ebb4e661-2398-4cdf-a23f-066a8a9f2441 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:40.513706 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ebb4e661-2398-4cdf-a23f-066a8a9f2441 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:40.516732 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1193/2339] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:50:40 2022] DELETE /identity/v3/projects/f87c76e7c86d46108f703a81c8fceb0f => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:50:40.522588 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da8db5-cdb4-4267-ba6e-7a1da21b64a9 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:40.523086 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da8db5-cdb4-4267-ba6e-7a1da21b64a9 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:40.523354 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da8db5-cdb4-4267-ba6e-7a1da21b64a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:40.548078 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-11da8db5-cdb4-4267-ba6e-7a1da21b64a9 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:50:40.549594 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-11da8db5-cdb4-4267-ba6e-7a1da21b64a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:40.614246 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:40.617297 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1147/2340] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:50:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:50:40.625830 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0878d36-07fa-4daa-9225-71d56ff6fe9e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:40.631549 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0878d36-07fa-4daa-9225-71d56ff6fe9e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:40.631549 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0878d36-07fa-4daa-9225-71d56ff6fe9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:40.649029 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c0878d36-07fa-4daa-9225-71d56ff6fe9e None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:50:40.650215 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c0878d36-07fa-4daa-9225-71d56ff6fe9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:40.662080 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1194/2341] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:50:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:50:40.663684 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da8db5-cdb4-4267-ba6e-7a1da21b64a9 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:40.674428 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da8db5-cdb4-4267-ba6e-7a1da21b64a9 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:40.679503 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de55e06-f4c9-43d8-bb66-2e51eb042238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:40.680133 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de55e06-f4c9-43d8-bb66-2e51eb042238 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:40.680428 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de55e06-f4c9-43d8-bb66-2e51eb042238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:40.680701 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de55e06-f4c9-43d8-bb66-2e51eb042238 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:40.681386 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de55e06-f4c9-43d8-bb66-2e51eb042238 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:50:40.681732 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de55e06-f4c9-43d8-bb66-2e51eb042238 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:40.683369 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de55e06-f4c9-43d8-bb66-2e51eb042238 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:40.715680 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:40.723852 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1148/2342] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:50:40.729300 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0878d36-07fa-4daa-9225-71d56ff6fe9e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:40.739622 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0878d36-07fa-4daa-9225-71d56ff6fe9e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:40.744991 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021d8d8-6893-43d1-8cad-a2573f4d745a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:40.745626 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021d8d8-6893-43d1-8cad-a2573f4d745a admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:40.746414 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021d8d8-6893-43d1-8cad-a2573f4d745a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:40.746414 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021d8d8-6893-43d1-8cad-a2573f4d745a admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:40.747109 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021d8d8-6893-43d1-8cad-a2573f4d745a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:40.749461 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021d8d8-6893-43d1-8cad-a2573f4d745a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:40.927276 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1195/2343] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:50:40 2022] POST /identity/v3/projects => generated 371 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:50:40.931402 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de55e06-f4c9-43d8-bb66-2e51eb042238 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:40.947677 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de55e06-f4c9-43d8-bb66-2e51eb042238 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:41.040350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62060d-e5f2-448a-a216-38e8b2037d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:41.040977 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62060d-e5f2-448a-a216-38e8b2037d0e admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:41.041261 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62060d-e5f2-448a-a216-38e8b2037d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:41.041537 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62060d-e5f2-448a-a216-38e8b2037d0e admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:41.042368 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c62060d-e5f2-448a-a216-38e8b2037d0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:41.044456 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c62060d-e5f2-448a-a216-38e8b2037d0e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:41.137839 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:41.147356 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1149/2344] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:50:40 2022] POST /identity/v3/users => generated 286 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:50:41.148068 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021d8d8-6893-43d1-8cad-a2573f4d745a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:41.159780 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021d8d8-6893-43d1-8cad-a2573f4d745a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:41.165989 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a11c82-73d1-436c-832e-d5f101cacbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:41.167025 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a11c82-73d1-436c-832e-d5f101cacbcd admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:41.167473 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a11c82-73d1-436c-832e-d5f101cacbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:41.167749 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a11c82-73d1-436c-832e-d5f101cacbcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:41.168406 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a11c82-73d1-436c-832e-d5f101cacbcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:41.170263 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a11c82-73d1-436c-832e-d5f101cacbcd admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:41.182052 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1196/2345] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:50:41.185873 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62060d-e5f2-448a-a216-38e8b2037d0e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:41.199491 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62060d-e5f2-448a-a216-38e8b2037d0e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:41.205473 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a738da7-fd0d-42c6-ad4b-cc462a7ad29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:41.206143 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a738da7-fd0d-42c6-ad4b-cc462a7ad29e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:41.206428 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a738da7-fd0d-42c6-ad4b-cc462a7ad29e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:41.211092 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a738da7-fd0d-42c6-ad4b-cc462a7ad29e admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:41.211092 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a738da7-fd0d-42c6-ad4b-cc462a7ad29e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:41.211092 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a738da7-fd0d-42c6-ad4b-cc462a7ad29e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:41.225273 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1150/2346] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:50:41.226783 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a11c82-73d1-436c-832e-d5f101cacbcd admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:41.237621 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a11c82-73d1-436c-832e-d5f101cacbcd admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:41.243321 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894caa69-765e-49fb-b479-ebe552d33d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:41.244313 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894caa69-765e-49fb-b479-ebe552d33d63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:41.244748 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894caa69-765e-49fb-b479-ebe552d33d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:41.245190 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894caa69-765e-49fb-b479-ebe552d33d63 admin admin] PATH_INFO: `/v3/projects/53e9fb6421c24648a6e7b9b37b0a8388/users/3cfb86f5216942a58671d24ae50cd6f8/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:41.262467 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894caa69-765e-49fb-b479-ebe552d33d63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53e9fb6421c24648a6e7b9b37b0a8388, user_id=3cfb86f5216942a58671d24ae50cd6f8, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:41.265405 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894caa69-765e-49fb-b479-ebe552d33d63 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:41.359810 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1197/2347] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:50:41 2022] PUT /identity/v3/projects/53e9fb6421c24648a6e7b9b37b0a8388/users/3cfb86f5216942a58671d24ae50cd6f8/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:50:41.361664 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176e943-7f71-43d6-8d98-653e6aa2e17b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:41.362136 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176e943-7f71-43d6-8d98-653e6aa2e17b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:41.362419 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176e943-7f71-43d6-8d98-653e6aa2e17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:41.410819 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9176e943-7f71-43d6-8d98-653e6aa2e17b None None] MFA Rules not processed for user `3cfb86f5216942a58671d24ae50cd6f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:50:41.413484 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9176e943-7f71-43d6-8d98-653e6aa2e17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:41.503531 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1151/2348] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:50:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:50:41.515651 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894caa69-765e-49fb-b479-ebe552d33d63 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:41.520028 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-894caa69-765e-49fb-b479-ebe552d33d63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:41.595897 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894caa69-765e-49fb-b479-ebe552d33d63 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:41.600675 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc4c90-8d33-4a25-8761-2e0c96620707 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:41.601339 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc4c90-8d33-4a25-8761-2e0c96620707 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:41.601619 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc4c90-8d33-4a25-8761-2e0c96620707 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:41.601927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc4c90-8d33-4a25-8761-2e0c96620707 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:41.611917 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc4c90-8d33-4a25-8761-2e0c96620707 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:41.613402 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc4c90-8d33-4a25-8761-2e0c96620707 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:41.624005 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1198/2349] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:50:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:50:41.654930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176e943-7f71-43d6-8d98-653e6aa2e17b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:41.747634 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176e943-7f71-43d6-8d98-653e6aa2e17b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:41.753086 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38360dc2-b1c6-48c8-902b-090b07706d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:41.753951 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38360dc2-b1c6-48c8-902b-090b07706d91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:41.754336 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38360dc2-b1c6-48c8-902b-090b07706d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:41.754800 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38360dc2-b1c6-48c8-902b-090b07706d91 admin admin] PATH_INFO: `/v3/users/3cfb86f5216942a58671d24ae50cd6f8` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:41.756652 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38360dc2-b1c6-48c8-902b-090b07706d91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cfb86f5216942a58671d24ae50cd6f8)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:41.758848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38360dc2-b1c6-48c8-902b-090b07706d91 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:41.772906 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:42.074822 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-38360dc2-b1c6-48c8-902b-090b07706d91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cfb86f5216942a58671d24ae50cd6f8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:42.077028 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-38360dc2-b1c6-48c8-902b-090b07706d91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cfb86f5216942a58671d24ae50cd6f8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:42.087865 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-38360dc2-b1c6-48c8-902b-090b07706d91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cfb86f5216942a58671d24ae50cd6f8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:42.104687 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-38360dc2-b1c6-48c8-902b-090b07706d91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cfb86f5216942a58671d24ae50cd6f8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:42.107451 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-38360dc2-b1c6-48c8-902b-090b07706d91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cfb86f5216942a58671d24ae50cd6f8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:42.238944 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1152/2350] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:50:41 2022] DELETE /identity/v3/users/3cfb86f5216942a58671d24ae50cd6f8 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:50:42.247630 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff423afb-f5a1-42ac-a060-1df00edef8b4 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:42.248038 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff423afb-f5a1-42ac-a060-1df00edef8b4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:42.248413 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff423afb-f5a1-42ac-a060-1df00edef8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:42.270589 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ff423afb-f5a1-42ac-a060-1df00edef8b4 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:50:42.272132 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ff423afb-f5a1-42ac-a060-1df00edef8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:42.337003 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1199/2351] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:50:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:50:42.347327 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38360dc2-b1c6-48c8-902b-090b07706d91 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:42.348902 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-38360dc2-b1c6-48c8-902b-090b07706d91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:42.431218 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38360dc2-b1c6-48c8-902b-090b07706d91 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:42.440141 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867e108-e761-454e-ae04-e6e98a9a5306 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:42.440801 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867e108-e761-454e-ae04-e6e98a9a5306 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:42.441086 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867e108-e761-454e-ae04-e6e98a9a5306 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:42.441364 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867e108-e761-454e-ae04-e6e98a9a5306 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:42.451745 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3867e108-e761-454e-ae04-e6e98a9a5306 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:42.453305 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3867e108-e761-454e-ae04-e6e98a9a5306 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:42.462921 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1153/2352] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:50:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 03:50:42.555233 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:43.061235 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff423afb-f5a1-42ac-a060-1df00edef8b4 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:43.063596 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ff423afb-f5a1-42ac-a060-1df00edef8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:43.081292 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff423afb-f5a1-42ac-a060-1df00edef8b4 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:43.099320 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fbcc8b-3ec5-48fd-a24c-834fea38a485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:43.101084 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fbcc8b-3ec5-48fd-a24c-834fea38a485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:43.102288 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fbcc8b-3ec5-48fd-a24c-834fea38a485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:43.102722 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fbcc8b-3ec5-48fd-a24c-834fea38a485 admin admin] PATH_INFO: `/v3/projects/53e9fb6421c24648a6e7b9b37b0a8388` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:43.104780 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fbcc8b-3ec5-48fd-a24c-834fea38a485 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53e9fb6421c24648a6e7b9b37b0a8388)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:43.107522 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fbcc8b-3ec5-48fd-a24c-834fea38a485 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:43.252880 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a4fbcc8b-3ec5-48fd-a24c-834fea38a485 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53e9fb6421c24648a6e7b9b37b0a8388', 'request_id': 'req-a4fbcc8b-3ec5-48fd-a24c-834fea38a485'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:43.352241 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a4fbcc8b-3ec5-48fd-a24c-834fea38a485 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53e9fb6421c24648a6e7b9b37b0a8388', 'request_id': 'req-a4fbcc8b-3ec5-48fd-a24c-834fea38a485'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:43.359567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a4fbcc8b-3ec5-48fd-a24c-834fea38a485 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53e9fb6421c24648a6e7b9b37b0a8388', 'request_id': 'req-a4fbcc8b-3ec5-48fd-a24c-834fea38a485'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:43.370136 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a4fbcc8b-3ec5-48fd-a24c-834fea38a485 admin admin] The token cache is being invalidate because project 53e9fb6421c24648a6e7b9b37b0a8388 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:50:43.370427 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a4fbcc8b-3ec5-48fd-a24c-834fea38a485 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:43.371106 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a4fbcc8b-3ec5-48fd-a24c-834fea38a485 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:43.372659 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1200/2353] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:50:43 2022] DELETE /identity/v3/projects/53e9fb6421c24648a6e7b9b37b0a8388 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:50:43.377616 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176452e-6c9b-4232-8567-bc8d2365348e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:43.380274 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176452e-6c9b-4232-8567-bc8d2365348e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:43.380274 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176452e-6c9b-4232-8567-bc8d2365348e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:43.398597 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8176452e-6c9b-4232-8567-bc8d2365348e None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:50:43.399921 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8176452e-6c9b-4232-8567-bc8d2365348e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:43.459850 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1154/2354] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:50:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:50:43.467678 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51fe05-54b9-4cdc-b25f-2947ac51cc7a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:43.467965 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51fe05-54b9-4cdc-b25f-2947ac51cc7a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:43.468242 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51fe05-54b9-4cdc-b25f-2947ac51cc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:43.488351 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4a51fe05-54b9-4cdc-b25f-2947ac51cc7a None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:50:43.490977 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4a51fe05-54b9-4cdc-b25f-2947ac51cc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:43.500248 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1201/2355] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:50:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:50:43.504277 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176452e-6c9b-4232-8567-bc8d2365348e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:43.515653 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176452e-6c9b-4232-8567-bc8d2365348e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:43.520356 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9885d-32c6-4e2a-89d9-6a9abd70d09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:43.520969 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9885d-32c6-4e2a-89d9-6a9abd70d09c admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:43.521270 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9885d-32c6-4e2a-89d9-6a9abd70d09c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:43.521570 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9885d-32c6-4e2a-89d9-6a9abd70d09c admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:43.522803 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9885d-32c6-4e2a-89d9-6a9abd70d09c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:50:43.523106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9885d-32c6-4e2a-89d9-6a9abd70d09c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:43.524746 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9885d-32c6-4e2a-89d9-6a9abd70d09c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:43.536634 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1155/2356] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:50:43.541136 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51fe05-54b9-4cdc-b25f-2947ac51cc7a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:43.550337 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51fe05-54b9-4cdc-b25f-2947ac51cc7a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:43.555435 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d33ae-6853-4601-9a75-f1d76a1b7aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:43.556095 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d33ae-6853-4601-9a75-f1d76a1b7aca admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:43.556376 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d33ae-6853-4601-9a75-f1d76a1b7aca admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:43.556647 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d33ae-6853-4601-9a75-f1d76a1b7aca admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:43.557278 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d33ae-6853-4601-9a75-f1d76a1b7aca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:43.559224 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d33ae-6853-4601-9a75-f1d76a1b7aca admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:43.699799 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1202/2357] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:50:43 2022] POST /identity/v3/projects => generated 391 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:50:43.704688 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9885d-32c6-4e2a-89d9-6a9abd70d09c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:43.718201 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9885d-32c6-4e2a-89d9-6a9abd70d09c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:43.776862 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb8d472-f942-4103-a63a-f1a634cf877f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:43.777471 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8d472-f942-4103-a63a-f1a634cf877f admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:43.777784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8d472-f942-4103-a63a-f1a634cf877f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:43.778058 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8d472-f942-4103-a63a-f1a634cf877f admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:43.778723 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb8d472-f942-4103-a63a-f1a634cf877f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:43.780624 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb8d472-f942-4103-a63a-f1a634cf877f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:43.886503 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1156/2358] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:50:43 2022] POST /identity/v3/users => generated 296 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:50:43.890566 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d33ae-6853-4601-9a75-f1d76a1b7aca admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:43.900736 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d33ae-6853-4601-9a75-f1d76a1b7aca admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:43.905347 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bdacd-02b6-4df5-ab99-f9c805e515ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:43.906000 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bdacd-02b6-4df5-ab99-f9c805e515ab admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:43.906286 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bdacd-02b6-4df5-ab99-f9c805e515ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:43.906580 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bdacd-02b6-4df5-ab99-f9c805e515ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:43.907549 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433bdacd-02b6-4df5-ab99-f9c805e515ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:43.909673 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433bdacd-02b6-4df5-ab99-f9c805e515ab admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:43.918983 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1203/2359] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:50:43.922797 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb8d472-f942-4103-a63a-f1a634cf877f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:43.933789 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb8d472-f942-4103-a63a-f1a634cf877f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:43.938495 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96a02b-89c8-445d-858c-0037c49a467f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:43.939084 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96a02b-89c8-445d-858c-0037c49a467f admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:43.939363 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96a02b-89c8-445d-858c-0037c49a467f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:43.939635 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96a02b-89c8-445d-858c-0037c49a467f admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:43.940274 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db96a02b-89c8-445d-858c-0037c49a467f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:43.941916 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db96a02b-89c8-445d-858c-0037c49a467f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:43.953097 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1157/2360] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:50:43.957162 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bdacd-02b6-4df5-ab99-f9c805e515ab admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:43.967783 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bdacd-02b6-4df5-ab99-f9c805e515ab admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:43.972758 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092118b5-765c-42a0-bba5-ce6fc8fd2ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:43.973428 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092118b5-765c-42a0-bba5-ce6fc8fd2ed2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:43.973779 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092118b5-765c-42a0-bba5-ce6fc8fd2ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:43.974060 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092118b5-765c-42a0-bba5-ce6fc8fd2ed2 admin admin] PATH_INFO: `/v3/projects/e090846050ba46f3b1804a2355996e16/users/03d4573cb9184793b8c1d15f2f791011/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:43.989898 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092118b5-765c-42a0-bba5-ce6fc8fd2ed2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e090846050ba46f3b1804a2355996e16, user_id=03d4573cb9184793b8c1d15f2f791011, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:43.993140 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092118b5-765c-42a0-bba5-ce6fc8fd2ed2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:44.125617 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1204/2361] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:50:43 2022] PUT /identity/v3/projects/e090846050ba46f3b1804a2355996e16/users/03d4573cb9184793b8c1d15f2f791011/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:50:44.154560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:44.194194 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f573a-ee80-4286-9ec9-58bf7111e382 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:44.194475 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f573a-ee80-4286-9ec9-58bf7111e382 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:44.194750 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f573a-ee80-4286-9ec9-58bf7111e382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:44.222294 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-673f573a-ee80-4286-9ec9-58bf7111e382 None None] MFA Rules not processed for user `03d4573cb9184793b8c1d15f2f791011`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:50:44.223501 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-673f573a-ee80-4286-9ec9-58bf7111e382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:44.257419 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:44.289429 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1158/2362] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:50:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:50:44.300291 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092118b5-765c-42a0-bba5-ce6fc8fd2ed2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:44.302253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-092118b5-765c-42a0-bba5-ce6fc8fd2ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:44.358723 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092118b5-765c-42a0-bba5-ce6fc8fd2ed2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:44.362538 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3fc379-5c8f-41ed-907b-062fb1665b79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:44.363171 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fc379-5c8f-41ed-907b-062fb1665b79 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:44.363424 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fc379-5c8f-41ed-907b-062fb1665b79 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:44.363698 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fc379-5c8f-41ed-907b-062fb1665b79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:44.372391 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3fc379-5c8f-41ed-907b-062fb1665b79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:44.374751 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3fc379-5c8f-41ed-907b-062fb1665b79 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:44.382607 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1205/2363] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:50:44 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:50:44.685541 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e522a3-e333-4fa6-9f28-9f2e8838dacf None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:44.686052 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e522a3-e333-4fa6-9f28-9f2e8838dacf None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:44.686150 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e522a3-e333-4fa6-9f28-9f2e8838dacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:44.705282 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-47e522a3-e333-4fa6-9f28-9f2e8838dacf None None] MFA Rules not processed for user `b0812002d7b14bcb81a42eb380231feb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:50:44.706522 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-47e522a3-e333-4fa6-9f28-9f2e8838dacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:44.766711 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1159/2364] 10.222.0.33 () {58 vars in 967 bytes} [Fri Sep 16 03:50:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:50:44.782889 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3fc379-5c8f-41ed-907b-062fb1665b79 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:44.784313 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fc3fc379-5c8f-41ed-907b-062fb1665b79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:44.852734 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3fc379-5c8f-41ed-907b-062fb1665b79 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:44.857952 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81abe28-ae66-414b-bdf0-d1087efb130a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f784d98d5f440c681f53ae70f6d1cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:44.858564 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81abe28-ae66-414b-bdf0-d1087efb130a service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:44.858846 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81abe28-ae66-414b-bdf0-d1087efb130a service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:44.859119 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81abe28-ae66-414b-bdf0-d1087efb130a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:44.867634 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81abe28-ae66-414b-bdf0-d1087efb130a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:44.869242 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81abe28-ae66-414b-bdf0-d1087efb130a service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:44.877128 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1206/2365] 10.222.0.33 () {60 vars in 1384 bytes} [Fri Sep 16 03:50:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 03:50:45.780674 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:45.960319 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:47.631927 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:47.755348 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:48.399046 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2375d40-7872-483d-8658-c76030c255aa None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:48.399364 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2375d40-7872-483d-8658-c76030c255aa None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:48.399642 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2375d40-7872-483d-8658-c76030c255aa None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:48.401027 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1160/2366] 10.222.0.33 () {54 vars in 921 bytes} [Fri Sep 16 03:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:50:48.410577 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87cbe7-60e0-403e-b27a-58f010befca5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:48.410859 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87cbe7-60e0-403e-b27a-58f010befca5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:48.411131 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87cbe7-60e0-403e-b27a-58f010befca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:48.431066 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4c87cbe7-60e0-403e-b27a-58f010befca5 None None] MFA Rules not processed for user `c39fd09bea1a40babc5f629612c6702b`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:50:48.432266 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4c87cbe7-60e0-403e-b27a-58f010befca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:48.493980 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1207/2367] 10.222.0.33 () {58 vars in 1018 bytes} [Fri Sep 16 03:50:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:50:48.504913 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2375d40-7872-483d-8658-c76030c255aa None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:48.509844 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d2375d40-7872-483d-8658-c76030c255aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:48.529835 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2375d40-7872-483d-8658-c76030c255aa None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:48.539769 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694f1c9-f498-424e-9078-21d043bfca6e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c39fd09bea1a40babc5f629612c6702b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:48.540655 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694f1c9-f498-424e-9078-21d043bfca6e service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:48.541168 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694f1c9-f498-424e-9078-21d043bfca6e service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:48.541554 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694f1c9-f498-424e-9078-21d043bfca6e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:48.551605 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c87cbe7-60e0-403e-b27a-58f010befca5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:48.551930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5694f1c9-f498-424e-9078-21d043bfca6e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:48.553895 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4c87cbe7-60e0-403e-b27a-58f010befca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:48.554600 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5694f1c9-f498-424e-9078-21d043bfca6e service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:48.567437 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1161/2368] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:50:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:50:48.619148 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c87cbe7-60e0-403e-b27a-58f010befca5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:48.623901 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4cca6-68ea-4972-b1a8-5e8dbcf016f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:48.624527 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4cca6-68ea-4972-b1a8-5e8dbcf016f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:48.624805 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4cca6-68ea-4972-b1a8-5e8dbcf016f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:48.625077 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4cca6-68ea-4972-b1a8-5e8dbcf016f2 admin admin] PATH_INFO: `/v3/users/b612217c1da94e9db3bab736c2c85c59` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:48.626225 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4cca6-68ea-4972-b1a8-5e8dbcf016f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b612217c1da94e9db3bab736c2c85c59)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:48.628183 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4cca6-68ea-4972-b1a8-5e8dbcf016f2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:48.750801 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:48.883069 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-eaa4cca6-68ea-4972-b1a8-5e8dbcf016f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b612217c1da94e9db3bab736c2c85c59'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:48.883739 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-eaa4cca6-68ea-4972-b1a8-5e8dbcf016f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b612217c1da94e9db3bab736c2c85c59'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:48.890536 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-eaa4cca6-68ea-4972-b1a8-5e8dbcf016f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b612217c1da94e9db3bab736c2c85c59'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:48.902850 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-eaa4cca6-68ea-4972-b1a8-5e8dbcf016f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b612217c1da94e9db3bab736c2c85c59'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:48.903487 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-eaa4cca6-68ea-4972-b1a8-5e8dbcf016f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b612217c1da94e9db3bab736c2c85c59'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:49.016762 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1208/2369] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:50:48 2022] DELETE /identity/v3/users/b612217c1da94e9db3bab736c2c85c59 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:50:49.255866 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694f1c9-f498-424e-9078-21d043bfca6e service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:49.276761 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694f1c9-f498-424e-9078-21d043bfca6e service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:49.327443 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:49.348370 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2e494-973c-4e3b-be82-11c0abcf467f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:49.349106 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2e494-973c-4e3b-be82-11c0abcf467f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:49.349399 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2e494-973c-4e3b-be82-11c0abcf467f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:49.350198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2e494-973c-4e3b-be82-11c0abcf467f admin admin] PATH_INFO: `/v3/projects/856b0f6294ed49dea7d7f192bb38a86e` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:49.352054 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2e494-973c-4e3b-be82-11c0abcf467f admin admin] RBAC: Authorizing `identity:delete_project(project_id=856b0f6294ed49dea7d7f192bb38a86e)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:49.354204 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2e494-973c-4e3b-be82-11c0abcf467f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:49.493132 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-88f2e494-973c-4e3b-be82-11c0abcf467f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '856b0f6294ed49dea7d7f192bb38a86e', 'request_id': 'req-88f2e494-973c-4e3b-be82-11c0abcf467f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:49.559748 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-88f2e494-973c-4e3b-be82-11c0abcf467f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '856b0f6294ed49dea7d7f192bb38a86e', 'request_id': 'req-88f2e494-973c-4e3b-be82-11c0abcf467f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:49.566615 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-88f2e494-973c-4e3b-be82-11c0abcf467f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '856b0f6294ed49dea7d7f192bb38a86e', 'request_id': 'req-88f2e494-973c-4e3b-be82-11c0abcf467f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:49.577349 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-88f2e494-973c-4e3b-be82-11c0abcf467f admin admin] The token cache is being invalidate because project 856b0f6294ed49dea7d7f192bb38a86e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:50:49.577662 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-88f2e494-973c-4e3b-be82-11c0abcf467f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:49.578275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-88f2e494-973c-4e3b-be82-11c0abcf467f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:49.579732 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1162/2370] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:50:49 2022] DELETE /identity/v3/projects/856b0f6294ed49dea7d7f192bb38a86e => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:50:49.584650 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314cd4cf-9cbc-49ad-9d4d-0c6a0f4e0d20 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:49.584941 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314cd4cf-9cbc-49ad-9d4d-0c6a0f4e0d20 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:49.585216 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314cd4cf-9cbc-49ad-9d4d-0c6a0f4e0d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:49.604848 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-314cd4cf-9cbc-49ad-9d4d-0c6a0f4e0d20 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:50:49.606075 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-314cd4cf-9cbc-49ad-9d4d-0c6a0f4e0d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:49.663740 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1209/2371] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:50:49.672564 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f0e07-be7f-40dd-a22a-2d4a4161571e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:49.672894 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f0e07-be7f-40dd-a22a-2d4a4161571e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:49.673203 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f0e07-be7f-40dd-a22a-2d4a4161571e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:49.693558 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-312f0e07-be7f-40dd-a22a-2d4a4161571e None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:50:49.694793 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-312f0e07-be7f-40dd-a22a-2d4a4161571e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:49.702765 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1163/2372] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:50:49.707102 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314cd4cf-9cbc-49ad-9d4d-0c6a0f4e0d20 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:49.725143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314cd4cf-9cbc-49ad-9d4d-0c6a0f4e0d20 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:49.732389 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0fd05-e5e5-49c6-a3ca-b74c5984c084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:49.733026 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0fd05-e5e5-49c6-a3ca-b74c5984c084 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:49.733280 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0fd05-e5e5-49c6-a3ca-b74c5984c084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:49.733555 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0fd05-e5e5-49c6-a3ca-b74c5984c084 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:49.734394 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0fd05-e5e5-49c6-a3ca-b74c5984c084 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:50:49.734845 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0fd05-e5e5-49c6-a3ca-b74c5984c084 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:49.736642 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0fd05-e5e5-49c6-a3ca-b74c5984c084 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:49.751297 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1210/2373] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:50:49.755534 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f0e07-be7f-40dd-a22a-2d4a4161571e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:49.765362 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f0e07-be7f-40dd-a22a-2d4a4161571e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:49.770151 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a34a0-f038-4c9c-b347-1c7a8e3c7150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:49.770816 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a34a0-f038-4c9c-b347-1c7a8e3c7150 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:49.771026 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a34a0-f038-4c9c-b347-1c7a8e3c7150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:49.771299 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a34a0-f038-4c9c-b347-1c7a8e3c7150 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:49.771968 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a34a0-f038-4c9c-b347-1c7a8e3c7150 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:49.773864 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a34a0-f038-4c9c-b347-1c7a8e3c7150 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:49.892916 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1164/2374] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:50:49 2022] POST /identity/v3/projects => generated 371 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:50:49.897238 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0fd05-e5e5-49c6-a3ca-b74c5984c084 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:49.907218 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0fd05-e5e5-49c6-a3ca-b74c5984c084 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:49.962403 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce69138-9adb-40f7-b2a9-a091f1f870a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:49.963007 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce69138-9adb-40f7-b2a9-a091f1f870a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:49.963286 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce69138-9adb-40f7-b2a9-a091f1f870a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:49.963556 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce69138-9adb-40f7-b2a9-a091f1f870a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:49.964217 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce69138-9adb-40f7-b2a9-a091f1f870a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:49.966180 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce69138-9adb-40f7-b2a9-a091f1f870a3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:50.080973 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1211/2375] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:50:49 2022] POST /identity/v3/users => generated 286 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:50:50.083810 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a34a0-f038-4c9c-b347-1c7a8e3c7150 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:50.095765 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a34a0-f038-4c9c-b347-1c7a8e3c7150 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:50.101076 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9bc0c-2cf4-43ad-a599-46ea7f92a4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:50.107245 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9bc0c-2cf4-43ad-a599-46ea7f92a4a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:50.107245 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9bc0c-2cf4-43ad-a599-46ea7f92a4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:50.107245 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9bc0c-2cf4-43ad-a599-46ea7f92a4a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:50.107245 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c9bc0c-2cf4-43ad-a599-46ea7f92a4a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:50.107245 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c9bc0c-2cf4-43ad-a599-46ea7f92a4a4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:50.114534 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1165/2376] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:50:50.119376 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce69138-9adb-40f7-b2a9-a091f1f870a3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:50.137914 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce69138-9adb-40f7-b2a9-a091f1f870a3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:50.143056 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a1b3f-4e0b-4f78-a5c4-bc98fb0b5599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:50.143662 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a1b3f-4e0b-4f78-a5c4-bc98fb0b5599 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:50.143941 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a1b3f-4e0b-4f78-a5c4-bc98fb0b5599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:50.144215 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a1b3f-4e0b-4f78-a5c4-bc98fb0b5599 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:50.144883 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a1b3f-4e0b-4f78-a5c4-bc98fb0b5599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:50.146691 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a1b3f-4e0b-4f78-a5c4-bc98fb0b5599 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:50.157345 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1212/2377] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:50:50.161567 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9bc0c-2cf4-43ad-a599-46ea7f92a4a4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:50.172294 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9bc0c-2cf4-43ad-a599-46ea7f92a4a4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:50.177029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa9196-286e-4189-aa9d-d79bd1854747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:50.177711 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa9196-286e-4189-aa9d-d79bd1854747 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:50.178602 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa9196-286e-4189-aa9d-d79bd1854747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:50.179174 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa9196-286e-4189-aa9d-d79bd1854747 admin admin] PATH_INFO: `/v3/projects/48d64c5285474e6cbea66644bce84971/users/d1d120a3857a4cd88b9dc397ce6d698a/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:50.193821 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa9196-286e-4189-aa9d-d79bd1854747 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48d64c5285474e6cbea66644bce84971, user_id=d1d120a3857a4cd88b9dc397ce6d698a, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:50.199018 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa9196-286e-4189-aa9d-d79bd1854747 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:50.278141 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1166/2378] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:50:50 2022] PUT /identity/v3/projects/48d64c5285474e6cbea66644bce84971/users/d1d120a3857a4cd88b9dc397ce6d698a/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:50:50.289007 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ffd61-3dc7-4d4a-ae3a-d377d12c5ff7 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:50.289289 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ffd61-3dc7-4d4a-ae3a-d377d12c5ff7 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:50.289561 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ffd61-3dc7-4d4a-ae3a-d377d12c5ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:50.319010 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-846ffd61-3dc7-4d4a-ae3a-d377d12c5ff7 None None] MFA Rules not processed for user `d1d120a3857a4cd88b9dc397ce6d698a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:50:50.320224 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-846ffd61-3dc7-4d4a-ae3a-d377d12c5ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:50.360735 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:50.386920 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1213/2379] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:50:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:50:50.399759 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa9196-286e-4189-aa9d-d79bd1854747 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:50.401500 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dcaa9196-286e-4189-aa9d-d79bd1854747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:50.459838 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa9196-286e-4189-aa9d-d79bd1854747 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:50.464142 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbc3c4-1adc-408d-8748-4e7d220f7c36 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aafb065e06c3481bbed8d98e893766ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:50.464756 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbc3c4-1adc-408d-8748-4e7d220f7c36 service glance] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:50.465038 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbc3c4-1adc-408d-8748-4e7d220f7c36 service glance] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:50.465310 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbc3c4-1adc-408d-8748-4e7d220f7c36 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:50.473816 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bbc3c4-1adc-408d-8748-4e7d220f7c36 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:50.475235 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bbc3c4-1adc-408d-8748-4e7d220f7c36 service glance] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:50.484742 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1167/2380] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:50:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:50:50.983071 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:51.158539 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ffd61-3dc7-4d4a-ae3a-d377d12c5ff7 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:51.159944 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-846ffd61-3dc7-4d4a-ae3a-d377d12c5ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:51.235599 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ffd61-3dc7-4d4a-ae3a-d377d12c5ff7 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:51.247562 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5b1a5-a46d-4a5a-997b-444652cf486f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:51.248299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5b1a5-a46d-4a5a-997b-444652cf486f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:51.248646 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5b1a5-a46d-4a5a-997b-444652cf486f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:51.248986 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5b1a5-a46d-4a5a-997b-444652cf486f admin admin] PATH_INFO: `/v3/users/bb502a5537ac43829d9c230ffe62f1c8` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:51.250304 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5b1a5-a46d-4a5a-997b-444652cf486f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb502a5537ac43829d9c230ffe62f1c8)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:51.252382 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5b1a5-a46d-4a5a-997b-444652cf486f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:51.345124 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:51.436495 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-42a5b1a5-a46d-4a5a-997b-444652cf486f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb502a5537ac43829d9c230ffe62f1c8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:51.437247 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-42a5b1a5-a46d-4a5a-997b-444652cf486f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb502a5537ac43829d9c230ffe62f1c8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:51.444083 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-42a5b1a5-a46d-4a5a-997b-444652cf486f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb502a5537ac43829d9c230ffe62f1c8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:51.455822 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-42a5b1a5-a46d-4a5a-997b-444652cf486f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb502a5537ac43829d9c230ffe62f1c8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:51.456561 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-42a5b1a5-a46d-4a5a-997b-444652cf486f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb502a5537ac43829d9c230ffe62f1c8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:51.545894 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1214/2381] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:50:51 2022] DELETE /identity/v3/users/bb502a5537ac43829d9c230ffe62f1c8 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:50:51.550516 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e30bd-253b-4932-88b7-cd4ac431b8d3 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:51.550961 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e30bd-253b-4932-88b7-cd4ac431b8d3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:51.551078 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e30bd-253b-4932-88b7-cd4ac431b8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:51.571126 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f97e30bd-253b-4932-88b7-cd4ac431b8d3 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:50:51.572313 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f97e30bd-253b-4932-88b7-cd4ac431b8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:51.631508 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1168/2382] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:50:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:50:51.641607 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5b1a5-a46d-4a5a-997b-444652cf486f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:51.644067 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-42a5b1a5-a46d-4a5a-997b-444652cf486f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:51.750105 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5b1a5-a46d-4a5a-997b-444652cf486f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:51.755533 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc7a0b-d138-442b-ba61-f0f2cfa5be53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:51.756651 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc7a0b-d138-442b-ba61-f0f2cfa5be53 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:51.757821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc7a0b-d138-442b-ba61-f0f2cfa5be53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:51.758191 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc7a0b-d138-442b-ba61-f0f2cfa5be53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:51.770674 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc7a0b-d138-442b-ba61-f0f2cfa5be53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:51.772261 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc7a0b-d138-442b-ba61-f0f2cfa5be53 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:51.784587 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1215/2383] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:50:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:50:51.786599 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:51.812052 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:52.213254 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e30bd-253b-4932-88b7-cd4ac431b8d3 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:52.214721 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f97e30bd-253b-4932-88b7-cd4ac431b8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:52.229119 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e30bd-253b-4932-88b7-cd4ac431b8d3 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:52.233925 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673af95-eb8b-4044-ad2a-38ced781795c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:52.235613 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673af95-eb8b-4044-ad2a-38ced781795c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:52.235897 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673af95-eb8b-4044-ad2a-38ced781795c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:52.236270 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673af95-eb8b-4044-ad2a-38ced781795c admin admin] PATH_INFO: `/v3/projects/8c220c598b9b41af90088ea576b2edeb` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:52.237422 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673af95-eb8b-4044-ad2a-38ced781795c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c220c598b9b41af90088ea576b2edeb)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:52.239460 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673af95-eb8b-4044-ad2a-38ced781795c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:52.394622 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1673af95-eb8b-4044-ad2a-38ced781795c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c220c598b9b41af90088ea576b2edeb', 'request_id': 'req-1673af95-eb8b-4044-ad2a-38ced781795c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:52.497525 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1673af95-eb8b-4044-ad2a-38ced781795c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c220c598b9b41af90088ea576b2edeb', 'request_id': 'req-1673af95-eb8b-4044-ad2a-38ced781795c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:52.506237 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1673af95-eb8b-4044-ad2a-38ced781795c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c220c598b9b41af90088ea576b2edeb', 'request_id': 'req-1673af95-eb8b-4044-ad2a-38ced781795c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:52.517076 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1673af95-eb8b-4044-ad2a-38ced781795c admin admin] The token cache is being invalidate because project 8c220c598b9b41af90088ea576b2edeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:50:52.517364 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1673af95-eb8b-4044-ad2a-38ced781795c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:52.518056 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1673af95-eb8b-4044-ad2a-38ced781795c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:52.519537 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1169/2384] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:50:52 2022] DELETE /identity/v3/projects/8c220c598b9b41af90088ea576b2edeb => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:50:52.524661 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69778d9-4c18-404e-aa17-9351c9ce623b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:52.525118 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69778d9-4c18-404e-aa17-9351c9ce623b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:52.525254 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69778d9-4c18-404e-aa17-9351c9ce623b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:52.545887 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c69778d9-4c18-404e-aa17-9351c9ce623b None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:50:52.547139 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c69778d9-4c18-404e-aa17-9351c9ce623b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:52.605373 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1216/2385] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:50:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:50:52.614567 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ad04e-46cf-4929-853e-fc32602e6b73 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:52.615048 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ad04e-46cf-4929-853e-fc32602e6b73 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:52.615142 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ad04e-46cf-4929-853e-fc32602e6b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:52.635132 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f71ad04e-46cf-4929-853e-fc32602e6b73 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:50:52.636344 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f71ad04e-46cf-4929-853e-fc32602e6b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:52.644296 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1170/2386] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:50:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:50:52.648950 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69778d9-4c18-404e-aa17-9351c9ce623b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:52.656186 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:52.660022 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69778d9-4c18-404e-aa17-9351c9ce623b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:52.665600 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f82579-d88a-413b-91d0-9d6ff3356ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:52.666239 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f82579-d88a-413b-91d0-9d6ff3356ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:52.666532 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f82579-d88a-413b-91d0-9d6ff3356ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:52.666837 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f82579-d88a-413b-91d0-9d6ff3356ee4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:52.667565 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f82579-d88a-413b-91d0-9d6ff3356ee4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:50:52.667894 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f82579-d88a-413b-91d0-9d6ff3356ee4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:52.669603 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f82579-d88a-413b-91d0-9d6ff3356ee4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:52.683902 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1217/2387] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:50:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:50:52.688249 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ad04e-46cf-4929-853e-fc32602e6b73 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:52.698138 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ad04e-46cf-4929-853e-fc32602e6b73 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:52.703558 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d01d3-0b12-47b8-9e99-2839e39df224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:52.704512 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d01d3-0b12-47b8-9e99-2839e39df224 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:52.705406 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d01d3-0b12-47b8-9e99-2839e39df224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:52.705729 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d01d3-0b12-47b8-9e99-2839e39df224 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:52.706419 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d01d3-0b12-47b8-9e99-2839e39df224 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:52.708685 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d01d3-0b12-47b8-9e99-2839e39df224 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:52.809710 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1171/2388] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:50:52 2022] POST /identity/v3/projects => generated 365 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:50:52.813780 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f82579-d88a-413b-91d0-9d6ff3356ee4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:52.824742 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f82579-d88a-413b-91d0-9d6ff3356ee4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:52.888429 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3dacc-8ecd-4bba-8f4a-89f27ec20273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:52.889032 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3dacc-8ecd-4bba-8f4a-89f27ec20273 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:52.889309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3dacc-8ecd-4bba-8f4a-89f27ec20273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:52.889578 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3dacc-8ecd-4bba-8f4a-89f27ec20273 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:52.890241 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3dacc-8ecd-4bba-8f4a-89f27ec20273 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:52.892195 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3dacc-8ecd-4bba-8f4a-89f27ec20273 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:52.988781 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1218/2389] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:50:52 2022] POST /identity/v3/users => generated 283 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:50:52.992863 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d01d3-0b12-47b8-9e99-2839e39df224 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:53.003450 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d01d3-0b12-47b8-9e99-2839e39df224 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:53.005890 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:53.010555 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc7b6e-6078-40d3-8cc5-76177f931fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:53.011155 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc7b6e-6078-40d3-8cc5-76177f931fdc admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:53.011434 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc7b6e-6078-40d3-8cc5-76177f931fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:53.011705 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc7b6e-6078-40d3-8cc5-76177f931fdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:53.012340 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc7b6e-6078-40d3-8cc5-76177f931fdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:53.014012 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc7b6e-6078-40d3-8cc5-76177f931fdc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:53.024355 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1172/2390] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:50:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:50:53.028535 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3dacc-8ecd-4bba-8f4a-89f27ec20273 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:53.038759 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3dacc-8ecd-4bba-8f4a-89f27ec20273 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:53.043404 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18917499-8eb4-47d1-a709-3c74ff73801b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:53.044046 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18917499-8eb4-47d1-a709-3c74ff73801b admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:53.044329 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18917499-8eb4-47d1-a709-3c74ff73801b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:53.044605 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18917499-8eb4-47d1-a709-3c74ff73801b admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:53.045263 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18917499-8eb4-47d1-a709-3c74ff73801b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:53.046905 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18917499-8eb4-47d1-a709-3c74ff73801b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:53.058103 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1219/2391] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:50:53.059070 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:53.061541 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc7b6e-6078-40d3-8cc5-76177f931fdc admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:53.072234 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc7b6e-6078-40d3-8cc5-76177f931fdc admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:53.076874 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9df293-d0a2-49c4-ad23-22c528bab872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:53.077521 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9df293-d0a2-49c4-ad23-22c528bab872 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:53.077882 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9df293-d0a2-49c4-ad23-22c528bab872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:53.078232 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9df293-d0a2-49c4-ad23-22c528bab872 admin admin] PATH_INFO: `/v3/projects/5eb9a4c26f54419aaaca1aa56a3f603c/users/4255e2e00c434a728aa73c5de3623245/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:53.093157 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9df293-d0a2-49c4-ad23-22c528bab872 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eb9a4c26f54419aaaca1aa56a3f603c, user_id=4255e2e00c434a728aa73c5de3623245, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:53.095817 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9df293-d0a2-49c4-ad23-22c528bab872 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:53.218234 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1173/2392] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:50:53 2022] PUT /identity/v3/projects/5eb9a4c26f54419aaaca1aa56a3f603c/users/4255e2e00c434a728aa73c5de3623245/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:50:53.228779 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccefc1-78d0-43a5-8d7e-d9d17b772731 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:53.229065 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccefc1-78d0-43a5-8d7e-d9d17b772731 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:53.229339 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccefc1-78d0-43a5-8d7e-d9d17b772731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:53.255919 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-bfccefc1-78d0-43a5-8d7e-d9d17b772731 None None] MFA Rules not processed for user `4255e2e00c434a728aa73c5de3623245`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:50:53.257611 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bfccefc1-78d0-43a5-8d7e-d9d17b772731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:53.321136 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1220/2393] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:50:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:50:53.332554 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9df293-d0a2-49c4-ad23-22c528bab872 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:53.337373 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7d9df293-d0a2-49c4-ad23-22c528bab872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:53.399595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9df293-d0a2-49c4-ad23-22c528bab872 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:53.403609 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84321582-f908-4478-9942-f0bc5018efdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:53.404225 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84321582-f908-4478-9942-f0bc5018efdd service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:53.404680 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84321582-f908-4478-9942-f0bc5018efdd service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:53.405516 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84321582-f908-4478-9942-f0bc5018efdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:53.414307 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84321582-f908-4478-9942-f0bc5018efdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:53.415711 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84321582-f908-4478-9942-f0bc5018efdd service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:53.424413 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1174/2394] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:50:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:50:53.866676 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:54.268814 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:54.983017 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:55.108643 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:55.640510 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=80,keystone:INSERT=3,keystone:DELETE=17 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:56.292882 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:56.656077 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfccefc1-78d0-43a5-8d7e-d9d17b772731 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:56.658004 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bfccefc1-78d0-43a5-8d7e-d9d17b772731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:56.728840 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfccefc1-78d0-43a5-8d7e-d9d17b772731 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:56.777444 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4eb42-b100-4164-ad79-18562919becf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:56.777444 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4eb42-b100-4164-ad79-18562919becf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:56.777444 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4eb42-b100-4164-ad79-18562919becf admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:56.777444 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4eb42-b100-4164-ad79-18562919becf admin admin] PATH_INFO: `/v3/users/03d4573cb9184793b8c1d15f2f791011` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:56.779057 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4eb42-b100-4164-ad79-18562919becf admin admin] RBAC: Authorizing `identity:delete_user(user_id=03d4573cb9184793b8c1d15f2f791011)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:56.779057 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4eb42-b100-4164-ad79-18562919becf admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:57.062322 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1fb4eb42-b100-4164-ad79-18562919becf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03d4573cb9184793b8c1d15f2f791011'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:57.062976 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1fb4eb42-b100-4164-ad79-18562919becf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03d4573cb9184793b8c1d15f2f791011'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:57.069833 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1fb4eb42-b100-4164-ad79-18562919becf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03d4573cb9184793b8c1d15f2f791011'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:57.081937 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1fb4eb42-b100-4164-ad79-18562919becf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03d4573cb9184793b8c1d15f2f791011'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:57.082624 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1fb4eb42-b100-4164-ad79-18562919becf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03d4573cb9184793b8c1d15f2f791011'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:57.101016 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:57.184669 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1221/2395] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:50:56 2022] DELETE /identity/v3/users/03d4573cb9184793b8c1d15f2f791011 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:50:57.189716 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9eae7-6fd0-4849-89ba-3c93c296fa99 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:57.189999 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9eae7-6fd0-4849-89ba-3c93c296fa99 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:57.190272 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9eae7-6fd0-4849-89ba-3c93c296fa99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:57.210449 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-70f9eae7-6fd0-4849-89ba-3c93c296fa99 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:50:57.211652 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-70f9eae7-6fd0-4849-89ba-3c93c296fa99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:57.270121 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1175/2396] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:50:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:50:57.279765 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4eb42-b100-4164-ad79-18562919becf admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:57.281164 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1fb4eb42-b100-4164-ad79-18562919becf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:57.317784 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:57.339396 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4eb42-b100-4164-ad79-18562919becf admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:57.342976 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30bb4e3-5573-4a37-bebf-368e3459d940 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:57.343577 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bb4e3-5573-4a37-bebf-368e3459d940 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:57.343853 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bb4e3-5573-4a37-bebf-368e3459d940 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:57.344127 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bb4e3-5573-4a37-bebf-368e3459d940 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:57.353423 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30bb4e3-5573-4a37-bebf-368e3459d940 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:57.354912 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30bb4e3-5573-4a37-bebf-368e3459d940 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:57.364610 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1222/2397] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:50:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:50:57.945048 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9eae7-6fd0-4849-89ba-3c93c296fa99 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:50:57.946570 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-70f9eae7-6fd0-4849-89ba-3c93c296fa99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:50:57.963449 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9eae7-6fd0-4849-89ba-3c93c296fa99 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:50:57.977619 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2dac3a-1045-4e81-b9d8-2efc63615d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:50:57.977619 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dac3a-1045-4e81-b9d8-2efc63615d12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:50:57.977619 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dac3a-1045-4e81-b9d8-2efc63615d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:50:57.977619 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dac3a-1045-4e81-b9d8-2efc63615d12 admin admin] PATH_INFO: `/v3/projects/e090846050ba46f3b1804a2355996e16` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:50:57.978304 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2dac3a-1045-4e81-b9d8-2efc63615d12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e090846050ba46f3b1804a2355996e16)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:50:57.978304 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2dac3a-1045-4e81-b9d8-2efc63615d12 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:50:58.193949 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9e2dac3a-1045-4e81-b9d8-2efc63615d12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e090846050ba46f3b1804a2355996e16', 'request_id': 'req-9e2dac3a-1045-4e81-b9d8-2efc63615d12'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:58.317836 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9e2dac3a-1045-4e81-b9d8-2efc63615d12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e090846050ba46f3b1804a2355996e16', 'request_id': 'req-9e2dac3a-1045-4e81-b9d8-2efc63615d12'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:58.325457 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9e2dac3a-1045-4e81-b9d8-2efc63615d12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e090846050ba46f3b1804a2355996e16', 'request_id': 'req-9e2dac3a-1045-4e81-b9d8-2efc63615d12'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:58.335696 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9e2dac3a-1045-4e81-b9d8-2efc63615d12 admin admin] The token cache is being invalidate because project e090846050ba46f3b1804a2355996e16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:50:58.336583 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9e2dac3a-1045-4e81-b9d8-2efc63615d12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:58.337199 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9e2dac3a-1045-4e81-b9d8-2efc63615d12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:50:58.338701 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1176/2398] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:50:57 2022] DELETE /identity/v3/projects/e090846050ba46f3b1804a2355996e16 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:50:58.520743 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:58.652113 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:59.754590 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:50:59.976879 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:00.592214 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:00.943570 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:01.312270 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:01.609346 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:01.794554 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:01.983371 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:02.069020 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:02.668996 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:03.146594 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:03.254940 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:03.303094 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:03.798191 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:03.886588 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:04.186397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:04.503796 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:04.689497 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:05.312286 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:05.426364 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:06.120047 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:06.295287 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:06.514550 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:06.558001 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:06.777521 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:07.189002 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:07.599455 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:08.535212 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:08.577440 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:09.424717 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:10.263395 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9179a-76b5-4f58-a95c-dc432bac0583 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:51:10.263971 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9179a-76b5-4f58-a95c-dc432bac0583 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:51:10.264069 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9179a-76b5-4f58-a95c-dc432bac0583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:51:10.285545 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-dfd9179a-76b5-4f58-a95c-dc432bac0583 None None] MFA Rules not processed for user `88532079079a4976ad5b51dda910f3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:51:10.286923 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-dfd9179a-76b5-4f58-a95c-dc432bac0583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:51:10.371991 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1223/2399] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:51:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:51:10.423970 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:11.641305 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:12.720991 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:13.278412 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:14.263963 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:15.202027 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:15.365564 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:15.903506 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:16.329317 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:16.693440 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:17.726013 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:18.463470 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:18.840580 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:18.896893 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2dac3a-1045-4e81-b9d8-2efc63615d12 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:51:18.899964 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9e2dac3a-1045-4e81-b9d8-2efc63615d12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:51:18.972218 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2dac3a-1045-4e81-b9d8-2efc63615d12 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:51:18.976779 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44269cf1-de3e-40f8-a7f4-b3ed10a08577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:51:18.977406 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44269cf1-de3e-40f8-a7f4-b3ed10a08577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:51:18.977716 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44269cf1-de3e-40f8-a7f4-b3ed10a08577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:51:18.977993 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44269cf1-de3e-40f8-a7f4-b3ed10a08577 admin admin] PATH_INFO: `/v3/users/d1d120a3857a4cd88b9dc397ce6d698a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:51:18.979102 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44269cf1-de3e-40f8-a7f4-b3ed10a08577 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1d120a3857a4cd88b9dc397ce6d698a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:51:18.981005 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44269cf1-de3e-40f8-a7f4-b3ed10a08577 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:51:19.221059 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:19.243930 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-44269cf1-de3e-40f8-a7f4-b3ed10a08577 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1d120a3857a4cd88b9dc397ce6d698a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:51:19.245453 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-44269cf1-de3e-40f8-a7f4-b3ed10a08577 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1d120a3857a4cd88b9dc397ce6d698a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:51:19.254774 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-44269cf1-de3e-40f8-a7f4-b3ed10a08577 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1d120a3857a4cd88b9dc397ce6d698a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:51:19.267604 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-44269cf1-de3e-40f8-a7f4-b3ed10a08577 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1d120a3857a4cd88b9dc397ce6d698a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:51:19.268376 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-44269cf1-de3e-40f8-a7f4-b3ed10a08577 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1d120a3857a4cd88b9dc397ce6d698a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:51:19.352830 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1177/2400] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:51:18 2022] DELETE /identity/v3/users/d1d120a3857a4cd88b9dc397ce6d698a => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:51:19.358139 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2c2f7-f63b-4995-a880-42ad251e12b9 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:51:19.358325 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2c2f7-f63b-4995-a880-42ad251e12b9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:51:19.358607 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2c2f7-f63b-4995-a880-42ad251e12b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:51:19.406696 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6fb2c2f7-f63b-4995-a880-42ad251e12b9 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:51:19.408257 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6fb2c2f7-f63b-4995-a880-42ad251e12b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:51:19.474693 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1224/2401] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:51:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:51:19.484491 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44269cf1-de3e-40f8-a7f4-b3ed10a08577 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:51:19.489851 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-44269cf1-de3e-40f8-a7f4-b3ed10a08577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:51:19.558517 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44269cf1-de3e-40f8-a7f4-b3ed10a08577 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:51:19.572361 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c0cb9-22c4-477f-ab24-b0671f387c4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:51:19.572997 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c0cb9-22c4-477f-ab24-b0671f387c4e service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:51:19.573365 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c0cb9-22c4-477f-ab24-b0671f387c4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:51:19.573658 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c0cb9-22c4-477f-ab24-b0671f387c4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:51:19.584502 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c0cb9-22c4-477f-ab24-b0671f387c4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:51:19.587294 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c0cb9-22c4-477f-ab24-b0671f387c4e service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:51:19.600365 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1178/2402] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:51:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 03:51:19.623885 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:20.065145 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2c2f7-f63b-4995-a880-42ad251e12b9 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:51:20.066772 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6fb2c2f7-f63b-4995-a880-42ad251e12b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:51:20.079369 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2c2f7-f63b-4995-a880-42ad251e12b9 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:51:20.086224 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a759405c-2edd-4c84-84a9-bae89ba2f1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:51:20.086872 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759405c-2edd-4c84-84a9-bae89ba2f1d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:51:20.087154 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759405c-2edd-4c84-84a9-bae89ba2f1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:51:20.087429 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759405c-2edd-4c84-84a9-bae89ba2f1d1 admin admin] PATH_INFO: `/v3/projects/48d64c5285474e6cbea66644bce84971` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:51:20.088578 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a759405c-2edd-4c84-84a9-bae89ba2f1d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48d64c5285474e6cbea66644bce84971)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:51:20.090572 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a759405c-2edd-4c84-84a9-bae89ba2f1d1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:51:20.221687 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a759405c-2edd-4c84-84a9-bae89ba2f1d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48d64c5285474e6cbea66644bce84971', 'request_id': 'req-a759405c-2edd-4c84-84a9-bae89ba2f1d1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:51:20.227226 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:20.342824 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a759405c-2edd-4c84-84a9-bae89ba2f1d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48d64c5285474e6cbea66644bce84971', 'request_id': 'req-a759405c-2edd-4c84-84a9-bae89ba2f1d1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:51:20.349643 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a759405c-2edd-4c84-84a9-bae89ba2f1d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48d64c5285474e6cbea66644bce84971', 'request_id': 'req-a759405c-2edd-4c84-84a9-bae89ba2f1d1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:51:20.360918 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a759405c-2edd-4c84-84a9-bae89ba2f1d1 admin admin] The token cache is being invalidate because project 48d64c5285474e6cbea66644bce84971 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:51:20.361210 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a759405c-2edd-4c84-84a9-bae89ba2f1d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:51:20.361869 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a759405c-2edd-4c84-84a9-bae89ba2f1d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:51:20.363355 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1225/2403] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:51:20 2022] DELETE /identity/v3/projects/48d64c5285474e6cbea66644bce84971 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:51:20.368419 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e5929-d873-4475-9bfa-80382c3f9d2f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:51:20.368700 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e5929-d873-4475-9bfa-80382c3f9d2f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:51:20.368972 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e5929-d873-4475-9bfa-80382c3f9d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:51:20.388167 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-947e5929-d873-4475-9bfa-80382c3f9d2f None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:51:20.389347 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-947e5929-d873-4475-9bfa-80382c3f9d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:51:20.457704 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1179/2404] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:51:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:51:20.466330 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d047b-7993-4d88-af02-1ac23b3161c8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:51:20.466662 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d047b-7993-4d88-af02-1ac23b3161c8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:51:20.466953 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d047b-7993-4d88-af02-1ac23b3161c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:51:20.486969 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6d6d047b-7993-4d88-af02-1ac23b3161c8 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:51:20.488278 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6d6d047b-7993-4d88-af02-1ac23b3161c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:51:20.496394 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1226/2405] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:51:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:51:20.500583 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:20.501055 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e5929-d873-4475-9bfa-80382c3f9d2f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:51:20.510946 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e5929-d873-4475-9bfa-80382c3f9d2f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:51:20.515473 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6d05e-9d92-4ea5-930c-1d5e386055b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:51:20.516078 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6d05e-9d92-4ea5-930c-1d5e386055b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:51:20.516363 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6d05e-9d92-4ea5-930c-1d5e386055b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:51:20.516632 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6d05e-9d92-4ea5-930c-1d5e386055b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:51:20.517273 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc6d05e-9d92-4ea5-930c-1d5e386055b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:51:20.517575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc6d05e-9d92-4ea5-930c-1d5e386055b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:51:20.519218 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc6d05e-9d92-4ea5-930c-1d5e386055b7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:51:20.531838 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1180/2406] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:51:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:51:20.536423 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d047b-7993-4d88-af02-1ac23b3161c8 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:51:20.546862 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d047b-7993-4d88-af02-1ac23b3161c8 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:51:20.551601 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b9708-8de8-4079-9317-91a47f57f683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:51:20.552203 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b9708-8de8-4079-9317-91a47f57f683 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:51:20.552488 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b9708-8de8-4079-9317-91a47f57f683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:51:20.552764 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b9708-8de8-4079-9317-91a47f57f683 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:51:20.554660 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b9708-8de8-4079-9317-91a47f57f683 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:51:20.556573 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b9708-8de8-4079-9317-91a47f57f683 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:51:20.610360 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:20.693228 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1227/2407] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:51:20 2022] POST /identity/v3/projects => generated 381 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:51:20.702464 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6d05e-9d92-4ea5-930c-1d5e386055b7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:51:20.713837 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6d05e-9d92-4ea5-930c-1d5e386055b7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:51:20.772443 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab2c37d-8b1e-40df-86a7-9eef408b6aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:51:20.774392 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2c37d-8b1e-40df-86a7-9eef408b6aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:51:20.774677 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2c37d-8b1e-40df-86a7-9eef408b6aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:51:20.775577 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2c37d-8b1e-40df-86a7-9eef408b6aa5 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:51:20.776255 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab2c37d-8b1e-40df-86a7-9eef408b6aa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:51:20.779472 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab2c37d-8b1e-40df-86a7-9eef408b6aa5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:51:20.891878 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1181/2408] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:51:20 2022] POST /identity/v3/users => generated 291 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:51:20.896456 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b9708-8de8-4079-9317-91a47f57f683 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:51:20.905665 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:20.910458 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b9708-8de8-4079-9317-91a47f57f683 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:51:20.915134 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa3ad2-9526-4360-b860-7c7def94fb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:51:20.915750 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa3ad2-9526-4360-b860-7c7def94fb64 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:51:20.916025 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa3ad2-9526-4360-b860-7c7def94fb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:51:20.916295 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa3ad2-9526-4360-b860-7c7def94fb64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:51:20.916934 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa3ad2-9526-4360-b860-7c7def94fb64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:51:20.918557 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa3ad2-9526-4360-b860-7c7def94fb64 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:51:20.928645 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1228/2409] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:51:20.932872 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab2c37d-8b1e-40df-86a7-9eef408b6aa5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:51:20.943164 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab2c37d-8b1e-40df-86a7-9eef408b6aa5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:51:20.948328 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d66b4f-4005-4fc4-a4f7-d98a8e2960ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:51:20.948919 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d66b4f-4005-4fc4-a4f7-d98a8e2960ce admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:51:20.949198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d66b4f-4005-4fc4-a4f7-d98a8e2960ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:51:20.952157 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d66b4f-4005-4fc4-a4f7-d98a8e2960ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:51:20.952157 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d66b4f-4005-4fc4-a4f7-d98a8e2960ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:51:20.952157 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d66b4f-4005-4fc4-a4f7-d98a8e2960ce admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:51:20.962754 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1182/2410] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:51:20.966586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa3ad2-9526-4360-b860-7c7def94fb64 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:51:20.976285 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa3ad2-9526-4360-b860-7c7def94fb64 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:51:20.980844 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c5ff2-0d1c-4556-a93d-770fa5f2ccc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:51:20.981479 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c5ff2-0d1c-4556-a93d-770fa5f2ccc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:51:20.981802 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c5ff2-0d1c-4556-a93d-770fa5f2ccc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:51:20.982078 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c5ff2-0d1c-4556-a93d-770fa5f2ccc2 admin admin] PATH_INFO: `/v3/projects/8ee2206d83a54ee29e731a1a8e1f84eb/users/93001c8eac8c4d4daab8c73f5e897cdc/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:51:20.996561 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c5ff2-0d1c-4556-a93d-770fa5f2ccc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ee2206d83a54ee29e731a1a8e1f84eb, user_id=93001c8eac8c4d4daab8c73f5e897cdc, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:51:20.999247 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c5ff2-0d1c-4556-a93d-770fa5f2ccc2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:51:21.121329 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1229/2411] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:51:20 2022] PUT /identity/v3/projects/8ee2206d83a54ee29e731a1a8e1f84eb/users/93001c8eac8c4d4daab8c73f5e897cdc/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:51:21.126603 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f3cba-6956-42da-b300-f9625639d69a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:51:21.126896 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f3cba-6956-42da-b300-f9625639d69a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:51:21.127173 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f3cba-6956-42da-b300-f9625639d69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:51:21.146843 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-894f3cba-6956-42da-b300-f9625639d69a None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:51:21.149261 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:21.150054 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-894f3cba-6956-42da-b300-f9625639d69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:51:21.212306 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1183/2412] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:51:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:51:21.221987 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c5ff2-0d1c-4556-a93d-770fa5f2ccc2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:51:21.223693 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-242c5ff2-0d1c-4556-a93d-770fa5f2ccc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:51:21.231854 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:21.284672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c5ff2-0d1c-4556-a93d-770fa5f2ccc2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:51:21.288943 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b7dd3-6975-4c14-a803-1ea46105fea3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:51:21.289072 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b7dd3-6975-4c14-a803-1ea46105fea3 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:51:21.289307 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b7dd3-6975-4c14-a803-1ea46105fea3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:51:21.289581 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b7dd3-6975-4c14-a803-1ea46105fea3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:51:21.309842 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b7dd3-6975-4c14-a803-1ea46105fea3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:51:21.309842 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b7dd3-6975-4c14-a803-1ea46105fea3 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:51:21.317269 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1230/2413] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:51:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:51:21.331945 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:21.412467 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:21.804558 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:21.992925 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:22.701186 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:23.072522 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae3fd8-12ab-48ee-a523-ede6290ee9a2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:51:23.073077 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae3fd8-12ab-48ee-a523-ede6290ee9a2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:51:23.073375 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae3fd8-12ab-48ee-a523-ede6290ee9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:51:23.124269 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-67ae3fd8-12ab-48ee-a523-ede6290ee9a2 None None] MFA Rules not processed for user `93001c8eac8c4d4daab8c73f5e897cdc`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:51:23.126431 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-67ae3fd8-12ab-48ee-a523-ede6290ee9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:51:23.235364 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1184/2414] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:51:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:51:23.249071 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b7dd3-6975-4c14-a803-1ea46105fea3 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:51:23.249071 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a31b7dd3-6975-4c14-a803-1ea46105fea3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:51:23.327714 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b7dd3-6975-4c14-a803-1ea46105fea3 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:51:23.337188 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4340c-b34d-4c1e-9e12-e0524aa519c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:51:23.337188 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4340c-b34d-4c1e-9e12-e0524aa519c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:51:23.337188 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4340c-b34d-4c1e-9e12-e0524aa519c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:51:23.337188 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4340c-b34d-4c1e-9e12-e0524aa519c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:51:23.344459 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b4340c-b34d-4c1e-9e12-e0524aa519c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:51:23.346163 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b4340c-b34d-4c1e-9e12-e0524aa519c4 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:51:23.356473 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1231/2415] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:51:23 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:51:24.047058 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae3fd8-12ab-48ee-a523-ede6290ee9a2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:51:24.048825 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-67ae3fd8-12ab-48ee-a523-ede6290ee9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:51:24.098229 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:24.143071 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae3fd8-12ab-48ee-a523-ede6290ee9a2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:51:24.150847 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882e216-4fc7-4adf-980a-a1ee44d72097 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c39fd09bea1a40babc5f629612c6702b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:51:24.151690 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882e216-4fc7-4adf-980a-a1ee44d72097 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:51:24.152074 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882e216-4fc7-4adf-980a-a1ee44d72097 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:51:24.152522 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882e216-4fc7-4adf-980a-a1ee44d72097 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:51:24.155157 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d882e216-4fc7-4adf-980a-a1ee44d72097 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:51:24.170669 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882e216-4fc7-4adf-980a-a1ee44d72097 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:51:24.172714 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882e216-4fc7-4adf-980a-a1ee44d72097 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:51:24.188042 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1185/2416] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:51:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:51:25.104165 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:25.351424 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502473c-465a-4aa3-999d-f52f8147ebb3 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:51:25.351732 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502473c-465a-4aa3-999d-f52f8147ebb3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:51:25.352009 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502473c-465a-4aa3-999d-f52f8147ebb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:51:25.372691 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0502473c-465a-4aa3-999d-f52f8147ebb3 None None] MFA Rules not processed for user `93001c8eac8c4d4daab8c73f5e897cdc`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:51:25.374607 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0502473c-465a-4aa3-999d-f52f8147ebb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:51:25.381803 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1232/2417] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:51:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:51:31.388429 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d2e60-95b5-460d-99c6-6b5f47aa1e7c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:51:31.388969 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d2e60-95b5-460d-99c6-6b5f47aa1e7c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:51:31.388969 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d2e60-95b5-460d-99c6-6b5f47aa1e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:51:31.408572 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d26d2e60-95b5-460d-99c6-6b5f47aa1e7c None None] MFA Rules not processed for user `6efa7a654e2d4e3e9066aa361460729d`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:51:31.409914 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d26d2e60-95b5-460d-99c6-6b5f47aa1e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:51:31.466587 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1186/2418] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:51:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:51:32.123351 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0502473c-465a-4aa3-999d-f52f8147ebb3 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:51:32.124910 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0502473c-465a-4aa3-999d-f52f8147ebb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:51:32.138352 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0502473c-465a-4aa3-999d-f52f8147ebb3 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:51:32.142906 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40205a-f347-4a4d-9305-271b94893672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:51:32.143526 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40205a-f347-4a4d-9305-271b94893672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:51:32.143818 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40205a-f347-4a4d-9305-271b94893672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:51:32.144076 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40205a-f347-4a4d-9305-271b94893672 admin admin] PATH_INFO: `/v3/users/4255e2e00c434a728aa73c5de3623245` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:51:32.147676 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40205a-f347-4a4d-9305-271b94893672 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4255e2e00c434a728aa73c5de3623245)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:51:32.147676 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40205a-f347-4a4d-9305-271b94893672 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:51:32.426477 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-de40205a-f347-4a4d-9305-271b94893672 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4255e2e00c434a728aa73c5de3623245'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:51:32.427138 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-de40205a-f347-4a4d-9305-271b94893672 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4255e2e00c434a728aa73c5de3623245'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:51:32.434026 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-de40205a-f347-4a4d-9305-271b94893672 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4255e2e00c434a728aa73c5de3623245'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:51:32.445809 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-de40205a-f347-4a4d-9305-271b94893672 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4255e2e00c434a728aa73c5de3623245'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:51:32.446470 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-de40205a-f347-4a4d-9305-271b94893672 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4255e2e00c434a728aa73c5de3623245'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:51:32.566172 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1233/2419] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:51:32 2022] DELETE /identity/v3/users/4255e2e00c434a728aa73c5de3623245 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:51:32.570656 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503445a-1580-4ee2-baf1-946bc9bcd9b4 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:51:32.571143 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503445a-1580-4ee2-baf1-946bc9bcd9b4 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:51:32.571261 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503445a-1580-4ee2-baf1-946bc9bcd9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:51:32.590172 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b503445a-1580-4ee2-baf1-946bc9bcd9b4 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:51:32.591356 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b503445a-1580-4ee2-baf1-946bc9bcd9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:51:32.654362 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1187/2420] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:51:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:51:32.664719 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40205a-f347-4a4d-9305-271b94893672 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:51:32.666159 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-de40205a-f347-4a4d-9305-271b94893672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:51:32.732846 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40205a-f347-4a4d-9305-271b94893672 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:51:32.741941 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a6786a-c34a-47b0-b06d-cf623b106e50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:51:32.742665 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6786a-c34a-47b0-b06d-cf623b106e50 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:51:32.742941 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6786a-c34a-47b0-b06d-cf623b106e50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:51:32.743204 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6786a-c34a-47b0-b06d-cf623b106e50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:51:32.752830 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a6786a-c34a-47b0-b06d-cf623b106e50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:51:32.754296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a6786a-c34a-47b0-b06d-cf623b106e50 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:51:32.758792 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:32.766940 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1234/2421] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:51:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:51:33.290923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b503445a-1580-4ee2-baf1-946bc9bcd9b4 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:51:33.292407 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b503445a-1580-4ee2-baf1-946bc9bcd9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:51:33.305428 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b503445a-1580-4ee2-baf1-946bc9bcd9b4 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:51:33.310545 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4303a-b87b-4ac9-b4bf-7fd6451e5705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:51:33.311398 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4303a-b87b-4ac9-b4bf-7fd6451e5705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:51:33.311863 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4303a-b87b-4ac9-b4bf-7fd6451e5705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:51:33.312133 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4303a-b87b-4ac9-b4bf-7fd6451e5705 admin admin] PATH_INFO: `/v3/projects/5eb9a4c26f54419aaaca1aa56a3f603c` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:51:33.313733 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade4303a-b87b-4ac9-b4bf-7fd6451e5705 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eb9a4c26f54419aaaca1aa56a3f603c)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:51:33.315764 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade4303a-b87b-4ac9-b4bf-7fd6451e5705 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:51:33.428217 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ade4303a-b87b-4ac9-b4bf-7fd6451e5705 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eb9a4c26f54419aaaca1aa56a3f603c', 'request_id': 'req-ade4303a-b87b-4ac9-b4bf-7fd6451e5705'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:51:33.526264 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ade4303a-b87b-4ac9-b4bf-7fd6451e5705 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eb9a4c26f54419aaaca1aa56a3f603c', 'request_id': 'req-ade4303a-b87b-4ac9-b4bf-7fd6451e5705'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:51:33.533147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ade4303a-b87b-4ac9-b4bf-7fd6451e5705 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eb9a4c26f54419aaaca1aa56a3f603c', 'request_id': 'req-ade4303a-b87b-4ac9-b4bf-7fd6451e5705'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:51:33.538215 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:33.544808 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ade4303a-b87b-4ac9-b4bf-7fd6451e5705 admin admin] The token cache is being invalidate because project 5eb9a4c26f54419aaaca1aa56a3f603c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:51:33.545099 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ade4303a-b87b-4ac9-b4bf-7fd6451e5705 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:51:33.545754 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ade4303a-b87b-4ac9-b4bf-7fd6451e5705 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:51:33.547219 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1188/2422] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:51:33 2022] DELETE /identity/v3/projects/5eb9a4c26f54419aaaca1aa56a3f603c => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:51:43.080217 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:51:43.821021 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:52:02.352333 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bf1b6-34ff-4cab-9481-789ef6e38d2d None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:52:02.352885 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bf1b6-34ff-4cab-9481-789ef6e38d2d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:52:02.352885 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bf1b6-34ff-4cab-9481-789ef6e38d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:52:02.372540 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-497bf1b6-34ff-4cab-9481-789ef6e38d2d None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:52:02.373755 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-497bf1b6-34ff-4cab-9481-789ef6e38d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:52:02.429788 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1235/2423] 10.222.0.26 () {58 vars in 1016 bytes} [Fri Sep 16 03:52:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:52:02.446104 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4303a-b87b-4ac9-b4bf-7fd6451e5705 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:52:02.447572 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ade4303a-b87b-4ac9-b4bf-7fd6451e5705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:52:02.521019 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4303a-b87b-4ac9-b4bf-7fd6451e5705 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:52:02.526317 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98527c32-cc32-4ebe-bdba-c73d7fb0a5a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:52:02.526913 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98527c32-cc32-4ebe-bdba-c73d7fb0a5a2 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:52:02.527191 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98527c32-cc32-4ebe-bdba-c73d7fb0a5a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:52:02.527459 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98527c32-cc32-4ebe-bdba-c73d7fb0a5a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:52:02.535642 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98527c32-cc32-4ebe-bdba-c73d7fb0a5a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:52:02.537209 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98527c32-cc32-4ebe-bdba-c73d7fb0a5a2 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:52:02.546478 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1189/2424] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:52:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:52:06.631506 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0fa0e-58f6-41b5-bbb6-022236638ec1 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:52:06.632009 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0fa0e-58f6-41b5-bbb6-022236638ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:52:06.632009 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0fa0e-58f6-41b5-bbb6-022236638ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:52:06.651126 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f8f0fa0e-58f6-41b5-bbb6-022236638ec1 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:52:06.652321 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f8f0fa0e-58f6-41b5-bbb6-022236638ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:52:06.660296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1236/2425] 10.222.0.26 () {58 vars in 1016 bytes} [Fri Sep 16 03:52:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:52:06.683560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98527c32-cc32-4ebe-bdba-c73d7fb0a5a2 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:52:06.684996 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-98527c32-cc32-4ebe-bdba-c73d7fb0a5a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:52:06.700294 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98527c32-cc32-4ebe-bdba-c73d7fb0a5a2 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:52:06.712613 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333bca23-7ca3-4e28-a636-91aece76ab58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:52:06.712613 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bca23-7ca3-4e28-a636-91aece76ab58 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:52:06.712613 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bca23-7ca3-4e28-a636-91aece76ab58 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:52:06.712613 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bca23-7ca3-4e28-a636-91aece76ab58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:52:06.715875 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333bca23-7ca3-4e28-a636-91aece76ab58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:52:06.718175 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333bca23-7ca3-4e28-a636-91aece76ab58 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:52:06.728296 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1190/2426] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:52:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:52:10.282886 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727705b-ed81-47c7-95f2-9e95a123bed4 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:52:10.283449 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727705b-ed81-47c7-95f2-9e95a123bed4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:52:10.283449 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727705b-ed81-47c7-95f2-9e95a123bed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:52:10.302645 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3727705b-ed81-47c7-95f2-9e95a123bed4 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:52:10.303836 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3727705b-ed81-47c7-95f2-9e95a123bed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:52:10.311700 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1237/2427] 10.222.0.26 () {58 vars in 1016 bytes} [Fri Sep 16 03:52:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:52:10.330351 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333bca23-7ca3-4e28-a636-91aece76ab58 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:52:10.342105 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333bca23-7ca3-4e28-a636-91aece76ab58 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:52:10.347453 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106079ac-f3ae-486a-a222-4bb40da71b18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:52:10.348040 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106079ac-f3ae-486a-a222-4bb40da71b18 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:52:10.348323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106079ac-f3ae-486a-a222-4bb40da71b18 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:52:10.348589 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106079ac-f3ae-486a-a222-4bb40da71b18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:52:10.356561 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106079ac-f3ae-486a-a222-4bb40da71b18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:52:10.358151 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106079ac-f3ae-486a-a222-4bb40da71b18 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:52:10.367290 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1191/2428] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:52:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:52:13.109415 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf508c1-993e-4aa9-80ad-9e5a16025503 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:52:13.119569 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf508c1-993e-4aa9-80ad-9e5a16025503 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:52:13.119569 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf508c1-993e-4aa9-80ad-9e5a16025503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:52:13.130469 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-abf508c1-993e-4aa9-80ad-9e5a16025503 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:52:13.131669 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-abf508c1-993e-4aa9-80ad-9e5a16025503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:52:13.139791 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1238/2429] 10.222.0.26 () {58 vars in 1016 bytes} [Fri Sep 16 03:52:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:52:13.156845 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106079ac-f3ae-486a-a222-4bb40da71b18 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:52:13.168405 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106079ac-f3ae-486a-a222-4bb40da71b18 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:52:13.174455 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b871b44-3846-48b4-849f-1ea5a20db44d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:52:13.175057 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b871b44-3846-48b4-849f-1ea5a20db44d service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:52:13.175333 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b871b44-3846-48b4-849f-1ea5a20db44d service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:52:13.175605 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b871b44-3846-48b4-849f-1ea5a20db44d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:52:13.183734 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b871b44-3846-48b4-849f-1ea5a20db44d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:52:13.185372 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b871b44-3846-48b4-849f-1ea5a20db44d service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:52:13.195363 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1192/2430] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:52:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:52:16.416639 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6681b7-8557-4f6c-873f-82314a2282b3 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:52:16.417148 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6681b7-8557-4f6c-873f-82314a2282b3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:52:16.417253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6681b7-8557-4f6c-873f-82314a2282b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:52:16.437135 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7d6681b7-8557-4f6c-873f-82314a2282b3 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:52:16.438440 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7d6681b7-8557-4f6c-873f-82314a2282b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:52:16.446310 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1239/2431] 10.222.0.26 () {58 vars in 1016 bytes} [Fri Sep 16 03:52:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:52:16.461698 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b871b44-3846-48b4-849f-1ea5a20db44d service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:52:16.473903 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b871b44-3846-48b4-849f-1ea5a20db44d service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:52:16.479933 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ce115-642a-44c4-a29f-f7b9d966590f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:52:16.480539 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ce115-642a-44c4-a29f-f7b9d966590f service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:52:16.480822 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ce115-642a-44c4-a29f-f7b9d966590f service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:52:16.481095 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ce115-642a-44c4-a29f-f7b9d966590f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:52:16.490471 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3ce115-642a-44c4-a29f-f7b9d966590f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:52:16.492158 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3ce115-642a-44c4-a29f-f7b9d966590f service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:52:16.502017 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1193/2432] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:52:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:52:19.627895 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693ed4e-5bfa-49c0-88af-49c771192f62 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:52:19.628372 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693ed4e-5bfa-49c0-88af-49c771192f62 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:52:19.629279 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693ed4e-5bfa-49c0-88af-49c771192f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:52:19.648328 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5693ed4e-5bfa-49c0-88af-49c771192f62 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:52:19.649515 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5693ed4e-5bfa-49c0-88af-49c771192f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:52:19.657304 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1240/2433] 10.222.0.26 () {58 vars in 1016 bytes} [Fri Sep 16 03:52:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:52:19.673314 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ce115-642a-44c4-a29f-f7b9d966590f service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:52:19.684629 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ce115-642a-44c4-a29f-f7b9d966590f service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:52:19.690645 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf28db-7eff-4164-8dc3-a2a7311bbc63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:52:19.691250 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf28db-7eff-4164-8dc3-a2a7311bbc63 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:52:19.691697 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf28db-7eff-4164-8dc3-a2a7311bbc63 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:52:19.691980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf28db-7eff-4164-8dc3-a2a7311bbc63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:52:19.700916 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf28db-7eff-4164-8dc3-a2a7311bbc63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:52:19.702525 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf28db-7eff-4164-8dc3-a2a7311bbc63 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:52:19.713194 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1194/2434] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:52:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:52:29.642365 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=42 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:52:29.708618 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=64 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:52:38.127691 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fccd9-5691-41f3-ad9d-dbb1a8a64ca2 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:52:38.135028 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fccd9-5691-41f3-ad9d-dbb1a8a64ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:52:38.135028 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fccd9-5691-41f3-ad9d-dbb1a8a64ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:52:38.147240 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-475fccd9-5691-41f3-ad9d-dbb1a8a64ca2 None None] MFA Rules not processed for user `93001c8eac8c4d4daab8c73f5e897cdc`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:52:38.148434 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-475fccd9-5691-41f3-ad9d-dbb1a8a64ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:52:38.204907 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1241/2435] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:52:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:52:38.548667 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34c9be-40ba-4a7d-8d09-3c0a8334982e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:52:38.549179 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34c9be-40ba-4a7d-8d09-3c0a8334982e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:52:38.549304 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34c9be-40ba-4a7d-8d09-3c0a8334982e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:52:38.569385 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-5c34c9be-40ba-4a7d-8d09-3c0a8334982e None None] MFA Rules not processed for user `c04a0f9a09a24473a9377ca68fc638b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:52:38.570698 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5c34c9be-40ba-4a7d-8d09-3c0a8334982e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:52:38.630196 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1195/2436] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:52:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:52:39.066508 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858745af-b53f-4e8f-945c-b100bb2168c5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:52:39.066992 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858745af-b53f-4e8f-945c-b100bb2168c5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:52:39.067426 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858745af-b53f-4e8f-945c-b100bb2168c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:52:39.091219 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-858745af-b53f-4e8f-945c-b100bb2168c5 None None] MFA Rules not processed for user `88532079079a4976ad5b51dda910f3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:52:39.091219 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-858745af-b53f-4e8f-945c-b100bb2168c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:52:39.172578 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1242/2437] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:52:39 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:52:48.623724 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=25 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:52:49.165417 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=50 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:52:52.776345 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409b6b8-58e0-4b87-8f21-27a9b965d324 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:52:52.776851 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409b6b8-58e0-4b87-8f21-27a9b965d324 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:52:52.776980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409b6b8-58e0-4b87-8f21-27a9b965d324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:52:52.798933 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e409b6b8-58e0-4b87-8f21-27a9b965d324 None None] MFA Rules not processed for user `6efa7a654e2d4e3e9066aa361460729d`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:52:52.805900 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e409b6b8-58e0-4b87-8f21-27a9b965d324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:52:52.860424 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1196/2438] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:52:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:53:01.452313 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca38a77-d7a0-40f0-b5ef-f0e583459d88 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:53:01.452858 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca38a77-d7a0-40f0-b5ef-f0e583459d88 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:53:01.452858 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca38a77-d7a0-40f0-b5ef-f0e583459d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:53:01.472811 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2ca38a77-d7a0-40f0-b5ef-f0e583459d88 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:53:01.473518 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2ca38a77-d7a0-40f0-b5ef-f0e583459d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:53:01.482130 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1243/2439] 10.222.0.26 () {58 vars in 1016 bytes} [Fri Sep 16 03:53:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:53:01.499213 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409b6b8-58e0-4b87-8f21-27a9b965d324 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:53:01.512468 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409b6b8-58e0-4b87-8f21-27a9b965d324 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:53:01.517918 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428cb74-248e-4d77-b51d-a8e35e7d6e74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:53:01.518598 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428cb74-248e-4d77-b51d-a8e35e7d6e74 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:53:01.518809 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428cb74-248e-4d77-b51d-a8e35e7d6e74 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:53:01.519082 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428cb74-248e-4d77-b51d-a8e35e7d6e74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:53:01.527528 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5428cb74-248e-4d77-b51d-a8e35e7d6e74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:53:01.529114 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5428cb74-248e-4d77-b51d-a8e35e7d6e74 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:53:01.539326 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1197/2440] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:53:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:53:05.103544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a230a2-2e62-4550-b122-587107105ca3 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:53:05.104100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a230a2-2e62-4550-b122-587107105ca3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:53:05.104213 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a230a2-2e62-4550-b122-587107105ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:53:05.124155 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-23a230a2-2e62-4550-b122-587107105ca3 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:53:05.125344 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-23a230a2-2e62-4550-b122-587107105ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:53:05.133055 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1244/2441] 10.222.0.26 () {58 vars in 1016 bytes} [Fri Sep 16 03:53:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:53:05.151054 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428cb74-248e-4d77-b51d-a8e35e7d6e74 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:53:05.162603 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428cb74-248e-4d77-b51d-a8e35e7d6e74 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:53:05.168511 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae531bb-a471-450d-8014-e8a6aa5edf6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:53:05.169104 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae531bb-a471-450d-8014-e8a6aa5edf6f service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:53:05.169376 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae531bb-a471-450d-8014-e8a6aa5edf6f service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:53:05.169726 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae531bb-a471-450d-8014-e8a6aa5edf6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:53:05.177750 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae531bb-a471-450d-8014-e8a6aa5edf6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:53:05.180432 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae531bb-a471-450d-8014-e8a6aa5edf6f service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:53:05.189155 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1198/2442] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:53:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:53:08.030434 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89490234-b4db-41a2-a182-09cb05835135 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:53:08.030913 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89490234-b4db-41a2-a182-09cb05835135 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:53:08.031022 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89490234-b4db-41a2-a182-09cb05835135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:53:08.050067 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-89490234-b4db-41a2-a182-09cb05835135 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:53:08.051245 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-89490234-b4db-41a2-a182-09cb05835135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:53:08.059341 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1245/2443] 10.222.0.26 () {58 vars in 1016 bytes} [Fri Sep 16 03:53:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:53:08.082320 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae531bb-a471-450d-8014-e8a6aa5edf6f service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:53:08.094026 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae531bb-a471-450d-8014-e8a6aa5edf6f service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:53:08.099525 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a915c1-07ac-47a9-b0a5-1ce721a57959 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:53:08.100117 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a915c1-07ac-47a9-b0a5-1ce721a57959 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:53:08.100397 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a915c1-07ac-47a9-b0a5-1ce721a57959 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:53:08.100670 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a915c1-07ac-47a9-b0a5-1ce721a57959 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:53:08.111519 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a915c1-07ac-47a9-b0a5-1ce721a57959 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:53:08.115599 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a915c1-07ac-47a9-b0a5-1ce721a57959 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:53:08.128057 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1199/2444] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:53:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:53:12.304527 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb63a47-ff83-4cbc-a37c-0143bc39502a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:53:12.305064 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb63a47-ff83-4cbc-a37c-0143bc39502a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:53:12.305064 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb63a47-ff83-4cbc-a37c-0143bc39502a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:53:12.326095 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-fbb63a47-ff83-4cbc-a37c-0143bc39502a None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:53:12.327317 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fbb63a47-ff83-4cbc-a37c-0143bc39502a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:53:12.336505 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1246/2445] 10.222.0.26 () {58 vars in 1016 bytes} [Fri Sep 16 03:53:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:53:12.351002 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a915c1-07ac-47a9-b0a5-1ce721a57959 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:53:12.363050 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a915c1-07ac-47a9-b0a5-1ce721a57959 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:53:12.368638 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d10e2-9fb9-4d41-a5a8-e4f1f1e06cb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:53:12.369236 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d10e2-9fb9-4d41-a5a8-e4f1f1e06cb4 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:53:12.369511 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d10e2-9fb9-4d41-a5a8-e4f1f1e06cb4 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:53:12.369816 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d10e2-9fb9-4d41-a5a8-e4f1f1e06cb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:53:12.378400 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2d10e2-9fb9-4d41-a5a8-e4f1f1e06cb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:53:12.380032 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2d10e2-9fb9-4d41-a5a8-e4f1f1e06cb4 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:53:12.390280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1200/2446] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:53:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:53:15.556381 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d40abe-f0e4-4a5e-990b-5bf81fe41e18 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:53:15.556880 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d40abe-f0e4-4a5e-990b-5bf81fe41e18 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:53:15.556967 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d40abe-f0e4-4a5e-990b-5bf81fe41e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:53:15.577293 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f2d40abe-f0e4-4a5e-990b-5bf81fe41e18 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:53:15.580867 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f2d40abe-f0e4-4a5e-990b-5bf81fe41e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:53:15.586717 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1247/2447] 10.222.0.26 () {58 vars in 1016 bytes} [Fri Sep 16 03:53:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:53:15.601426 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d10e2-9fb9-4d41-a5a8-e4f1f1e06cb4 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:53:15.613350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d10e2-9fb9-4d41-a5a8-e4f1f1e06cb4 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:53:15.619121 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3cc0d6-1314-43f9-8d99-0c7003c5038d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:53:15.619729 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cc0d6-1314-43f9-8d99-0c7003c5038d service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:53:15.620004 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cc0d6-1314-43f9-8d99-0c7003c5038d service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:53:15.620281 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cc0d6-1314-43f9-8d99-0c7003c5038d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:53:15.629164 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3cc0d6-1314-43f9-8d99-0c7003c5038d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:53:15.630783 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3cc0d6-1314-43f9-8d99-0c7003c5038d service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:53:15.640519 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1201/2448] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:53:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:53:18.675673 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d40abe-f0e4-4a5e-990b-5bf81fe41e18 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:53:18.677065 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f2d40abe-f0e4-4a5e-990b-5bf81fe41e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:53:18.733980 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d40abe-f0e4-4a5e-990b-5bf81fe41e18 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:53:18.737515 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0d557-3ccb-4ab5-a923-4ed93e9f3944 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:53:18.738144 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0d557-3ccb-4ab5-a923-4ed93e9f3944 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:53:18.738418 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0d557-3ccb-4ab5-a923-4ed93e9f3944 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:53:18.738686 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0d557-3ccb-4ab5-a923-4ed93e9f3944 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:53:18.740362 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-06b0d557-3ccb-4ab5-a923-4ed93e9f3944 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:53:18.753626 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0d557-3ccb-4ab5-a923-4ed93e9f3944 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:53:18.755068 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0d557-3ccb-4ab5-a923-4ed93e9f3944 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:53:18.766201 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1248/2449] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:53:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:53:19.596937 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3cc0d6-1314-43f9-8d99-0c7003c5038d service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:53:19.601283 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=56 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:53:19.607555 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3cc0d6-1314-43f9-8d99-0c7003c5038d service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:53:19.611190 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634dc4bb-13be-4442-b1e3-a873a44da966 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:53:19.611852 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634dc4bb-13be-4442-b1e3-a873a44da966 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:53:19.612130 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634dc4bb-13be-4442-b1e3-a873a44da966 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:53:19.612398 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634dc4bb-13be-4442-b1e3-a873a44da966 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:53:19.614116 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-634dc4bb-13be-4442-b1e3-a873a44da966 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:53:19.627286 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634dc4bb-13be-4442-b1e3-a873a44da966 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:53:19.628836 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634dc4bb-13be-4442-b1e3-a873a44da966 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:53:19.639654 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1202/2450] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:53:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:53:28.760906 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=41 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:53:29.648544 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:53:44.918475 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0d557-3ccb-4ab5-a923-4ed93e9f3944 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:53:44.929543 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0d557-3ccb-4ab5-a923-4ed93e9f3944 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:53:44.935035 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048523e-cddf-4f90-8f44-055d3020c753 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:53:44.935660 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048523e-cddf-4f90-8f44-055d3020c753 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:53:44.935947 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048523e-cddf-4f90-8f44-055d3020c753 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:53:44.936220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048523e-cddf-4f90-8f44-055d3020c753 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:53:44.937992 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7048523e-cddf-4f90-8f44-055d3020c753 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:53:44.948811 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7048523e-cddf-4f90-8f44-055d3020c753 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:53:44.950435 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7048523e-cddf-4f90-8f44-055d3020c753 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:53:44.960117 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1249/2451] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:53:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:53:46.671921 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634dc4bb-13be-4442-b1e3-a873a44da966 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:53:46.683748 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634dc4bb-13be-4442-b1e3-a873a44da966 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:53:46.689885 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf841272-9d72-4400-a658-97fa35e5bea6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:53:46.691262 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf841272-9d72-4400-a658-97fa35e5bea6 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:53:46.691736 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf841272-9d72-4400-a658-97fa35e5bea6 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:53:46.692246 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf841272-9d72-4400-a658-97fa35e5bea6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:53:46.694437 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bf841272-9d72-4400-a658-97fa35e5bea6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:53:46.709835 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf841272-9d72-4400-a658-97fa35e5bea6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:53:46.710944 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf841272-9d72-4400-a658-97fa35e5bea6 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:53:46.722360 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1203/2452] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:53:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:53:52.580923 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048523e-cddf-4f90-8f44-055d3020c753 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:53:52.582415 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7048523e-cddf-4f90-8f44-055d3020c753 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:53:52.599548 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048523e-cddf-4f90-8f44-055d3020c753 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:53:52.604902 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d4272-cd20-4111-9160-543b6a068d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:53:52.605553 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d4272-cd20-4111-9160-543b6a068d73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:53:52.605868 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d4272-cd20-4111-9160-543b6a068d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:53:52.606294 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d4272-cd20-4111-9160-543b6a068d73 admin admin] PATH_INFO: `/v3/users/88532079079a4976ad5b51dda910f3e7` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:53:52.607440 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d4272-cd20-4111-9160-543b6a068d73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88532079079a4976ad5b51dda910f3e7)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:53:52.609459 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d4272-cd20-4111-9160-543b6a068d73 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:53:52.759619 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a46d4272-cd20-4111-9160-543b6a068d73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88532079079a4976ad5b51dda910f3e7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:53:52.760319 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a46d4272-cd20-4111-9160-543b6a068d73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88532079079a4976ad5b51dda910f3e7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:53:52.767769 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a46d4272-cd20-4111-9160-543b6a068d73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88532079079a4976ad5b51dda910f3e7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:53:52.780489 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a46d4272-cd20-4111-9160-543b6a068d73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88532079079a4976ad5b51dda910f3e7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:53:52.781237 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a46d4272-cd20-4111-9160-543b6a068d73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88532079079a4976ad5b51dda910f3e7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:53:52.870707 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1250/2453] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:53:52 2022] DELETE /identity/v3/users/88532079079a4976ad5b51dda910f3e7 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:53:53.119917 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf841272-9d72-4400-a658-97fa35e5bea6 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:53:53.131322 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf841272-9d72-4400-a658-97fa35e5bea6 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:53:53.194088 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83342f-6879-4803-b6c1-7aacd404e281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:53:53.194769 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83342f-6879-4803-b6c1-7aacd404e281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:53:53.195189 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83342f-6879-4803-b6c1-7aacd404e281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:53:53.195473 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83342f-6879-4803-b6c1-7aacd404e281 admin admin] PATH_INFO: `/v3/projects/4746d3cf9df74697a7d92f42ade5363d` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:53:53.196612 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83342f-6879-4803-b6c1-7aacd404e281 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4746d3cf9df74697a7d92f42ade5363d)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:53:53.198607 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83342f-6879-4803-b6c1-7aacd404e281 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:53:53.347329 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7d83342f-6879-4803-b6c1-7aacd404e281 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4746d3cf9df74697a7d92f42ade5363d', 'request_id': 'req-7d83342f-6879-4803-b6c1-7aacd404e281'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:53:53.397155 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7d83342f-6879-4803-b6c1-7aacd404e281 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4746d3cf9df74697a7d92f42ade5363d', 'request_id': 'req-7d83342f-6879-4803-b6c1-7aacd404e281'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:53:53.404158 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7d83342f-6879-4803-b6c1-7aacd404e281 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4746d3cf9df74697a7d92f42ade5363d', 'request_id': 'req-7d83342f-6879-4803-b6c1-7aacd404e281'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:53:53.417037 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7d83342f-6879-4803-b6c1-7aacd404e281 admin admin] The token cache is being invalidate because project 4746d3cf9df74697a7d92f42ade5363d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:53:53.417333 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7d83342f-6879-4803-b6c1-7aacd404e281 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:53:53.418163 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7d83342f-6879-4803-b6c1-7aacd404e281 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:53:53.419870 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1204/2454] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:53:53 2022] DELETE /identity/v3/projects/4746d3cf9df74697a7d92f42ade5363d => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:53:53.426022 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217c4d0-df0e-4a39-bf4d-0f349158c7d3 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:53:53.426633 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217c4d0-df0e-4a39-bf4d-0f349158c7d3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:53:53.427141 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217c4d0-df0e-4a39-bf4d-0f349158c7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:53:53.450344 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1217c4d0-df0e-4a39-bf4d-0f349158c7d3 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:53:53.451714 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1217c4d0-df0e-4a39-bf4d-0f349158c7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:53:53.515455 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1251/2455] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:53:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:53:53.523219 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f4c93-d4ad-46c1-8e5e-1f56711f85b6 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:53:53.523766 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f4c93-d4ad-46c1-8e5e-1f56711f85b6 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:53:53.524250 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f4c93-d4ad-46c1-8e5e-1f56711f85b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:53:53.546867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a39f4c93-d4ad-46c1-8e5e-1f56711f85b6 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:53:53.548511 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a39f4c93-d4ad-46c1-8e5e-1f56711f85b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:53:53.557393 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1205/2456] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:53:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:53:53.561771 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217c4d0-df0e-4a39-bf4d-0f349158c7d3 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:53:53.571471 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217c4d0-df0e-4a39-bf4d-0f349158c7d3 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:53:53.576210 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36398a17-70a7-46d5-a329-076bf1bd26e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:53:53.576820 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36398a17-70a7-46d5-a329-076bf1bd26e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:53:53.577103 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36398a17-70a7-46d5-a329-076bf1bd26e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:53:53.577379 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36398a17-70a7-46d5-a329-076bf1bd26e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:53:53.578153 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36398a17-70a7-46d5-a329-076bf1bd26e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:53:53.578463 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36398a17-70a7-46d5-a329-076bf1bd26e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:53:53.580645 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36398a17-70a7-46d5-a329-076bf1bd26e2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:53:53.592356 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1252/2457] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:53:53.598577 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f4c93-d4ad-46c1-8e5e-1f56711f85b6 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:53:53.607984 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f4c93-d4ad-46c1-8e5e-1f56711f85b6 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:53:53.612687 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34e662-6c65-498b-93a1-4766ba2a7214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:53:53.613285 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34e662-6c65-498b-93a1-4766ba2a7214 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:53:53.613562 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34e662-6c65-498b-93a1-4766ba2a7214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:53:53.613875 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34e662-6c65-498b-93a1-4766ba2a7214 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:53:53.614510 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34e662-6c65-498b-93a1-4766ba2a7214 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:53:53.616433 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34e662-6c65-498b-93a1-4766ba2a7214 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:53:53.679648 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36398a17-70a7-46d5-a329-076bf1bd26e2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:53:53.682149 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-36398a17-70a7-46d5-a329-076bf1bd26e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:53:53.699014 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1206/2458] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:53:53 2022] POST /identity/v3/projects => generated 389 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:53:53.702763 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34e662-6c65-498b-93a1-4766ba2a7214 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:53:53.703107 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36398a17-70a7-46d5-a329-076bf1bd26e2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:53:53.758096 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:53:53.759160 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:53:53.771633 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686a053-787c-49e4-9ce4-4ce8c18021ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:53:53.772277 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686a053-787c-49e4-9ce4-4ce8c18021ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:53:53.772669 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686a053-787c-49e4-9ce4-4ce8c18021ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:53:53.772838 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686a053-787c-49e4-9ce4-4ce8c18021ff admin admin] PATH_INFO: `/v3/users/93001c8eac8c4d4daab8c73f5e897cdc` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:53:53.773675 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34e662-6c65-498b-93a1-4766ba2a7214 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:53:53.774034 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5686a053-787c-49e4-9ce4-4ce8c18021ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=93001c8eac8c4d4daab8c73f5e897cdc)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:53:53.775948 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5686a053-787c-49e4-9ce4-4ce8c18021ff admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:53:53.778349 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb1bba-e499-4260-ab1e-8017fc2ecd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:53:53.778962 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb1bba-e499-4260-ab1e-8017fc2ecd5d admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:53:53.779241 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb1bba-e499-4260-ab1e-8017fc2ecd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:53:53.779519 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb1bba-e499-4260-ab1e-8017fc2ecd5d admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:53:53.780197 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb1bba-e499-4260-ab1e-8017fc2ecd5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:53:53.782210 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb1bba-e499-4260-ab1e-8017fc2ecd5d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:53:53.897580 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1207/2459] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:53:53 2022] POST /identity/v3/users => generated 295 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:53:53.900744 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb1bba-e499-4260-ab1e-8017fc2ecd5d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:53:53.911347 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb1bba-e499-4260-ab1e-8017fc2ecd5d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:53:53.917809 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58a159-4e5e-4dab-992b-9d11c0bb71e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:53:53.918379 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58a159-4e5e-4dab-992b-9d11c0bb71e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:53:53.918657 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58a159-4e5e-4dab-992b-9d11c0bb71e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:53:53.918928 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58a159-4e5e-4dab-992b-9d11c0bb71e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:53:53.919736 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d58a159-4e5e-4dab-992b-9d11c0bb71e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:53:53.921443 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d58a159-4e5e-4dab-992b-9d11c0bb71e6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:53:53.932451 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1208/2460] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:53:53.936587 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58a159-4e5e-4dab-992b-9d11c0bb71e6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:53:53.946941 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58a159-4e5e-4dab-992b-9d11c0bb71e6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:53:53.951608 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38476ebc-9020-407c-8bab-509a5291c292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:53:53.954142 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38476ebc-9020-407c-8bab-509a5291c292 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:53:53.954142 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38476ebc-9020-407c-8bab-509a5291c292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:53:53.954142 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38476ebc-9020-407c-8bab-509a5291c292 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:53:53.954142 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38476ebc-9020-407c-8bab-509a5291c292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:53:53.955066 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38476ebc-9020-407c-8bab-509a5291c292 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:53:53.965347 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1209/2461] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:53:53.969948 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38476ebc-9020-407c-8bab-509a5291c292 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:53:53.979357 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38476ebc-9020-407c-8bab-509a5291c292 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:53:53.983905 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5c1d2-6989-4c32-a50b-0c33deee8cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:53:53.984517 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5c1d2-6989-4c32-a50b-0c33deee8cbf admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:53:53.984797 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5c1d2-6989-4c32-a50b-0c33deee8cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:53:53.985071 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5c1d2-6989-4c32-a50b-0c33deee8cbf admin admin] PATH_INFO: `/v3/projects/d4cf4ff943214f6ba4e97dbf0bdb89ef/users/db489eef960941e8a3c187bbedc978d9/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:53:53.999822 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe5c1d2-6989-4c32-a50b-0c33deee8cbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4cf4ff943214f6ba4e97dbf0bdb89ef, user_id=db489eef960941e8a3c187bbedc978d9, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:53:54.002481 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe5c1d2-6989-4c32-a50b-0c33deee8cbf admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:53:54.045207 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5686a053-787c-49e4-9ce4-4ce8c18021ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93001c8eac8c4d4daab8c73f5e897cdc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:53:54.045879 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5686a053-787c-49e4-9ce4-4ce8c18021ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93001c8eac8c4d4daab8c73f5e897cdc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:53:54.053466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5686a053-787c-49e4-9ce4-4ce8c18021ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93001c8eac8c4d4daab8c73f5e897cdc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:53:54.060210 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1210/2462] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:53:53 2022] PUT /identity/v3/projects/d4cf4ff943214f6ba4e97dbf0bdb89ef/users/db489eef960941e8a3c187bbedc978d9/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:53:54.065124 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdaefad-535f-4d77-81c8-97f36b65d93a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:53:54.065489 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdaefad-535f-4d77-81c8-97f36b65d93a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:53:54.065857 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdaefad-535f-4d77-81c8-97f36b65d93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:53:54.066058 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5686a053-787c-49e4-9ce4-4ce8c18021ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93001c8eac8c4d4daab8c73f5e897cdc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:53:54.066757 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5686a053-787c-49e4-9ce4-4ce8c18021ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93001c8eac8c4d4daab8c73f5e897cdc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:53:54.084839 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4cdaefad-535f-4d77-81c8-97f36b65d93a None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:53:54.086075 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4cdaefad-535f-4d77-81c8-97f36b65d93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:53:54.145985 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1211/2463] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:53:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:53:54.156038 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdaefad-535f-4d77-81c8-97f36b65d93a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:53:54.156422 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1253/2464] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:53:53 2022] DELETE /identity/v3/users/93001c8eac8c4d4daab8c73f5e897cdc => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:53:54.158390 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4cdaefad-535f-4d77-81c8-97f36b65d93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:53:54.216413 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdaefad-535f-4d77-81c8-97f36b65d93a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:53:54.270481 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:53:54.276085 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add1a87-8cde-438a-9508-10176f457377 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:53:54.277213 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add1a87-8cde-438a-9508-10176f457377 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:53:54.277495 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add1a87-8cde-438a-9508-10176f457377 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:53:54.277803 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add1a87-8cde-438a-9508-10176f457377 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:53:54.341751 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add1a87-8cde-438a-9508-10176f457377 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:53:54.343195 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add1a87-8cde-438a-9508-10176f457377 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:53:54.354960 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1212/2465] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:53:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 03:53:54.426949 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686a053-787c-49e4-9ce4-4ce8c18021ff admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:53:54.432096 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5686a053-787c-49e4-9ce4-4ce8c18021ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:53:54.442729 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686a053-787c-49e4-9ce4-4ce8c18021ff admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:53:54.447673 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b3aa2-5a7e-4187-a943-dba1dece8749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:53:54.448345 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b3aa2-5a7e-4187-a943-dba1dece8749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:53:54.448628 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b3aa2-5a7e-4187-a943-dba1dece8749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:53:54.448924 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b3aa2-5a7e-4187-a943-dba1dece8749 admin admin] PATH_INFO: `/v3/projects/8ee2206d83a54ee29e731a1a8e1f84eb` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:53:54.455025 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b3aa2-5a7e-4187-a943-dba1dece8749 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ee2206d83a54ee29e731a1a8e1f84eb)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:53:54.455025 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b3aa2-5a7e-4187-a943-dba1dece8749 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:53:54.557510 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0c4b3aa2-5a7e-4187-a943-dba1dece8749 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ee2206d83a54ee29e731a1a8e1f84eb', 'request_id': 'req-0c4b3aa2-5a7e-4187-a943-dba1dece8749'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:53:54.625184 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0c4b3aa2-5a7e-4187-a943-dba1dece8749 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ee2206d83a54ee29e731a1a8e1f84eb', 'request_id': 'req-0c4b3aa2-5a7e-4187-a943-dba1dece8749'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:53:54.632804 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0c4b3aa2-5a7e-4187-a943-dba1dece8749 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ee2206d83a54ee29e731a1a8e1f84eb', 'request_id': 'req-0c4b3aa2-5a7e-4187-a943-dba1dece8749'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:53:54.645463 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0c4b3aa2-5a7e-4187-a943-dba1dece8749 admin admin] The token cache is being invalidate because project 8ee2206d83a54ee29e731a1a8e1f84eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:53:54.645831 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0c4b3aa2-5a7e-4187-a943-dba1dece8749 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:53:54.646712 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0c4b3aa2-5a7e-4187-a943-dba1dece8749 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:53:54.648753 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1254/2466] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:53:54 2022] DELETE /identity/v3/projects/8ee2206d83a54ee29e731a1a8e1f84eb => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:53:54.654091 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108ad63-8952-4985-a72d-bc1131a1922d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:53:54.654423 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108ad63-8952-4985-a72d-bc1131a1922d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:53:54.654668 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108ad63-8952-4985-a72d-bc1131a1922d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:53:54.675748 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-6108ad63-8952-4985-a72d-bc1131a1922d None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:53:54.676982 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6108ad63-8952-4985-a72d-bc1131a1922d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:53:54.740691 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1213/2467] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:53:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:53:54.805192 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516edb4-493f-44b4-8491-0424b4d08f3a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:53:54.805480 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516edb4-493f-44b4-8491-0424b4d08f3a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:53:54.805789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516edb4-493f-44b4-8491-0424b4d08f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:53:54.830796 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5516edb4-493f-44b4-8491-0424b4d08f3a None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:53:54.832621 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5516edb4-493f-44b4-8491-0424b4d08f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:53:54.842391 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1255/2468] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:53:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:53:54.847117 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108ad63-8952-4985-a72d-bc1131a1922d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:53:54.857767 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108ad63-8952-4985-a72d-bc1131a1922d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:53:54.862894 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8c7b6-ca5d-4405-b400-8b6e1b08b0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:53:54.863461 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8c7b6-ca5d-4405-b400-8b6e1b08b0d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:53:54.863742 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8c7b6-ca5d-4405-b400-8b6e1b08b0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:53:54.864010 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8c7b6-ca5d-4405-b400-8b6e1b08b0d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:53:54.864702 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8c7b6-ca5d-4405-b400-8b6e1b08b0d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:53:54.865602 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8c7b6-ca5d-4405-b400-8b6e1b08b0d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:53:54.867452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8c7b6-ca5d-4405-b400-8b6e1b08b0d2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:53:54.885800 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1214/2469] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:53:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:53:54.887991 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516edb4-493f-44b4-8491-0424b4d08f3a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:53:54.898498 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516edb4-493f-44b4-8491-0424b4d08f3a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:53:54.903874 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae439a-4b50-4db6-8df9-2803612787c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:53:54.907422 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae439a-4b50-4db6-8df9-2803612787c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:53:54.907422 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae439a-4b50-4db6-8df9-2803612787c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:53:54.907422 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae439a-4b50-4db6-8df9-2803612787c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:53:54.907422 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae439a-4b50-4db6-8df9-2803612787c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:53:54.907806 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae439a-4b50-4db6-8df9-2803612787c3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:53:55.012447 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8c7b6-ca5d-4405-b400-8b6e1b08b0d2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:53:55.014220 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6be8c7b6-ca5d-4405-b400-8b6e1b08b0d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:53:55.052624 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1256/2470] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:53:54 2022] POST /identity/v3/projects => generated 385 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:53:55.066733 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae439a-4b50-4db6-8df9-2803612787c3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:53:55.090663 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:53:55.095158 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8c7b6-ca5d-4405-b400-8b6e1b08b0d2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:53:55.118164 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:53:55.141692 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae439a-4b50-4db6-8df9-2803612787c3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:53:55.148923 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2be414-683e-45b7-9f0c-78a13db80fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:53:55.150339 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2be414-683e-45b7-9f0c-78a13db80fdd admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:53:55.150774 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2be414-683e-45b7-9f0c-78a13db80fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:53:55.151196 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2be414-683e-45b7-9f0c-78a13db80fdd admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:53:55.151980 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2be414-683e-45b7-9f0c-78a13db80fdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:53:55.154301 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2be414-683e-45b7-9f0c-78a13db80fdd admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:53:55.175626 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690e82f-4b1b-456d-a065-8678a1a87b2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:53:55.179278 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690e82f-4b1b-456d-a065-8678a1a87b2d service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:53:55.179278 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690e82f-4b1b-456d-a065-8678a1a87b2d service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:53:55.179278 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690e82f-4b1b-456d-a065-8678a1a87b2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:53:55.179278 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7690e82f-4b1b-456d-a065-8678a1a87b2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:53:55.248785 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1257/2471] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:53:55 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:53:55.250141 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2be414-683e-45b7-9f0c-78a13db80fdd admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:53:55.255495 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7690e82f-4b1b-456d-a065-8678a1a87b2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:53:55.257672 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7690e82f-4b1b-456d-a065-8678a1a87b2d service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:53:55.262163 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2be414-683e-45b7-9f0c-78a13db80fdd admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:53:55.268267 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e6e9f-7cfd-46d8-aeda-015f83dccfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:53:55.273898 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e6e9f-7cfd-46d8-aeda-015f83dccfaf admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:53:55.273898 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e6e9f-7cfd-46d8-aeda-015f83dccfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:53:55.273898 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e6e9f-7cfd-46d8-aeda-015f83dccfaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:53:55.274209 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1215/2472] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:53:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 03:53:55.280328 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e6e9f-7cfd-46d8-aeda-015f83dccfaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:53:55.282022 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e6e9f-7cfd-46d8-aeda-015f83dccfaf admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:53:55.302808 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1258/2473] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:53:55.307823 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690e82f-4b1b-456d-a065-8678a1a87b2d service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:53:55.320399 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690e82f-4b1b-456d-a065-8678a1a87b2d service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:53:55.325122 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d99dc-2313-4d0b-a7d3-a01011885c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:53:55.325762 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d99dc-2313-4d0b-a7d3-a01011885c11 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:53:55.326045 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d99dc-2313-4d0b-a7d3-a01011885c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:53:55.326313 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d99dc-2313-4d0b-a7d3-a01011885c11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:53:55.326952 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d99dc-2313-4d0b-a7d3-a01011885c11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:53:55.328642 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d99dc-2313-4d0b-a7d3-a01011885c11 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:53:55.341069 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1216/2474] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:53:55.345562 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e6e9f-7cfd-46d8-aeda-015f83dccfaf admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:53:55.355769 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e6e9f-7cfd-46d8-aeda-015f83dccfaf admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:53:55.360845 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d115949-5b6c-44aa-8d66-471fed8fdb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:53:55.361534 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d115949-5b6c-44aa-8d66-471fed8fdb1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:53:55.361803 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d115949-5b6c-44aa-8d66-471fed8fdb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:53:55.362084 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d115949-5b6c-44aa-8d66-471fed8fdb1c admin admin] PATH_INFO: `/v3/projects/6f7a509357914575bb66a6fb62cce5fe/users/2a9f5df827e74cbd98513755af517251/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:53:55.377890 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d115949-5b6c-44aa-8d66-471fed8fdb1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f7a509357914575bb66a6fb62cce5fe, user_id=2a9f5df827e74cbd98513755af517251, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:53:55.380727 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d115949-5b6c-44aa-8d66-471fed8fdb1c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:53:55.512924 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1259/2475] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:53:55 2022] PUT /identity/v3/projects/6f7a509357914575bb66a6fb62cce5fe/users/2a9f5df827e74cbd98513755af517251/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:53:55.524203 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f64298-8595-4c0e-84bb-167b71e9d356 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:53:55.524491 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f64298-8595-4c0e-84bb-167b71e9d356 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:53:55.525006 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f64298-8595-4c0e-84bb-167b71e9d356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:53:55.545579 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-12f64298-8595-4c0e-84bb-167b71e9d356 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:53:55.557713 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-12f64298-8595-4c0e-84bb-167b71e9d356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:53:55.614936 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1217/2476] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:53:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:53:55.627717 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d115949-5b6c-44aa-8d66-471fed8fdb1c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:53:55.629520 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3d115949-5b6c-44aa-8d66-471fed8fdb1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:53:55.695136 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d115949-5b6c-44aa-8d66-471fed8fdb1c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:53:55.699781 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdddb00d-0a02-47d7-93ae-e9f3d2ceeff5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:53:55.705422 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdddb00d-0a02-47d7-93ae-e9f3d2ceeff5 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:53:55.705422 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdddb00d-0a02-47d7-93ae-e9f3d2ceeff5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:53:55.705422 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdddb00d-0a02-47d7-93ae-e9f3d2ceeff5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:53:55.711413 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdddb00d-0a02-47d7-93ae-e9f3d2ceeff5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:53:55.712869 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdddb00d-0a02-47d7-93ae-e9f3d2ceeff5 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:53:55.723681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1260/2477] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:53:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:54:01.063689 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b02113-def5-4fdb-bc63-f4aa8b7a1fbf None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:01.071041 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b02113-def5-4fdb-bc63-f4aa8b7a1fbf None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:01.071041 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b02113-def5-4fdb-bc63-f4aa8b7a1fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:01.109452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-78b02113-def5-4fdb-bc63-f4aa8b7a1fbf None None] MFA Rules not processed for user `db489eef960941e8a3c187bbedc978d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:54:01.111189 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-78b02113-def5-4fdb-bc63-f4aa8b7a1fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:01.178668 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:01.239009 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1218/2478] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:54:01 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:54:01.245412 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdddb00d-0a02-47d7-93ae-e9f3d2ceeff5 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:01.429797 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdddb00d-0a02-47d7-93ae-e9f3d2ceeff5 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:01.435619 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a7cef-014c-4c18-81aa-0633acf210ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:01.436281 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a7cef-014c-4c18-81aa-0633acf210ca service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:01.436561 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a7cef-014c-4c18-81aa-0633acf210ca service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:01.436893 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a7cef-014c-4c18-81aa-0633acf210ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:01.446895 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a7cef-014c-4c18-81aa-0633acf210ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:01.449316 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a7cef-014c-4c18-81aa-0633acf210ca service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:01.468989 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1261/2479] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:54:01 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:54:04.476010 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914952ca-3f26-418c-98ae-8bcc57c2cb5c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:04.477427 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914952ca-3f26-418c-98ae-8bcc57c2cb5c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:04.477427 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914952ca-3f26-418c-98ae-8bcc57c2cb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:04.523009 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-914952ca-3f26-418c-98ae-8bcc57c2cb5c None None] MFA Rules not processed for user `2a9f5df827e74cbd98513755af517251`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:54:04.524270 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-914952ca-3f26-418c-98ae-8bcc57c2cb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:04.671320 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1219/2480] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:54:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:54:04.678738 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a7cef-014c-4c18-81aa-0633acf210ca service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:04.684089 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:04.698778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a7cef-014c-4c18-81aa-0633acf210ca service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:04.715470 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4275ba3-bac4-4af5-971e-ca4ff6be5f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:04.716765 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4275ba3-bac4-4af5-971e-ca4ff6be5f38 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:04.716765 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4275ba3-bac4-4af5-971e-ca4ff6be5f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:04.717089 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4275ba3-bac4-4af5-971e-ca4ff6be5f38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:04.718200 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4275ba3-bac4-4af5-971e-ca4ff6be5f38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:04.720356 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4275ba3-bac4-4af5-971e-ca4ff6be5f38 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:04.885334 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1262/2481] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:54:04 2022] POST /identity/v3/projects => generated 383 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:54:04.889411 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914952ca-3f26-418c-98ae-8bcc57c2cb5c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:04.903130 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914952ca-3f26-418c-98ae-8bcc57c2cb5c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:04.986548 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ee3e5-fc19-4f68-992b-8f6f9ac0bea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:04.988168 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ee3e5-fc19-4f68-992b-8f6f9ac0bea8 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:04.988530 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ee3e5-fc19-4f68-992b-8f6f9ac0bea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:04.988876 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ee3e5-fc19-4f68-992b-8f6f9ac0bea8 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:04.989679 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ee3e5-fc19-4f68-992b-8f6f9ac0bea8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:04.992246 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ee3e5-fc19-4f68-992b-8f6f9ac0bea8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:05.144460 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1220/2482] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:54:04 2022] POST /identity/v3/users => generated 298 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:54:05.145767 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4275ba3-bac4-4af5-971e-ca4ff6be5f38 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:05.157764 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4275ba3-bac4-4af5-971e-ca4ff6be5f38 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:05.168776 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027a2ce-6ab2-467f-ade9-b556b1d1e90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:05.169414 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027a2ce-6ab2-467f-ade9-b556b1d1e90d admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:05.169899 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027a2ce-6ab2-467f-ade9-b556b1d1e90d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:05.170181 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027a2ce-6ab2-467f-ade9-b556b1d1e90d admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:05.170877 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027a2ce-6ab2-467f-ade9-b556b1d1e90d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:05.173161 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027a2ce-6ab2-467f-ade9-b556b1d1e90d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:05.184029 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1263/2483] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:54:05.190147 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027a2ce-6ab2-467f-ade9-b556b1d1e90d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:05.190420 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02f13f-94d6-48bb-8202-9ea3ee7e753c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:05.191378 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02f13f-94d6-48bb-8202-9ea3ee7e753c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:05.191768 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02f13f-94d6-48bb-8202-9ea3ee7e753c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:05.202356 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027a2ce-6ab2-467f-ade9-b556b1d1e90d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:05.210523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e0c22-f64c-44e8-b3af-5a9dda2c4b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:05.215568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e0c22-f64c-44e8-b3af-5a9dda2c4b30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:05.215568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e0c22-f64c-44e8-b3af-5a9dda2c4b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:05.215568 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e0c22-f64c-44e8-b3af-5a9dda2c4b30 admin admin] PATH_INFO: `/v3/projects/61a84bea63a94ccd931c057f0d87a2d7/users/c1baeebafbc3458e9071cdc9ad14884a/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:05.223509 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2c02f13f-94d6-48bb-8202-9ea3ee7e753c None None] MFA Rules not processed for user `db489eef960941e8a3c187bbedc978d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:54:05.224736 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2c02f13f-94d6-48bb-8202-9ea3ee7e753c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:05.227335 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e0c22-f64c-44e8-b3af-5a9dda2c4b30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61a84bea63a94ccd931c057f0d87a2d7, user_id=c1baeebafbc3458e9071cdc9ad14884a, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:05.230494 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e0c22-f64c-44e8-b3af-5a9dda2c4b30 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:05.291307 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1221/2484] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:54:05 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:54:05.348337 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1264/2485] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:54:05 2022] PUT /identity/v3/projects/61a84bea63a94ccd931c057f0d87a2d7/users/c1baeebafbc3458e9071cdc9ad14884a/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:54:05.352789 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02f13f-94d6-48bb-8202-9ea3ee7e753c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:05.360358 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:05.365311 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02f13f-94d6-48bb-8202-9ea3ee7e753c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:05.442011 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae733af2-f1c8-4d1d-a007-a7553cf7b25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:05.442689 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae733af2-f1c8-4d1d-a007-a7553cf7b25d admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:05.442970 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae733af2-f1c8-4d1d-a007-a7553cf7b25d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:05.443243 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae733af2-f1c8-4d1d-a007-a7553cf7b25d admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:05.443899 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae733af2-f1c8-4d1d-a007-a7553cf7b25d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:05.446211 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae733af2-f1c8-4d1d-a007-a7553cf7b25d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:05.462311 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1222/2486] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:54:05.471375 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e0c22-f64c-44e8-b3af-5a9dda2c4b30 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:05.481447 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e0c22-f64c-44e8-b3af-5a9dda2c4b30 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:05.491248 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d0e72-eb52-43fb-935f-53244231759c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:05.492828 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d0e72-eb52-43fb-935f-53244231759c admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:05.493269 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d0e72-eb52-43fb-935f-53244231759c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:05.493558 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d0e72-eb52-43fb-935f-53244231759c admin admin] PATH_INFO: `/v3/projects/61a84bea63a94ccd931c057f0d87a2d7/users/c1baeebafbc3458e9071cdc9ad14884a/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:05.497209 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d0e72-eb52-43fb-935f-53244231759c admin admin] RBAC: Authorizing `identity:create_grant(project_id=61a84bea63a94ccd931c057f0d87a2d7, user_id=c1baeebafbc3458e9071cdc9ad14884a, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:05.501471 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d0e72-eb52-43fb-935f-53244231759c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:05.521510 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1265/2487] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:54:05 2022] PUT /identity/v3/projects/61a84bea63a94ccd931c057f0d87a2d7/users/c1baeebafbc3458e9071cdc9ad14884a/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:54:05.711105 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae733af2-f1c8-4d1d-a007-a7553cf7b25d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:05.712989 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ae733af2-f1c8-4d1d-a007-a7553cf7b25d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:05.823255 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae733af2-f1c8-4d1d-a007-a7553cf7b25d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:05.881786 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c32c6-172f-443b-8d6c-8da40aaec903 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:05.882958 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c32c6-172f-443b-8d6c-8da40aaec903 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:05.883510 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c32c6-172f-443b-8d6c-8da40aaec903 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:05.884171 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c32c6-172f-443b-8d6c-8da40aaec903 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:05.886513 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-437c32c6-172f-443b-8d6c-8da40aaec903 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:05.898038 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c32c6-172f-443b-8d6c-8da40aaec903 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:05.900091 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c32c6-172f-443b-8d6c-8da40aaec903 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:05.913125 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1223/2488] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:54:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:54:06.630652 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d0e72-eb52-43fb-935f-53244231759c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:06.632564 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4a2d0e72-eb52-43fb-935f-53244231759c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:06.755205 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d0e72-eb52-43fb-935f-53244231759c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:06.760551 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9909fc6-0002-42be-aacf-0a7cb56fca4b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c39fd09bea1a40babc5f629612c6702b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:06.761206 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9909fc6-0002-42be-aacf-0a7cb56fca4b service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:06.761491 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9909fc6-0002-42be-aacf-0a7cb56fca4b service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:06.762190 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9909fc6-0002-42be-aacf-0a7cb56fca4b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:06.764330 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d9909fc6-0002-42be-aacf-0a7cb56fca4b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:06.786040 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9909fc6-0002-42be-aacf-0a7cb56fca4b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:06.786040 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9909fc6-0002-42be-aacf-0a7cb56fca4b service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:06.804203 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1266/2489] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:54:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:54:12.307146 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c32c6-172f-443b-8d6c-8da40aaec903 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:12.328028 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c32c6-172f-443b-8d6c-8da40aaec903 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:12.330336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9909fc6-0002-42be-aacf-0a7cb56fca4b service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:12.335006 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b2acd-f65d-451e-9db6-adde22ceb8a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:12.335841 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b2acd-f65d-451e-9db6-adde22ceb8a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:12.336274 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b2acd-f65d-451e-9db6-adde22ceb8a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:12.336699 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b2acd-f65d-451e-9db6-adde22ceb8a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:12.340327 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dc2b2acd-f65d-451e-9db6-adde22ceb8a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:12.345122 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9909fc6-0002-42be-aacf-0a7cb56fca4b service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:12.352645 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d36cc-55a6-4520-93dd-2036d1060c68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:12.353582 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d36cc-55a6-4520-93dd-2036d1060c68 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:12.354134 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d36cc-55a6-4520-93dd-2036d1060c68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:12.354616 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d36cc-55a6-4520-93dd-2036d1060c68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:12.358808 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-890d36cc-55a6-4520-93dd-2036d1060c68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:12.364074 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b2acd-f65d-451e-9db6-adde22ceb8a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:12.366080 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b2acd-f65d-451e-9db6-adde22ceb8a8 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:12.381922 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1224/2490] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:54:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:54:12.480502 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d36cc-55a6-4520-93dd-2036d1060c68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:12.482569 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d36cc-55a6-4520-93dd-2036d1060c68 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:12.503412 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1267/2491] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:54:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:54:13.997984 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fedcbf-72cf-44f2-9002-ca582921bab9 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:13.997984 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fedcbf-72cf-44f2-9002-ca582921bab9 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:13.997984 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fedcbf-72cf-44f2-9002-ca582921bab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:14.065505 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f9fedcbf-72cf-44f2-9002-ca582921bab9 None None] MFA Rules not processed for user `c1baeebafbc3458e9071cdc9ad14884a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:54:14.068080 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f9fedcbf-72cf-44f2-9002-ca582921bab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:14.143124 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:14.230271 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1225/2492] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:54:13 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:54:14.244076 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d36cc-55a6-4520-93dd-2036d1060c68 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:14.245898 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-890d36cc-55a6-4520-93dd-2036d1060c68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:14.270918 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:14.339010 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d36cc-55a6-4520-93dd-2036d1060c68 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:14.339010 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e556df-ee06-4ca1-81e5-646c4f918e00 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aafb065e06c3481bbed8d98e893766ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:14.339010 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e556df-ee06-4ca1-81e5-646c4f918e00 service glance] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:14.339010 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e556df-ee06-4ca1-81e5-646c4f918e00 service glance] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:14.339420 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e556df-ee06-4ca1-81e5-646c4f918e00 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:14.423232 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e556df-ee06-4ca1-81e5-646c4f918e00 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:14.426468 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e556df-ee06-4ca1-81e5-646c4f918e00 service glance] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:14.436147 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1268/2493] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:54:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:54:14.886026 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b04c90-8ff6-40ad-9559-f89256b8fb70 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:14.886578 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b04c90-8ff6-40ad-9559-f89256b8fb70 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:14.887015 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b04c90-8ff6-40ad-9559-f89256b8fb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:14.912424 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c9b04c90-8ff6-40ad-9559-f89256b8fb70 None None] MFA Rules not processed for user `b0812002d7b14bcb81a42eb380231feb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:54:14.914008 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c9b04c90-8ff6-40ad-9559-f89256b8fb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:14.976651 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1226/2494] 10.222.0.33 () {58 vars in 1009 bytes} [Fri Sep 16 03:54:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:54:15.133824 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e556df-ee06-4ca1-81e5-646c4f918e00 service glance] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:15.135270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-23e556df-ee06-4ca1-81e5-646c4f918e00 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:15.273062 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e556df-ee06-4ca1-81e5-646c4f918e00 service glance] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:15.289409 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a75cc-b28b-49aa-9ab4-0032fedef4ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f784d98d5f440c681f53ae70f6d1cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:15.290536 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a75cc-b28b-49aa-9ab4-0032fedef4ef service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:15.291003 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a75cc-b28b-49aa-9ab4-0032fedef4ef service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:15.291575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a75cc-b28b-49aa-9ab4-0032fedef4ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:15.304963 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a75cc-b28b-49aa-9ab4-0032fedef4ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:15.307588 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a75cc-b28b-49aa-9ab4-0032fedef4ef service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:15.336685 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1269/2495] 10.222.0.33 () {60 vars in 1384 bytes} [Fri Sep 16 03:54:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 03:54:17.678574 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b04c90-8ff6-40ad-9559-f89256b8fb70 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:17.691688 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b04c90-8ff6-40ad-9559-f89256b8fb70 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:17.696363 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1cbcc-23d1-4c0b-9c31-7809e2e5940e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:17.697315 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1cbcc-23d1-4c0b-9c31-7809e2e5940e service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:17.773238 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1cbcc-23d1-4c0b-9c31-7809e2e5940e service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:17.773238 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1cbcc-23d1-4c0b-9c31-7809e2e5940e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:17.773238 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e1b1cbcc-23d1-4c0b-9c31-7809e2e5940e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:17.773238 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b1cbcc-23d1-4c0b-9c31-7809e2e5940e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:17.773238 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b1cbcc-23d1-4c0b-9c31-7809e2e5940e service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:17.773238 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1227/2496] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:54:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:54:19.136277 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a75cc-b28b-49aa-9ab4-0032fedef4ef service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:19.244909 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1cbcc-23d1-4c0b-9c31-7809e2e5940e service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:19.246602 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e1b1cbcc-23d1-4c0b-9c31-7809e2e5940e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:19.262045 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:19.277180 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1cbcc-23d1-4c0b-9c31-7809e2e5940e service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:19.283169 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02904525-9954-4294-a0c0-6fccc7f76dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:19.283500 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a75cc-b28b-49aa-9ab4-0032fedef4ef service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:19.284241 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02904525-9954-4294-a0c0-6fccc7f76dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:19.284771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02904525-9954-4294-a0c0-6fccc7f76dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:19.285213 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02904525-9954-4294-a0c0-6fccc7f76dda admin admin] PATH_INFO: `/v3/users/c04a0f9a09a24473a9377ca68fc638b7` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:19.286547 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02904525-9954-4294-a0c0-6fccc7f76dda admin admin] RBAC: Authorizing `identity:delete_user(user_id=c04a0f9a09a24473a9377ca68fc638b7)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:19.288995 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02904525-9954-4294-a0c0-6fccc7f76dda admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:19.298973 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b70c2-7a2b-4446-906f-1fbdb4cbd735 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:19.299717 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b70c2-7a2b-4446-906f-1fbdb4cbd735 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:19.300039 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b70c2-7a2b-4446-906f-1fbdb4cbd735 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:19.300348 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b70c2-7a2b-4446-906f-1fbdb4cbd735 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:19.304353 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-923b70c2-7a2b-4446-906f-1fbdb4cbd735 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:19.329779 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923b70c2-7a2b-4446-906f-1fbdb4cbd735 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:19.331761 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923b70c2-7a2b-4446-906f-1fbdb4cbd735 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:19.350618 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1270/2497] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:54:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:54:19.704561 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-02904525-9954-4294-a0c0-6fccc7f76dda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c04a0f9a09a24473a9377ca68fc638b7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:19.705103 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-02904525-9954-4294-a0c0-6fccc7f76dda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c04a0f9a09a24473a9377ca68fc638b7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:19.718219 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-02904525-9954-4294-a0c0-6fccc7f76dda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c04a0f9a09a24473a9377ca68fc638b7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:19.754513 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-02904525-9954-4294-a0c0-6fccc7f76dda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c04a0f9a09a24473a9377ca68fc638b7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:19.755609 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-02904525-9954-4294-a0c0-6fccc7f76dda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c04a0f9a09a24473a9377ca68fc638b7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:19.849468 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1228/2498] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:54:19 2022] DELETE /identity/v3/users/c04a0f9a09a24473a9377ca68fc638b7 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:54:20.381889 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b70c2-7a2b-4446-906f-1fbdb4cbd735 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:20.404493 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b70c2-7a2b-4446-906f-1fbdb4cbd735 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:20.539001 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4fec8-55af-42b9-bab0-037acc317b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:20.540252 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4fec8-55af-42b9-bab0-037acc317b15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:20.540740 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4fec8-55af-42b9-bab0-037acc317b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:20.541204 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4fec8-55af-42b9-bab0-037acc317b15 admin admin] PATH_INFO: `/v3/projects/606dddf2fd0248a4b2a7fe0f69835e57` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:20.548898 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee4fec8-55af-42b9-bab0-037acc317b15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=606dddf2fd0248a4b2a7fe0f69835e57)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:20.550971 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee4fec8-55af-42b9-bab0-037acc317b15 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:20.745429 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7ee4fec8-55af-42b9-bab0-037acc317b15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '606dddf2fd0248a4b2a7fe0f69835e57', 'request_id': 'req-7ee4fec8-55af-42b9-bab0-037acc317b15'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:20.836507 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7ee4fec8-55af-42b9-bab0-037acc317b15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '606dddf2fd0248a4b2a7fe0f69835e57', 'request_id': 'req-7ee4fec8-55af-42b9-bab0-037acc317b15'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:20.857335 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7ee4fec8-55af-42b9-bab0-037acc317b15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '606dddf2fd0248a4b2a7fe0f69835e57', 'request_id': 'req-7ee4fec8-55af-42b9-bab0-037acc317b15'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:20.883638 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7ee4fec8-55af-42b9-bab0-037acc317b15 admin admin] The token cache is being invalidate because project 606dddf2fd0248a4b2a7fe0f69835e57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:54:20.884095 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7ee4fec8-55af-42b9-bab0-037acc317b15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:20.884777 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7ee4fec8-55af-42b9-bab0-037acc317b15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:20.887087 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1271/2499] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:54:20 2022] DELETE /identity/v3/projects/606dddf2fd0248a4b2a7fe0f69835e57 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:54:20.893037 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9b579-7b10-4a8b-b3e3-efd4c0619bb4 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:20.894097 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9b579-7b10-4a8b-b3e3-efd4c0619bb4 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:20.898481 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9b579-7b10-4a8b-b3e3-efd4c0619bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:20.938610 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f6c9b579-7b10-4a8b-b3e3-efd4c0619bb4 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:54:20.940752 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f6c9b579-7b10-4a8b-b3e3-efd4c0619bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:20.998868 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:21.069149 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1229/2500] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:54:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:54:21.071172 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbfba2-3aa8-4e76-90e6-b99053394fa9 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:21.071474 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbfba2-3aa8-4e76-90e6-b99053394fa9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:21.071745 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbfba2-3aa8-4e76-90e6-b99053394fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:21.108704 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-98fbfba2-3aa8-4e76-90e6-b99053394fa9 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:54:21.111012 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-98fbfba2-3aa8-4e76-90e6-b99053394fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:21.124296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1272/2501] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:54:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:54:21.129775 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9b579-7b10-4a8b-b3e3-efd4c0619bb4 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:21.145687 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9b579-7b10-4a8b-b3e3-efd4c0619bb4 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:21.155378 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384cdff-468d-4372-83b6-7a6d5ee09231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:21.156014 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384cdff-468d-4372-83b6-7a6d5ee09231 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:21.157283 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384cdff-468d-4372-83b6-7a6d5ee09231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:21.158402 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384cdff-468d-4372-83b6-7a6d5ee09231 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:21.159737 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384cdff-468d-4372-83b6-7a6d5ee09231 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:54:21.159737 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384cdff-468d-4372-83b6-7a6d5ee09231 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:21.161796 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384cdff-468d-4372-83b6-7a6d5ee09231 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:21.183716 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1230/2502] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:54:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:54:21.188829 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fbfba2-3aa8-4e76-90e6-b99053394fa9 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:21.229600 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fbfba2-3aa8-4e76-90e6-b99053394fa9 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:21.268819 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ed681-92e7-4d25-b85a-bc412bebc6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:21.269690 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ed681-92e7-4d25-b85a-bc412bebc6c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:21.269982 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ed681-92e7-4d25-b85a-bc412bebc6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:21.270266 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ed681-92e7-4d25-b85a-bc412bebc6c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:21.270942 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ed681-92e7-4d25-b85a-bc412bebc6c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:21.272957 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ed681-92e7-4d25-b85a-bc412bebc6c8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:21.603951 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1273/2503] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:54:21 2022] POST /identity/v3/projects => generated 375 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:54:21.611032 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384cdff-468d-4372-83b6-7a6d5ee09231 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:21.621311 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384cdff-468d-4372-83b6-7a6d5ee09231 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:21.687180 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313f9c6-e9b6-47ce-952e-9f455951ff4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:21.687720 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313f9c6-e9b6-47ce-952e-9f455951ff4e admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:21.688626 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313f9c6-e9b6-47ce-952e-9f455951ff4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:21.688907 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313f9c6-e9b6-47ce-952e-9f455951ff4e admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:21.694187 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313f9c6-e9b6-47ce-952e-9f455951ff4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:21.694187 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313f9c6-e9b6-47ce-952e-9f455951ff4e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:21.800862 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1231/2504] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:54:21 2022] POST /identity/v3/users => generated 288 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:54:21.805008 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ed681-92e7-4d25-b85a-bc412bebc6c8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:21.816317 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ed681-92e7-4d25-b85a-bc412bebc6c8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:21.834536 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b95a9-9574-42b4-b547-0fafbb47ccd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:21.835468 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b95a9-9574-42b4-b547-0fafbb47ccd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:21.835910 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b95a9-9574-42b4-b547-0fafbb47ccd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:21.836345 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b95a9-9574-42b4-b547-0fafbb47ccd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:21.837150 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b95a9-9574-42b4-b547-0fafbb47ccd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:21.838956 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b95a9-9574-42b4-b547-0fafbb47ccd2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:21.862317 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1274/2505] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:54:21 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:54:21.862627 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313f9c6-e9b6-47ce-952e-9f455951ff4e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:21.877243 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313f9c6-e9b6-47ce-952e-9f455951ff4e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:21.899032 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d16233-c933-449e-b84a-8108df94c289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:21.900872 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d16233-c933-449e-b84a-8108df94c289 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:21.901362 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d16233-c933-449e-b84a-8108df94c289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:21.901916 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d16233-c933-449e-b84a-8108df94c289 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:21.902829 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d16233-c933-449e-b84a-8108df94c289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:21.904703 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d16233-c933-449e-b84a-8108df94c289 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:21.926062 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1232/2506] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:54:21 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:54:21.930169 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b95a9-9574-42b4-b547-0fafbb47ccd2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:21.946174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b95a9-9574-42b4-b547-0fafbb47ccd2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:21.959878 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782dfc6-619c-4fd2-bb4f-79e98b896512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:21.960925 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782dfc6-619c-4fd2-bb4f-79e98b896512 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:21.961408 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782dfc6-619c-4fd2-bb4f-79e98b896512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:21.961934 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782dfc6-619c-4fd2-bb4f-79e98b896512 admin admin] PATH_INFO: `/v3/projects/79249788d761421795b7b6f9fddf388a/users/7507a4e0474441cf84e60ec61723aaec/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:22.001178 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b782dfc6-619c-4fd2-bb4f-79e98b896512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79249788d761421795b7b6f9fddf388a, user_id=7507a4e0474441cf84e60ec61723aaec, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:22.006336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b782dfc6-619c-4fd2-bb4f-79e98b896512 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:22.182918 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1275/2507] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:54:21 2022] PUT /identity/v3/projects/79249788d761421795b7b6f9fddf388a/users/7507a4e0474441cf84e60ec61723aaec/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:54:22.199284 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4890d14-3368-4f63-9e95-7f1cbdd564f5 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:22.199641 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4890d14-3368-4f63-9e95-7f1cbdd564f5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:22.200002 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4890d14-3368-4f63-9e95-7f1cbdd564f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:22.241909 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c4890d14-3368-4f63-9e95-7f1cbdd564f5 None None] MFA Rules not processed for user `7507a4e0474441cf84e60ec61723aaec`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:54:22.245133 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c4890d14-3368-4f63-9e95-7f1cbdd564f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:22.367822 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1233/2508] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:54:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:54:22.372136 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782dfc6-619c-4fd2-bb4f-79e98b896512 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:22.392579 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:22.487930 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782dfc6-619c-4fd2-bb4f-79e98b896512 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:22.494029 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c91e1d-949f-44c9-96d6-550fbc1b9f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:22.494651 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c91e1d-949f-44c9-96d6-550fbc1b9f52 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:22.494931 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c91e1d-949f-44c9-96d6-550fbc1b9f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:22.495208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c91e1d-949f-44c9-96d6-550fbc1b9f52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:22.495862 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c91e1d-949f-44c9-96d6-550fbc1b9f52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:22.498133 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c91e1d-949f-44c9-96d6-550fbc1b9f52 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:22.620657 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1276/2509] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:54:22 2022] POST /identity/v3/projects => generated 377 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:54:22.624017 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4890d14-3368-4f63-9e95-7f1cbdd564f5 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:22.646883 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4890d14-3368-4f63-9e95-7f1cbdd564f5 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:22.728075 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:22.791339 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ef2a3-c8d7-475e-ad19-2611ac969c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:22.791981 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ef2a3-c8d7-475e-ad19-2611ac969c8e admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:22.792308 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ef2a3-c8d7-475e-ad19-2611ac969c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:22.792761 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ef2a3-c8d7-475e-ad19-2611ac969c8e admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:22.793415 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ef2a3-c8d7-475e-ad19-2611ac969c8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:22.795531 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ef2a3-c8d7-475e-ad19-2611ac969c8e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:22.939419 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1234/2510] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:54:22 2022] POST /identity/v3/users => generated 295 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:54:22.941289 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c91e1d-949f-44c9-96d6-550fbc1b9f52 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:22.953680 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c91e1d-949f-44c9-96d6-550fbc1b9f52 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:22.970863 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f33f14-1562-4fa7-b473-5f4c085bc0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:22.971539 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f33f14-1562-4fa7-b473-5f4c085bc0b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:22.972154 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f33f14-1562-4fa7-b473-5f4c085bc0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:22.972621 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f33f14-1562-4fa7-b473-5f4c085bc0b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:22.973935 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f33f14-1562-4fa7-b473-5f4c085bc0b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:22.988407 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f33f14-1562-4fa7-b473-5f4c085bc0b8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:23.017106 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1277/2511] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:54:22 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:54:23.021430 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ef2a3-c8d7-475e-ad19-2611ac969c8e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:23.039267 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ef2a3-c8d7-475e-ad19-2611ac969c8e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:23.054544 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf29bdf-9acd-4f06-988c-0381a954476f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:23.056500 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf29bdf-9acd-4f06-988c-0381a954476f admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:23.057386 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf29bdf-9acd-4f06-988c-0381a954476f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:23.059020 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf29bdf-9acd-4f06-988c-0381a954476f admin admin] PATH_INFO: `/v3/projects/479c07b6fb674c98ab918e8fe7afe144/users/a44b11682a6d4fcf9012fb75f738de24/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:23.082149 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf29bdf-9acd-4f06-988c-0381a954476f admin admin] RBAC: Authorizing `identity:create_grant(project_id=479c07b6fb674c98ab918e8fe7afe144, user_id=a44b11682a6d4fcf9012fb75f738de24, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:23.085244 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf29bdf-9acd-4f06-988c-0381a954476f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:23.227332 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1235/2512] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:54:23 2022] PUT /identity/v3/projects/479c07b6fb674c98ab918e8fe7afe144/users/a44b11682a6d4fcf9012fb75f738de24/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:54:23.231303 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f33f14-1562-4fa7-b473-5f4c085bc0b8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:23.249596 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f33f14-1562-4fa7-b473-5f4c085bc0b8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:23.393133 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4a330-30c5-4e47-a6ff-4e21b54ef9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:23.394060 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4a330-30c5-4e47-a6ff-4e21b54ef9ac admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:23.394353 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4a330-30c5-4e47-a6ff-4e21b54ef9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:23.394628 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4a330-30c5-4e47-a6ff-4e21b54ef9ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:23.395332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4a330-30c5-4e47-a6ff-4e21b54ef9ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:23.398327 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4a330-30c5-4e47-a6ff-4e21b54ef9ac admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:23.420493 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1278/2513] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:54:23.422154 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf29bdf-9acd-4f06-988c-0381a954476f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:23.441965 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf29bdf-9acd-4f06-988c-0381a954476f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:23.455079 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370fb02-fc59-45ab-851b-8a40ae5a8fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:23.457855 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370fb02-fc59-45ab-851b-8a40ae5a8fb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:23.457855 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370fb02-fc59-45ab-851b-8a40ae5a8fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:23.457855 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370fb02-fc59-45ab-851b-8a40ae5a8fb9 admin admin] PATH_INFO: `/v3/projects/479c07b6fb674c98ab918e8fe7afe144/users/a44b11682a6d4fcf9012fb75f738de24/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:23.458931 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e370fb02-fc59-45ab-851b-8a40ae5a8fb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=479c07b6fb674c98ab918e8fe7afe144, user_id=a44b11682a6d4fcf9012fb75f738de24, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:23.461548 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e370fb02-fc59-45ab-851b-8a40ae5a8fb9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:23.496121 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1236/2514] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:54:23 2022] PUT /identity/v3/projects/479c07b6fb674c98ab918e8fe7afe144/users/a44b11682a6d4fcf9012fb75f738de24/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:54:23.507476 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ad84f-e279-4a31-a99c-8cb403ef9950 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:23.507804 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ad84f-e279-4a31-a99c-8cb403ef9950 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:23.508080 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ad84f-e279-4a31-a99c-8cb403ef9950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:23.573795 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-af4ad84f-e279-4a31-a99c-8cb403ef9950 None None] MFA Rules not processed for user `a44b11682a6d4fcf9012fb75f738de24`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:54:23.580414 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-af4ad84f-e279-4a31-a99c-8cb403ef9950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:23.689670 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1279/2515] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:54:23 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:54:23.714911 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370fb02-fc59-45ab-851b-8a40ae5a8fb9 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:23.717024 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e370fb02-fc59-45ab-851b-8a40ae5a8fb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:23.810000 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370fb02-fc59-45ab-851b-8a40ae5a8fb9 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:23.814701 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78747728-5453-46cf-b81f-b0ce898140d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:23.815567 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78747728-5453-46cf-b81f-b0ce898140d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:23.816005 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78747728-5453-46cf-b81f-b0ce898140d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:23.816448 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78747728-5453-46cf-b81f-b0ce898140d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:23.869480 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ad84f-e279-4a31-a99c-8cb403ef9950 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:23.871364 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-af4ad84f-e279-4a31-a99c-8cb403ef9950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:23.892041 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:23.976401 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78747728-5453-46cf-b81f-b0ce898140d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:23.979101 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78747728-5453-46cf-b81f-b0ce898140d8 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:24.018050 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1237/2516] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:54:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:54:24.019423 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ad84f-e279-4a31-a99c-8cb403ef9950 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:24.031095 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd7562-2bc8-4bd0-845a-ccdb64a28c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:24.031927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd7562-2bc8-4bd0-845a-ccdb64a28c8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:24.032962 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd7562-2bc8-4bd0-845a-ccdb64a28c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:24.034316 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd7562-2bc8-4bd0-845a-ccdb64a28c8d admin admin] PATH_INFO: `/v3/users/6efa7a654e2d4e3e9066aa361460729d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:24.037930 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd7562-2bc8-4bd0-845a-ccdb64a28c8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6efa7a654e2d4e3e9066aa361460729d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:24.040234 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd7562-2bc8-4bd0-845a-ccdb64a28c8d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:24.326701 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6ffd7562-2bc8-4bd0-845a-ccdb64a28c8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6efa7a654e2d4e3e9066aa361460729d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:24.327773 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6ffd7562-2bc8-4bd0-845a-ccdb64a28c8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6efa7a654e2d4e3e9066aa361460729d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:24.343611 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6ffd7562-2bc8-4bd0-845a-ccdb64a28c8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6efa7a654e2d4e3e9066aa361460729d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:24.369967 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6ffd7562-2bc8-4bd0-845a-ccdb64a28c8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6efa7a654e2d4e3e9066aa361460729d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:24.371250 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6ffd7562-2bc8-4bd0-845a-ccdb64a28c8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6efa7a654e2d4e3e9066aa361460729d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:24.461769 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1280/2517] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:54:23 2022] DELETE /identity/v3/users/6efa7a654e2d4e3e9066aa361460729d => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:54:24.889088 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78747728-5453-46cf-b81f-b0ce898140d8 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:24.904508 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78747728-5453-46cf-b81f-b0ce898140d8 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:25.004532 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:25.035603 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa438a-747e-48b8-a3f5-6720c13728e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:25.037871 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa438a-747e-48b8-a3f5-6720c13728e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:25.037871 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa438a-747e-48b8-a3f5-6720c13728e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:25.037871 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa438a-747e-48b8-a3f5-6720c13728e8 admin admin] PATH_INFO: `/v3/projects/f6d1a4d6749a484f8cb0f78bc77b179c` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:25.039068 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa438a-747e-48b8-a3f5-6720c13728e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6d1a4d6749a484f8cb0f78bc77b179c)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:25.041246 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa438a-747e-48b8-a3f5-6720c13728e8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:25.235450 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ddaa438a-747e-48b8-a3f5-6720c13728e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6d1a4d6749a484f8cb0f78bc77b179c', 'request_id': 'req-ddaa438a-747e-48b8-a3f5-6720c13728e8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:25.330132 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ddaa438a-747e-48b8-a3f5-6720c13728e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6d1a4d6749a484f8cb0f78bc77b179c', 'request_id': 'req-ddaa438a-747e-48b8-a3f5-6720c13728e8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:25.346467 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ddaa438a-747e-48b8-a3f5-6720c13728e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6d1a4d6749a484f8cb0f78bc77b179c', 'request_id': 'req-ddaa438a-747e-48b8-a3f5-6720c13728e8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:25.378008 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ddaa438a-747e-48b8-a3f5-6720c13728e8 admin admin] The token cache is being invalidate because project f6d1a4d6749a484f8cb0f78bc77b179c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:54:25.378440 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ddaa438a-747e-48b8-a3f5-6720c13728e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:25.380775 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ddaa438a-747e-48b8-a3f5-6720c13728e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:25.388807 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da8ea8-2194-430b-ac69-180fa53ae330 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:25.389383 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da8ea8-2194-430b-ac69-180fa53ae330 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:25.389383 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da8ea8-2194-430b-ac69-180fa53ae330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:25.393060 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1238/2518] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:54:24 2022] DELETE /identity/v3/projects/f6d1a4d6749a484f8cb0f78bc77b179c => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:54:25.430119 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-72da8ea8-2194-430b-ac69-180fa53ae330 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:54:25.431687 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-72da8ea8-2194-430b-ac69-180fa53ae330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:25.534223 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1281/2519] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:54:25.544854 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c189660-2fa2-4f63-a0b0-3bd530a182cb None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:25.545196 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c189660-2fa2-4f63-a0b0-3bd530a182cb None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:25.545414 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c189660-2fa2-4f63-a0b0-3bd530a182cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:25.576800 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3c189660-2fa2-4f63-a0b0-3bd530a182cb None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:54:25.584581 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3c189660-2fa2-4f63-a0b0-3bd530a182cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:25.599479 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1239/2520] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:54:25.603421 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da8ea8-2194-430b-ac69-180fa53ae330 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:25.615073 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da8ea8-2194-430b-ac69-180fa53ae330 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:25.627000 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d42290-dc89-4e84-90ef-a5f3cec7a91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:25.627655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d42290-dc89-4e84-90ef-a5f3cec7a91f admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:25.627939 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d42290-dc89-4e84-90ef-a5f3cec7a91f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:25.628216 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d42290-dc89-4e84-90ef-a5f3cec7a91f admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:25.628924 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d42290-dc89-4e84-90ef-a5f3cec7a91f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:54:25.629232 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d42290-dc89-4e84-90ef-a5f3cec7a91f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:25.630965 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d42290-dc89-4e84-90ef-a5f3cec7a91f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:25.651905 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1282/2521] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:54:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:54:25.656393 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c189660-2fa2-4f63-a0b0-3bd530a182cb None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:25.667975 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c189660-2fa2-4f63-a0b0-3bd530a182cb None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:25.687458 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ee94a-7e24-4814-8336-472f4321e204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:25.687458 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ee94a-7e24-4814-8336-472f4321e204 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:25.687458 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ee94a-7e24-4814-8336-472f4321e204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:25.687458 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ee94a-7e24-4814-8336-472f4321e204 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:25.688559 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ee94a-7e24-4814-8336-472f4321e204 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:25.688559 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ee94a-7e24-4814-8336-472f4321e204 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:25.870830 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1240/2522] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:54:25 2022] POST /identity/v3/projects => generated 381 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:54:25.888963 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d42290-dc89-4e84-90ef-a5f3cec7a91f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:25.888963 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d42290-dc89-4e84-90ef-a5f3cec7a91f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:25.905120 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:25.915127 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ee94a-7e24-4814-8336-472f4321e204 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:25.916963 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-966ee94a-7e24-4814-8336-472f4321e204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:25.960949 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1ba27-ef1e-4064-a4d4-dca5ef17ade0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:25.961710 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1ba27-ef1e-4064-a4d4-dca5ef17ade0 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:25.962060 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1ba27-ef1e-4064-a4d4-dca5ef17ade0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:25.962405 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1ba27-ef1e-4064-a4d4-dca5ef17ade0 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:25.963122 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab1ba27-ef1e-4064-a4d4-dca5ef17ade0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:25.966133 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab1ba27-ef1e-4064-a4d4-dca5ef17ade0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:25.981275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ee94a-7e24-4814-8336-472f4321e204 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:25.986663 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae3c33-c08a-40ee-8dcc-5bf3a8f564c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:25.987631 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae3c33-c08a-40ee-8dcc-5bf3a8f564c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:25.988094 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae3c33-c08a-40ee-8dcc-5bf3a8f564c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:25.988606 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae3c33-c08a-40ee-8dcc-5bf3a8f564c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:25.990805 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5aae3c33-c08a-40ee-8dcc-5bf3a8f564c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:26.052415 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:26.065295 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae3c33-c08a-40ee-8dcc-5bf3a8f564c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:26.071400 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae3c33-c08a-40ee-8dcc-5bf3a8f564c8 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:26.078063 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1241/2523] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:54:25 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:54:26.433400 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1283/2524] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:54:25 2022] POST /identity/v3/users => generated 291 bytes in 558 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:54:26.437851 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae3c33-c08a-40ee-8dcc-5bf3a8f564c8 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:26.450540 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae3c33-c08a-40ee-8dcc-5bf3a8f564c8 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:26.455423 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d713b-ae4d-4d77-b7c3-6701c5283d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:26.456220 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d713b-ae4d-4d77-b7c3-6701c5283d0e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:26.456940 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d713b-ae4d-4d77-b7c3-6701c5283d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:26.457224 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d713b-ae4d-4d77-b7c3-6701c5283d0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:26.457986 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d713b-ae4d-4d77-b7c3-6701c5283d0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:26.467362 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d713b-ae4d-4d77-b7c3-6701c5283d0e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:26.470494 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1242/2525] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:54:26.482032 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1ba27-ef1e-4064-a4d4-dca5ef17ade0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:26.485937 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1ba27-ef1e-4064-a4d4-dca5ef17ade0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:26.492348 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a075a19-9e0b-4ca8-b15a-091ccb6dab87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:26.492895 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a075a19-9e0b-4ca8-b15a-091ccb6dab87 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:26.493212 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a075a19-9e0b-4ca8-b15a-091ccb6dab87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:26.493597 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a075a19-9e0b-4ca8-b15a-091ccb6dab87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:26.494204 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a075a19-9e0b-4ca8-b15a-091ccb6dab87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:26.495853 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a075a19-9e0b-4ca8-b15a-091ccb6dab87 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:26.507822 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1284/2526] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:54:26.512001 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d713b-ae4d-4d77-b7c3-6701c5283d0e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:26.523357 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d713b-ae4d-4d77-b7c3-6701c5283d0e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:26.528506 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa51b6-ef4a-4bed-979b-3412f96f9f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:26.530861 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa51b6-ef4a-4bed-979b-3412f96f9f56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:26.530861 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa51b6-ef4a-4bed-979b-3412f96f9f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:26.530861 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa51b6-ef4a-4bed-979b-3412f96f9f56 admin admin] PATH_INFO: `/v3/projects/e85a7ab1b6c24171a98d3fdf2d348b49/users/5e9c67b65a444dc19edf71b669451529/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:26.548732 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa51b6-ef4a-4bed-979b-3412f96f9f56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e85a7ab1b6c24171a98d3fdf2d348b49, user_id=5e9c67b65a444dc19edf71b669451529, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:26.551580 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa51b6-ef4a-4bed-979b-3412f96f9f56 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:26.686368 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1243/2527] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:54:26 2022] PUT /identity/v3/projects/e85a7ab1b6c24171a98d3fdf2d348b49/users/5e9c67b65a444dc19edf71b669451529/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:54:26.696316 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d7774-fb7d-4645-bcba-c21790dd7791 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:26.696604 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d7774-fb7d-4645-bcba-c21790dd7791 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:26.696883 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d7774-fb7d-4645-bcba-c21790dd7791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:26.732262 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b19d7774-fb7d-4645-bcba-c21790dd7791 None None] MFA Rules not processed for user `5e9c67b65a444dc19edf71b669451529`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:54:26.733665 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b19d7774-fb7d-4645-bcba-c21790dd7791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:26.811661 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1285/2528] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:54:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:54:26.816471 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa51b6-ef4a-4bed-979b-3412f96f9f56 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:26.898893 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa51b6-ef4a-4bed-979b-3412f96f9f56 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:26.904132 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9b8e0-c09d-4f77-846c-8d7a1308c90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:26.904132 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9b8e0-c09d-4f77-846c-8d7a1308c90d admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:26.904583 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9b8e0-c09d-4f77-846c-8d7a1308c90d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:26.904888 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9b8e0-c09d-4f77-846c-8d7a1308c90d admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:26.905532 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9b8e0-c09d-4f77-846c-8d7a1308c90d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:26.908025 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9b8e0-c09d-4f77-846c-8d7a1308c90d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:27.027563 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1244/2529] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:54:26 2022] POST /identity/v3/projects => generated 381 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:54:27.031555 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d7774-fb7d-4645-bcba-c21790dd7791 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:27.043847 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d7774-fb7d-4645-bcba-c21790dd7791 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:27.111482 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e1377-081f-42ab-952b-e3322a598baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:27.111482 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e1377-081f-42ab-952b-e3322a598baf admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:27.111482 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e1377-081f-42ab-952b-e3322a598baf admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:27.111900 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e1377-081f-42ab-952b-e3322a598baf admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:27.112594 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e1377-081f-42ab-952b-e3322a598baf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:27.114705 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e1377-081f-42ab-952b-e3322a598baf admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:27.218267 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1286/2530] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:54:27 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:54:27.222915 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9b8e0-c09d-4f77-846c-8d7a1308c90d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:27.237974 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9b8e0-c09d-4f77-846c-8d7a1308c90d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:27.244711 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba5f1a-bd96-4037-adfb-719f125d1087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:27.245452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba5f1a-bd96-4037-adfb-719f125d1087 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:27.246070 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba5f1a-bd96-4037-adfb-719f125d1087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:27.246450 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba5f1a-bd96-4037-adfb-719f125d1087 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:27.247215 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba5f1a-bd96-4037-adfb-719f125d1087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:27.248897 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba5f1a-bd96-4037-adfb-719f125d1087 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:27.268261 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1245/2531] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:54:27.269209 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e1377-081f-42ab-952b-e3322a598baf admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:27.288583 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e1377-081f-42ab-952b-e3322a598baf admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:27.294248 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956da118-9138-43e7-bda6-471ca343e7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:27.294963 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956da118-9138-43e7-bda6-471ca343e7a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:27.294963 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956da118-9138-43e7-bda6-471ca343e7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:27.295817 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956da118-9138-43e7-bda6-471ca343e7a0 admin admin] PATH_INFO: `/v3/projects/6518e690d94b477990a450f166e344db/users/ed6d98e4354046729b344c1c300e3870/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:27.306785 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:27.315513 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956da118-9138-43e7-bda6-471ca343e7a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6518e690d94b477990a450f166e344db, user_id=ed6d98e4354046729b344c1c300e3870, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:27.317062 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956da118-9138-43e7-bda6-471ca343e7a0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:27.450381 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1287/2532] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:54:27 2022] PUT /identity/v3/projects/6518e690d94b477990a450f166e344db/users/ed6d98e4354046729b344c1c300e3870/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:54:27.454891 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba5f1a-bd96-4037-adfb-719f125d1087 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:27.468280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba5f1a-bd96-4037-adfb-719f125d1087 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:27.592684 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb8f74-bddd-47e6-b2ae-aadb7512eb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:27.593621 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb8f74-bddd-47e6-b2ae-aadb7512eb5e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:27.594023 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb8f74-bddd-47e6-b2ae-aadb7512eb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:27.595173 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb8f74-bddd-47e6-b2ae-aadb7512eb5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:27.595955 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeb8f74-bddd-47e6-b2ae-aadb7512eb5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:27.597758 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeb8f74-bddd-47e6-b2ae-aadb7512eb5e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:27.615657 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1246/2533] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:54:27.616964 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956da118-9138-43e7-bda6-471ca343e7a0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:27.645028 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956da118-9138-43e7-bda6-471ca343e7a0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:27.652145 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf42a0-a62c-4eda-990b-f064c273beae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:27.652840 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf42a0-a62c-4eda-990b-f064c273beae admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:27.653117 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf42a0-a62c-4eda-990b-f064c273beae admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:27.653382 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf42a0-a62c-4eda-990b-f064c273beae admin admin] PATH_INFO: `/v3/projects/6518e690d94b477990a450f166e344db/users/ed6d98e4354046729b344c1c300e3870/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:27.655374 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf42a0-a62c-4eda-990b-f064c273beae admin admin] RBAC: Authorizing `identity:create_grant(project_id=6518e690d94b477990a450f166e344db, user_id=ed6d98e4354046729b344c1c300e3870, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:27.659244 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf42a0-a62c-4eda-990b-f064c273beae admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:27.670581 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1288/2534] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:54:27 2022] PUT /identity/v3/projects/6518e690d94b477990a450f166e344db/users/ed6d98e4354046729b344c1c300e3870/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:54:27.682965 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5024c7-fbf8-4848-b850-786206a806d7 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:27.689556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5024c7-fbf8-4848-b850-786206a806d7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:27.689556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5024c7-fbf8-4848-b850-786206a806d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:27.730096 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-fc5024c7-fbf8-4848-b850-786206a806d7 None None] MFA Rules not processed for user `ed6d98e4354046729b344c1c300e3870`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:54:27.737705 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fc5024c7-fbf8-4848-b850-786206a806d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:27.765009 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:27.846077 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1247/2535] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:54:27 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:54:27.858101 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf42a0-a62c-4eda-990b-f064c273beae admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:28.056327 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf42a0-a62c-4eda-990b-f064c273beae admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:28.060683 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257d135-ee96-4771-8ee5-6be68533acdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:28.061314 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257d135-ee96-4771-8ee5-6be68533acdb service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:28.061573 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257d135-ee96-4771-8ee5-6be68533acdb service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:28.061897 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257d135-ee96-4771-8ee5-6be68533acdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:28.074560 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7257d135-ee96-4771-8ee5-6be68533acdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:28.076104 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7257d135-ee96-4771-8ee5-6be68533acdb service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:28.090310 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1289/2536] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:54:27 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:54:28.338558 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5024c7-fbf8-4848-b850-786206a806d7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:28.349157 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5024c7-fbf8-4848-b850-786206a806d7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:28.362229 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a393d2-e34b-4436-9971-d6a5c2ba3301 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:28.362229 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a393d2-e34b-4436-9971-d6a5c2ba3301 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:28.362229 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a393d2-e34b-4436-9971-d6a5c2ba3301 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:28.362229 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a393d2-e34b-4436-9971-d6a5c2ba3301 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:28.427426 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a393d2-e34b-4436-9971-d6a5c2ba3301 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:28.428827 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a393d2-e34b-4436-9971-d6a5c2ba3301 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:28.441112 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1248/2537] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:54:28 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:54:30.989052 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257d135-ee96-4771-8ee5-6be68533acdb service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:30.989052 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7257d135-ee96-4771-8ee5-6be68533acdb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:31.059621 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257d135-ee96-4771-8ee5-6be68533acdb service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:31.065032 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f1afa6-40a3-4a7f-a37f-a37ca81ccfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:31.065711 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1afa6-40a3-4a7f-a37f-a37ca81ccfbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:31.065996 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1afa6-40a3-4a7f-a37f-a37ca81ccfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:31.066270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1afa6-40a3-4a7f-a37f-a37ca81ccfbb admin admin] PATH_INFO: `/v3/users/7507a4e0474441cf84e60ec61723aaec` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:31.067456 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f1afa6-40a3-4a7f-a37f-a37ca81ccfbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7507a4e0474441cf84e60ec61723aaec)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:31.069473 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f1afa6-40a3-4a7f-a37f-a37ca81ccfbb admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:31.195531 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01d400-ba19-46d7-a135-75dab61b1a45 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:31.196158 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01d400-ba19-46d7-a135-75dab61b1a45 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:31.196158 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01d400-ba19-46d7-a135-75dab61b1a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:31.216756 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-5b01d400-ba19-46d7-a135-75dab61b1a45 None None] MFA Rules not processed for user `2a9f5df827e74cbd98513755af517251`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:54:31.217980 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5b01d400-ba19-46d7-a135-75dab61b1a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:31.278466 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1249/2538] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:54:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:54:31.297120 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-14f1afa6-40a3-4a7f-a37f-a37ca81ccfbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7507a4e0474441cf84e60ec61723aaec'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:31.302505 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-14f1afa6-40a3-4a7f-a37f-a37ca81ccfbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7507a4e0474441cf84e60ec61723aaec'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:31.305650 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-14f1afa6-40a3-4a7f-a37f-a37ca81ccfbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7507a4e0474441cf84e60ec61723aaec'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:31.319356 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-14f1afa6-40a3-4a7f-a37f-a37ca81ccfbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7507a4e0474441cf84e60ec61723aaec'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:31.320384 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-14f1afa6-40a3-4a7f-a37f-a37ca81ccfbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7507a4e0474441cf84e60ec61723aaec'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:31.324178 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:31.425433 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1290/2539] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:54:30 2022] DELETE /identity/v3/users/7507a4e0474441cf84e60ec61723aaec => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:54:31.429999 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d28b4-9c90-420f-9392-48462e4a40b2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:31.430311 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d28b4-9c90-420f-9392-48462e4a40b2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:31.430585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d28b4-9c90-420f-9392-48462e4a40b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:31.449373 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c10d28b4-9c90-420f-9392-48462e4a40b2 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:54:31.450611 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c10d28b4-9c90-420f-9392-48462e4a40b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:31.499373 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:31.511286 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1250/2540] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:54:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:54:31.521600 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f1afa6-40a3-4a7f-a37f-a37ca81ccfbb admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:31.525033 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-14f1afa6-40a3-4a7f-a37f-a37ca81ccfbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:31.539990 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d28b4-9c90-420f-9392-48462e4a40b2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:31.541362 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c10d28b4-9c90-420f-9392-48462e4a40b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:31.586615 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f1afa6-40a3-4a7f-a37f-a37ca81ccfbb admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:31.590383 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed4812-fddc-4e5a-9647-098d737c8c8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:31.590990 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed4812-fddc-4e5a-9647-098d737c8c8a service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:31.591342 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed4812-fddc-4e5a-9647-098d737c8c8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:31.591539 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed4812-fddc-4e5a-9647-098d737c8c8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:31.600150 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d28b4-9c90-420f-9392-48462e4a40b2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:31.601089 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed4812-fddc-4e5a-9647-098d737c8c8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:31.602635 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed4812-fddc-4e5a-9647-098d737c8c8a service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:31.604017 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e0348-13a8-409e-8fd9-b0fc28d35b82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:31.604621 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e0348-13a8-409e-8fd9-b0fc28d35b82 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:31.604899 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e0348-13a8-409e-8fd9-b0fc28d35b82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:31.605169 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e0348-13a8-409e-8fd9-b0fc28d35b82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:31.607153 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ce9e0348-13a8-409e-8fd9-b0fc28d35b82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:31.612687 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1291/2541] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:54:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:54:31.617466 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e0348-13a8-409e-8fd9-b0fc28d35b82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:31.618992 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e0348-13a8-409e-8fd9-b0fc28d35b82 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:31.627280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1251/2542] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:54:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 03:54:32.148160 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed4812-fddc-4e5a-9647-098d737c8c8a service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:32.149657 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-50ed4812-fddc-4e5a-9647-098d737c8c8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:32.177871 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed4812-fddc-4e5a-9647-098d737c8c8a service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:32.182815 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48a11b-cfcb-417c-bbed-c1e60e86af28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:32.183511 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48a11b-cfcb-417c-bbed-c1e60e86af28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:32.183852 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48a11b-cfcb-417c-bbed-c1e60e86af28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:32.184203 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48a11b-cfcb-417c-bbed-c1e60e86af28 admin admin] PATH_INFO: `/v3/projects/79249788d761421795b7b6f9fddf388a` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:32.185651 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48a11b-cfcb-417c-bbed-c1e60e86af28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79249788d761421795b7b6f9fddf388a)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:32.188528 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48a11b-cfcb-417c-bbed-c1e60e86af28 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:32.322578 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5c48a11b-cfcb-417c-bbed-c1e60e86af28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79249788d761421795b7b6f9fddf388a', 'request_id': 'req-5c48a11b-cfcb-417c-bbed-c1e60e86af28'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:32.390323 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5c48a11b-cfcb-417c-bbed-c1e60e86af28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79249788d761421795b7b6f9fddf388a', 'request_id': 'req-5c48a11b-cfcb-417c-bbed-c1e60e86af28'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:32.397744 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5c48a11b-cfcb-417c-bbed-c1e60e86af28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79249788d761421795b7b6f9fddf388a', 'request_id': 'req-5c48a11b-cfcb-417c-bbed-c1e60e86af28'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:32.408216 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5c48a11b-cfcb-417c-bbed-c1e60e86af28 admin admin] The token cache is being invalidate because project 79249788d761421795b7b6f9fddf388a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:54:32.408501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5c48a11b-cfcb-417c-bbed-c1e60e86af28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:32.409121 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5c48a11b-cfcb-417c-bbed-c1e60e86af28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:32.410676 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1292/2543] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:54:32 2022] DELETE /identity/v3/projects/79249788d761421795b7b6f9fddf388a => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:54:32.414945 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e0348-13a8-409e-8fd9-b0fc28d35b82 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:32.430039 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e0348-13a8-409e-8fd9-b0fc28d35b82 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:32.487563 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5dbe4-40c6-4ae6-97e7-96807ad28c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:32.488195 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5dbe4-40c6-4ae6-97e7-96807ad28c32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:32.488480 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5dbe4-40c6-4ae6-97e7-96807ad28c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:32.488757 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5dbe4-40c6-4ae6-97e7-96807ad28c32 admin admin] PATH_INFO: `/v3/users/a44b11682a6d4fcf9012fb75f738de24` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:32.489917 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5dbe4-40c6-4ae6-97e7-96807ad28c32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a44b11682a6d4fcf9012fb75f738de24)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:32.491862 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5dbe4-40c6-4ae6-97e7-96807ad28c32 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:32.736451 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1fb5dbe4-40c6-4ae6-97e7-96807ad28c32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a44b11682a6d4fcf9012fb75f738de24'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:32.737193 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1fb5dbe4-40c6-4ae6-97e7-96807ad28c32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a44b11682a6d4fcf9012fb75f738de24'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:32.744548 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1fb5dbe4-40c6-4ae6-97e7-96807ad28c32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a44b11682a6d4fcf9012fb75f738de24'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:32.758668 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1fb5dbe4-40c6-4ae6-97e7-96807ad28c32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a44b11682a6d4fcf9012fb75f738de24'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:32.759425 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1fb5dbe4-40c6-4ae6-97e7-96807ad28c32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a44b11682a6d4fcf9012fb75f738de24'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:32.854163 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1252/2544] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:54:32 2022] DELETE /identity/v3/users/a44b11682a6d4fcf9012fb75f738de24 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:54:33.317482 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48a11b-cfcb-417c-bbed-c1e60e86af28 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:33.318967 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5c48a11b-cfcb-417c-bbed-c1e60e86af28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:33.333188 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48a11b-cfcb-417c-bbed-c1e60e86af28 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:33.389583 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9986e-4686-41e8-b232-3b6519e40222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:33.390266 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9986e-4686-41e8-b232-3b6519e40222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:33.390599 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9986e-4686-41e8-b232-3b6519e40222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:33.390868 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9986e-4686-41e8-b232-3b6519e40222 admin admin] PATH_INFO: `/v3/projects/479c07b6fb674c98ab918e8fe7afe144` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:33.392481 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9986e-4686-41e8-b232-3b6519e40222 admin admin] RBAC: Authorizing `identity:delete_project(project_id=479c07b6fb674c98ab918e8fe7afe144)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:33.394399 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9986e-4686-41e8-b232-3b6519e40222 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:33.419114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:33.558324 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-dcf9986e-4686-41e8-b232-3b6519e40222 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '479c07b6fb674c98ab918e8fe7afe144', 'request_id': 'req-dcf9986e-4686-41e8-b232-3b6519e40222'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:33.636365 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-dcf9986e-4686-41e8-b232-3b6519e40222 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '479c07b6fb674c98ab918e8fe7afe144', 'request_id': 'req-dcf9986e-4686-41e8-b232-3b6519e40222'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:33.644227 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-dcf9986e-4686-41e8-b232-3b6519e40222 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '479c07b6fb674c98ab918e8fe7afe144', 'request_id': 'req-dcf9986e-4686-41e8-b232-3b6519e40222'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:33.654431 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-dcf9986e-4686-41e8-b232-3b6519e40222 admin admin] The token cache is being invalidate because project 479c07b6fb674c98ab918e8fe7afe144 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:54:33.654717 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-dcf9986e-4686-41e8-b232-3b6519e40222 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:33.655353 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-dcf9986e-4686-41e8-b232-3b6519e40222 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:33.656812 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1293/2545] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:54:33 2022] DELETE /identity/v3/projects/479c07b6fb674c98ab918e8fe7afe144 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:54:33.661790 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b100868-ace6-44b4-8e63-f2c9614bd405 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:33.662267 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b100868-ace6-44b4-8e63-f2c9614bd405 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:33.662380 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b100868-ace6-44b4-8e63-f2c9614bd405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:33.682361 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1b100868-ace6-44b4-8e63-f2c9614bd405 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:54:33.683582 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1b100868-ace6-44b4-8e63-f2c9614bd405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:33.697948 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:33.762466 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1253/2546] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:54:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:54:33.769677 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8a459-a833-4146-97f6-3f4972353a1c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:33.770087 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8a459-a833-4146-97f6-3f4972353a1c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:33.770366 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8a459-a833-4146-97f6-3f4972353a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:33.790311 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f2a8a459-a833-4146-97f6-3f4972353a1c None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:54:33.791569 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f2a8a459-a833-4146-97f6-3f4972353a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:33.802950 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1294/2547] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:54:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:54:33.804000 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b100868-ace6-44b4-8e63-f2c9614bd405 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:33.814860 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b100868-ace6-44b4-8e63-f2c9614bd405 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:33.820641 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ac1a9-cdea-43a1-a369-f2ba14cbe163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:33.821571 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ac1a9-cdea-43a1-a369-f2ba14cbe163 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:33.821726 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ac1a9-cdea-43a1-a369-f2ba14cbe163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:33.822087 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ac1a9-cdea-43a1-a369-f2ba14cbe163 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:33.822748 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ac1a9-cdea-43a1-a369-f2ba14cbe163 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:54:33.823053 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ac1a9-cdea-43a1-a369-f2ba14cbe163 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:33.825093 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ac1a9-cdea-43a1-a369-f2ba14cbe163 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:33.838366 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1254/2548] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:54:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:54:33.842884 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8a459-a833-4146-97f6-3f4972353a1c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:33.852742 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8a459-a833-4146-97f6-3f4972353a1c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:33.858228 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067fb361-221c-435b-b2d2-ca8acf8c8299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:33.858837 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fb361-221c-435b-b2d2-ca8acf8c8299 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:33.859827 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fb361-221c-435b-b2d2-ca8acf8c8299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:33.859827 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fb361-221c-435b-b2d2-ca8acf8c8299 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:33.860061 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067fb361-221c-435b-b2d2-ca8acf8c8299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:33.862041 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067fb361-221c-435b-b2d2-ca8acf8c8299 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:34.029732 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1295/2549] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:54:33 2022] POST /identity/v3/projects => generated 385 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:54:34.031661 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ac1a9-cdea-43a1-a369-f2ba14cbe163 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:34.041933 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ac1a9-cdea-43a1-a369-f2ba14cbe163 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:34.099843 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42415b3b-845d-45e9-abb3-0498dee7fac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:34.100421 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42415b3b-845d-45e9-abb3-0498dee7fac1 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:34.100705 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42415b3b-845d-45e9-abb3-0498dee7fac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:34.100981 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42415b3b-845d-45e9-abb3-0498dee7fac1 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:34.101673 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42415b3b-845d-45e9-abb3-0498dee7fac1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:34.103661 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42415b3b-845d-45e9-abb3-0498dee7fac1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:34.254936 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1255/2550] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:54:34 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:54:34.258912 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067fb361-221c-435b-b2d2-ca8acf8c8299 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:34.270661 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067fb361-221c-435b-b2d2-ca8acf8c8299 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:34.281090 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776af8a-18e1-48ee-9b94-3542ea51d1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:34.281090 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776af8a-18e1-48ee-9b94-3542ea51d1d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:34.281090 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776af8a-18e1-48ee-9b94-3542ea51d1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:34.281090 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776af8a-18e1-48ee-9b94-3542ea51d1d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:34.281442 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5776af8a-18e1-48ee-9b94-3542ea51d1d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:34.281442 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5776af8a-18e1-48ee-9b94-3542ea51d1d0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:34.294190 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1296/2551] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:54:34.295188 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42415b3b-845d-45e9-abb3-0498dee7fac1 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:34.307023 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42415b3b-845d-45e9-abb3-0498dee7fac1 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:34.312079 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d9ca7-1441-4686-bd98-9c6e0a69cd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:34.312757 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d9ca7-1441-4686-bd98-9c6e0a69cd9d admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:34.313822 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d9ca7-1441-4686-bd98-9c6e0a69cd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:34.314156 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d9ca7-1441-4686-bd98-9c6e0a69cd9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:34.314985 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d9ca7-1441-4686-bd98-9c6e0a69cd9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:34.316666 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d9ca7-1441-4686-bd98-9c6e0a69cd9d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:34.331307 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1256/2552] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:54:34.335596 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776af8a-18e1-48ee-9b94-3542ea51d1d0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:34.349802 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776af8a-18e1-48ee-9b94-3542ea51d1d0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:34.351384 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d4736-3ac3-4314-882f-6959223908c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:34.352073 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d4736-3ac3-4314-882f-6959223908c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:34.352407 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d4736-3ac3-4314-882f-6959223908c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:34.352688 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d4736-3ac3-4314-882f-6959223908c0 admin admin] PATH_INFO: `/v3/projects/33b1ed7605f1445faf589f55187e4f94/users/d0524535b0c04d968120514c30bfd4dc/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:34.368911 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d4736-3ac3-4314-882f-6959223908c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33b1ed7605f1445faf589f55187e4f94, user_id=d0524535b0c04d968120514c30bfd4dc, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:34.371787 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d4736-3ac3-4314-882f-6959223908c0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:34.459448 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1297/2553] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:54:34 2022] PUT /identity/v3/projects/33b1ed7605f1445faf589f55187e4f94/users/d0524535b0c04d968120514c30bfd4dc/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:54:34.471573 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1612b45-6a71-4f84-8537-fa4ef2d0d34d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:34.471864 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1612b45-6a71-4f84-8537-fa4ef2d0d34d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:34.472146 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1612b45-6a71-4f84-8537-fa4ef2d0d34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:34.503396 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a1612b45-6a71-4f84-8537-fa4ef2d0d34d None None] MFA Rules not processed for user `d0524535b0c04d968120514c30bfd4dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:54:34.504602 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a1612b45-6a71-4f84-8537-fa4ef2d0d34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:34.575793 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1257/2554] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:54:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:54:34.580180 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d4736-3ac3-4314-882f-6959223908c0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:34.651343 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d4736-3ac3-4314-882f-6959223908c0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:34.656374 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa955f-d674-445b-80fb-101956ded8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:34.657516 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa955f-d674-445b-80fb-101956ded8f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:34.657907 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa955f-d674-445b-80fb-101956ded8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:34.658185 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa955f-d674-445b-80fb-101956ded8f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:34.658824 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa955f-d674-445b-80fb-101956ded8f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:34.660813 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa955f-d674-445b-80fb-101956ded8f6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:34.736580 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1298/2555] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:54:34 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:54:34.741163 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1612b45-6a71-4f84-8537-fa4ef2d0d34d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:34.756455 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1612b45-6a71-4f84-8537-fa4ef2d0d34d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:34.769576 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:34.830034 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550e69e-a06c-4f06-92ff-c72b1e2f36f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:34.830653 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550e69e-a06c-4f06-92ff-c72b1e2f36f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:34.830939 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550e69e-a06c-4f06-92ff-c72b1e2f36f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:34.831248 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550e69e-a06c-4f06-92ff-c72b1e2f36f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:34.831901 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550e69e-a06c-4f06-92ff-c72b1e2f36f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:34.833870 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550e69e-a06c-4f06-92ff-c72b1e2f36f6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:34.948071 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1258/2556] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:54:34 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:54:34.952073 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa955f-d674-445b-80fb-101956ded8f6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:34.963530 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa955f-d674-445b-80fb-101956ded8f6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:34.968747 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478074f-dbaa-49b9-a034-b8b0fe19f697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:34.970088 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478074f-dbaa-49b9-a034-b8b0fe19f697 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:34.970375 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478074f-dbaa-49b9-a034-b8b0fe19f697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:34.970655 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478074f-dbaa-49b9-a034-b8b0fe19f697 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:34.971309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478074f-dbaa-49b9-a034-b8b0fe19f697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:34.973001 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478074f-dbaa-49b9-a034-b8b0fe19f697 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:34.986494 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1299/2557] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:54:34.990964 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550e69e-a06c-4f06-92ff-c72b1e2f36f6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:35.002032 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550e69e-a06c-4f06-92ff-c72b1e2f36f6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:35.007164 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b6342-80ee-4621-8e25-681afa718798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:35.007818 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b6342-80ee-4621-8e25-681afa718798 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:35.008210 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b6342-80ee-4621-8e25-681afa718798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:35.008492 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b6342-80ee-4621-8e25-681afa718798 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:35.009191 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b6342-80ee-4621-8e25-681afa718798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:35.011131 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b6342-80ee-4621-8e25-681afa718798 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:35.022861 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1259/2558] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:54:35.027147 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478074f-dbaa-49b9-a034-b8b0fe19f697 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:35.039650 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478074f-dbaa-49b9-a034-b8b0fe19f697 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:35.044366 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c3885-f5f0-4f47-b0aa-1ded3c4e67ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:35.045027 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c3885-f5f0-4f47-b0aa-1ded3c4e67ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:35.045312 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c3885-f5f0-4f47-b0aa-1ded3c4e67ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:35.045593 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c3885-f5f0-4f47-b0aa-1ded3c4e67ad admin admin] PATH_INFO: `/v3/projects/b8ebef1077d5492b83b68b5c9c8a5fe9/users/8516be2f9bf04c509d2e2881fe4fcdfb/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:35.064653 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c3885-f5f0-4f47-b0aa-1ded3c4e67ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8ebef1077d5492b83b68b5c9c8a5fe9, user_id=8516be2f9bf04c509d2e2881fe4fcdfb, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:35.067351 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c3885-f5f0-4f47-b0aa-1ded3c4e67ad admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:35.134315 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:35.139977 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1300/2559] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:54:35 2022] PUT /identity/v3/projects/b8ebef1077d5492b83b68b5c9c8a5fe9/users/8516be2f9bf04c509d2e2881fe4fcdfb/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:54:35.151058 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6944f-2c11-482d-9096-e3a47742badd None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:35.151058 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6944f-2c11-482d-9096-e3a47742badd None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:35.151258 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6944f-2c11-482d-9096-e3a47742badd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:35.186969 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-32c6944f-2c11-482d-9096-e3a47742badd None None] MFA Rules not processed for user `8516be2f9bf04c509d2e2881fe4fcdfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:54:35.188320 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-32c6944f-2c11-482d-9096-e3a47742badd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:35.206543 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1cda8-7c91-4b4f-833d-d47ce90b3ef5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:35.206938 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1cda8-7c91-4b4f-833d-d47ce90b3ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:35.207991 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1cda8-7c91-4b4f-833d-d47ce90b3ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:35.230995 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-02a1cda8-7c91-4b4f-833d-d47ce90b3ef5 None None] MFA Rules not processed for user `b0812002d7b14bcb81a42eb380231feb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:54:35.232582 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-02a1cda8-7c91-4b4f-833d-d47ce90b3ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:35.265683 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1260/2560] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:54:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:54:35.269847 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6944f-2c11-482d-9096-e3a47742badd None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:35.296794 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1301/2561] 10.222.0.33 () {58 vars in 1009 bytes} [Fri Sep 16 03:54:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:54:35.312669 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1cda8-7c91-4b4f-833d-d47ce90b3ef5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:35.314283 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-02a1cda8-7c91-4b4f-833d-d47ce90b3ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:35.343905 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6944f-2c11-482d-9096-e3a47742badd None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:35.352558 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2efb4-56c7-470c-b012-25ccfb951e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:35.353181 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2efb4-56c7-470c-b012-25ccfb951e54 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:35.356684 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2efb4-56c7-470c-b012-25ccfb951e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:35.356684 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2efb4-56c7-470c-b012-25ccfb951e54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:35.356684 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe2efb4-56c7-470c-b012-25ccfb951e54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:35.356684 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe2efb4-56c7-470c-b012-25ccfb951e54 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:35.398972 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1cda8-7c91-4b4f-833d-d47ce90b3ef5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:35.404077 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d074646d-dfeb-408d-bfd3-f23dd4eb1547 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f784d98d5f440c681f53ae70f6d1cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:35.404689 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074646d-dfeb-408d-bfd3-f23dd4eb1547 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:35.405002 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074646d-dfeb-408d-bfd3-f23dd4eb1547 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:35.405275 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074646d-dfeb-408d-bfd3-f23dd4eb1547 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:35.414536 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d074646d-dfeb-408d-bfd3-f23dd4eb1547 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:35.416202 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d074646d-dfeb-408d-bfd3-f23dd4eb1547 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:35.426355 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1302/2562] 10.222.0.33 () {60 vars in 1384 bytes} [Fri Sep 16 03:54:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 16 03:54:35.467441 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1261/2563] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:54:35 2022] POST /identity/v3/projects => generated 387 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:54:35.476817 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d074646d-dfeb-408d-bfd3-f23dd4eb1547 service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:35.482656 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d074646d-dfeb-408d-bfd3-f23dd4eb1547 service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:35.540210 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2c551-bb22-4e9f-ba13-ff19b896ae3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:35.540828 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2c551-bb22-4e9f-ba13-ff19b896ae3d admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:35.541111 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2c551-bb22-4e9f-ba13-ff19b896ae3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:35.541390 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2c551-bb22-4e9f-ba13-ff19b896ae3d admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:35.542053 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba2c551-bb22-4e9f-ba13-ff19b896ae3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:35.543979 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba2c551-bb22-4e9f-ba13-ff19b896ae3d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:35.635557 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1303/2564] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:54:35 2022] POST /identity/v3/users => generated 300 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:54:35.637068 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2efb4-56c7-470c-b012-25ccfb951e54 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:35.645677 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:35.661701 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2efb4-56c7-470c-b012-25ccfb951e54 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:35.667697 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5f1fd-2e8c-4999-8c6e-07547bd34a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:35.668367 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5f1fd-2e8c-4999-8c6e-07547bd34a28 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:35.668640 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5f1fd-2e8c-4999-8c6e-07547bd34a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:35.668910 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5f1fd-2e8c-4999-8c6e-07547bd34a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:35.669815 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b5f1fd-2e8c-4999-8c6e-07547bd34a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:35.671857 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b5f1fd-2e8c-4999-8c6e-07547bd34a28 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:35.695398 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1262/2565] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:54:35.698241 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2c551-bb22-4e9f-ba13-ff19b896ae3d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:35.721401 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2c551-bb22-4e9f-ba13-ff19b896ae3d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:35.742659 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55306411-a962-464b-89f4-9cc438810455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:35.743953 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55306411-a962-464b-89f4-9cc438810455 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:35.744383 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55306411-a962-464b-89f4-9cc438810455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:35.744753 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55306411-a962-464b-89f4-9cc438810455 admin admin] PATH_INFO: `/v3/projects/8aabbd27b09e45e68e564d0b9c7e352e/users/e56d738e14384034a612345d60153619/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:35.787047 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55306411-a962-464b-89f4-9cc438810455 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aabbd27b09e45e68e564d0b9c7e352e, user_id=e56d738e14384034a612345d60153619, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:35.791388 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55306411-a962-464b-89f4-9cc438810455 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:35.871841 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:35.883792 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1304/2566] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:54:35 2022] PUT /identity/v3/projects/8aabbd27b09e45e68e564d0b9c7e352e/users/e56d738e14384034a612345d60153619/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:54:35.887462 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5f1fd-2e8c-4999-8c6e-07547bd34a28 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:35.908188 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5f1fd-2e8c-4999-8c6e-07547bd34a28 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:36.009278 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3990a294-e1ff-432b-9e39-cc514999b555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:36.011881 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990a294-e1ff-432b-9e39-cc514999b555 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:36.013572 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990a294-e1ff-432b-9e39-cc514999b555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:36.014505 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990a294-e1ff-432b-9e39-cc514999b555 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:36.021077 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3990a294-e1ff-432b-9e39-cc514999b555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:36.025135 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3990a294-e1ff-432b-9e39-cc514999b555 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:36.072984 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1263/2567] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:54:36.077378 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55306411-a962-464b-89f4-9cc438810455 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:36.096211 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55306411-a962-464b-89f4-9cc438810455 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:36.108289 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19948c3a-28f7-4a84-813c-ab04c0de15f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:36.109423 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19948c3a-28f7-4a84-813c-ab04c0de15f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:36.109991 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19948c3a-28f7-4a84-813c-ab04c0de15f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:36.110482 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19948c3a-28f7-4a84-813c-ab04c0de15f1 admin admin] PATH_INFO: `/v3/projects/8aabbd27b09e45e68e564d0b9c7e352e/users/e56d738e14384034a612345d60153619/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:36.112594 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19948c3a-28f7-4a84-813c-ab04c0de15f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aabbd27b09e45e68e564d0b9c7e352e, user_id=e56d738e14384034a612345d60153619, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:36.116088 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19948c3a-28f7-4a84-813c-ab04c0de15f1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:36.129982 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1305/2568] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:54:36 2022] PUT /identity/v3/projects/8aabbd27b09e45e68e564d0b9c7e352e/users/e56d738e14384034a612345d60153619/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:54:36.144641 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab022c0d-41ff-4354-b1fb-ea6f0623cbcd None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:36.145257 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab022c0d-41ff-4354-b1fb-ea6f0623cbcd None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:36.145879 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab022c0d-41ff-4354-b1fb-ea6f0623cbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:36.184691 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ab022c0d-41ff-4354-b1fb-ea6f0623cbcd None None] MFA Rules not processed for user `e56d738e14384034a612345d60153619`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:54:36.186587 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ab022c0d-41ff-4354-b1fb-ea6f0623cbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:36.293468 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1264/2569] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:54:36 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:54:36.307361 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19948c3a-28f7-4a84-813c-ab04c0de15f1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:36.309874 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-19948c3a-28f7-4a84-813c-ab04c0de15f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:36.402971 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19948c3a-28f7-4a84-813c-ab04c0de15f1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:36.407605 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3801ff6-062a-475f-8248-eac9c710dd4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:36.408436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3801ff6-062a-475f-8248-eac9c710dd4b service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:36.408637 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3801ff6-062a-475f-8248-eac9c710dd4b service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:36.409017 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3801ff6-062a-475f-8248-eac9c710dd4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:36.421534 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3801ff6-062a-475f-8248-eac9c710dd4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:36.423722 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3801ff6-062a-475f-8248-eac9c710dd4b service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:36.436802 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1306/2570] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:54:36 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:54:37.852918 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab022c0d-41ff-4354-b1fb-ea6f0623cbcd None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:37.867210 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab022c0d-41ff-4354-b1fb-ea6f0623cbcd None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:37.871895 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05f7ff-0eae-486c-be96-01a9ffbb4565 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:37.872938 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05f7ff-0eae-486c-be96-01a9ffbb4565 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:37.873449 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05f7ff-0eae-486c-be96-01a9ffbb4565 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:37.873944 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05f7ff-0eae-486c-be96-01a9ffbb4565 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:38.014963 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c05f7ff-0eae-486c-be96-01a9ffbb4565 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:38.015998 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3801ff6-062a-475f-8248-eac9c710dd4b service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:38.016754 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c05f7ff-0eae-486c-be96-01a9ffbb4565 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:38.017486 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c3801ff6-062a-475f-8248-eac9c710dd4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:38.041230 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1265/2571] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:54:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:54:38.120120 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3801ff6-062a-475f-8248-eac9c710dd4b service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:38.126919 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ed106-0291-4064-9aa0-ed2ee9cd7588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:38.131307 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ed106-0291-4064-9aa0-ed2ee9cd7588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:38.131307 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ed106-0291-4064-9aa0-ed2ee9cd7588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:38.131307 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ed106-0291-4064-9aa0-ed2ee9cd7588 admin admin] PATH_INFO: `/v3/users/5e9c67b65a444dc19edf71b669451529` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:38.131307 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ed106-0291-4064-9aa0-ed2ee9cd7588 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e9c67b65a444dc19edf71b669451529)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:38.132653 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ed106-0291-4064-9aa0-ed2ee9cd7588 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:38.406392 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2c7ed106-0291-4064-9aa0-ed2ee9cd7588 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e9c67b65a444dc19edf71b669451529'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:38.407666 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2c7ed106-0291-4064-9aa0-ed2ee9cd7588 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e9c67b65a444dc19edf71b669451529'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:38.416007 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2c7ed106-0291-4064-9aa0-ed2ee9cd7588 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e9c67b65a444dc19edf71b669451529'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:38.429076 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2c7ed106-0291-4064-9aa0-ed2ee9cd7588 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e9c67b65a444dc19edf71b669451529'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:38.429825 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2c7ed106-0291-4064-9aa0-ed2ee9cd7588 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e9c67b65a444dc19edf71b669451529'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:38.660512 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1307/2572] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:54:38 2022] DELETE /identity/v3/users/5e9c67b65a444dc19edf71b669451529 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:54:38.665418 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b8c14-f1d8-45ae-90ea-c32cdd2b3a52 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:38.665796 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b8c14-f1d8-45ae-90ea-c32cdd2b3a52 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:38.666141 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b8c14-f1d8-45ae-90ea-c32cdd2b3a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:38.693925 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a06b8c14-f1d8-45ae-90ea-c32cdd2b3a52 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:54:38.694743 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a06b8c14-f1d8-45ae-90ea-c32cdd2b3a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:38.704035 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:38.758333 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1266/2573] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:54:38.769907 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ed106-0291-4064-9aa0-ed2ee9cd7588 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:38.771032 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2c7ed106-0291-4064-9aa0-ed2ee9cd7588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:38.782969 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:38.840844 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ed106-0291-4064-9aa0-ed2ee9cd7588 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:38.845519 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85ce70-bd5b-4f68-ac44-24012c5f241b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:38.846182 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85ce70-bd5b-4f68-ac44-24012c5f241b service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:38.846466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85ce70-bd5b-4f68-ac44-24012c5f241b service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:38.846807 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85ce70-bd5b-4f68-ac44-24012c5f241b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:38.858597 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df85ce70-bd5b-4f68-ac44-24012c5f241b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:38.860136 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df85ce70-bd5b-4f68-ac44-24012c5f241b service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:38.870668 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1308/2574] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:54:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:54:39.836865 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b8c14-f1d8-45ae-90ea-c32cdd2b3a52 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:39.839073 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a06b8c14-f1d8-45ae-90ea-c32cdd2b3a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:39.853157 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b8c14-f1d8-45ae-90ea-c32cdd2b3a52 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:39.862264 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3293b3-b7e2-4fbe-a483-e1af4a549e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:39.862937 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3293b3-b7e2-4fbe-a483-e1af4a549e8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:39.863218 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3293b3-b7e2-4fbe-a483-e1af4a549e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:39.863492 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3293b3-b7e2-4fbe-a483-e1af4a549e8b admin admin] PATH_INFO: `/v3/projects/e85a7ab1b6c24171a98d3fdf2d348b49` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:39.864638 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3293b3-b7e2-4fbe-a483-e1af4a549e8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e85a7ab1b6c24171a98d3fdf2d348b49)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:39.866751 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3293b3-b7e2-4fbe-a483-e1af4a549e8b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:40.911052 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dc3293b3-b7e2-4fbe-a483-e1af4a549e8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e85a7ab1b6c24171a98d3fdf2d348b49', 'request_id': 'req-dc3293b3-b7e2-4fbe-a483-e1af4a549e8b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:41.224916 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dc3293b3-b7e2-4fbe-a483-e1af4a549e8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e85a7ab1b6c24171a98d3fdf2d348b49', 'request_id': 'req-dc3293b3-b7e2-4fbe-a483-e1af4a549e8b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:41.235198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dc3293b3-b7e2-4fbe-a483-e1af4a549e8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e85a7ab1b6c24171a98d3fdf2d348b49', 'request_id': 'req-dc3293b3-b7e2-4fbe-a483-e1af4a549e8b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:41.250180 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dc3293b3-b7e2-4fbe-a483-e1af4a549e8b admin admin] The token cache is being invalidate because project e85a7ab1b6c24171a98d3fdf2d348b49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:54:41.250697 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dc3293b3-b7e2-4fbe-a483-e1af4a549e8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:41.251589 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dc3293b3-b7e2-4fbe-a483-e1af4a549e8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:41.254298 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1267/2575] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:54:39 2022] DELETE /identity/v3/projects/e85a7ab1b6c24171a98d3fdf2d348b49 => generated 0 bytes in 1418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:54:41.258421 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85ce70-bd5b-4f68-ac44-24012c5f241b service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:41.271089 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85ce70-bd5b-4f68-ac44-24012c5f241b service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:41.357133 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f575e0-20d4-49f3-bb62-d9a8ad4d804b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:41.358083 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f575e0-20d4-49f3-bb62-d9a8ad4d804b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:41.358431 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f575e0-20d4-49f3-bb62-d9a8ad4d804b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:41.358789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f575e0-20d4-49f3-bb62-d9a8ad4d804b admin admin] PATH_INFO: `/v3/users/ed6d98e4354046729b344c1c300e3870` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:41.360246 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f575e0-20d4-49f3-bb62-d9a8ad4d804b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed6d98e4354046729b344c1c300e3870)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:41.362491 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f575e0-20d4-49f3-bb62-d9a8ad4d804b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:42.159411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-48f575e0-20d4-49f3-bb62-d9a8ad4d804b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed6d98e4354046729b344c1c300e3870'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:42.160001 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-48f575e0-20d4-49f3-bb62-d9a8ad4d804b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed6d98e4354046729b344c1c300e3870'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:42.168023 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-48f575e0-20d4-49f3-bb62-d9a8ad4d804b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed6d98e4354046729b344c1c300e3870'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:42.180958 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-48f575e0-20d4-49f3-bb62-d9a8ad4d804b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed6d98e4354046729b344c1c300e3870'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:42.181735 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-48f575e0-20d4-49f3-bb62-d9a8ad4d804b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed6d98e4354046729b344c1c300e3870'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:42.289558 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1309/2576] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:54:41 2022] DELETE /identity/v3/users/ed6d98e4354046729b344c1c300e3870 => generated 0 bytes in 1032 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:54:42.878571 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3293b3-b7e2-4fbe-a483-e1af4a549e8b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:42.880115 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dc3293b3-b7e2-4fbe-a483-e1af4a549e8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:43.009146 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3293b3-b7e2-4fbe-a483-e1af4a549e8b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:43.046910 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:43.071576 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfcba4b-5a9b-4fe7-922e-bd24a3a5b72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:43.072215 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfcba4b-5a9b-4fe7-922e-bd24a3a5b72f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:43.072560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfcba4b-5a9b-4fe7-922e-bd24a3a5b72f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:43.072837 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfcba4b-5a9b-4fe7-922e-bd24a3a5b72f admin admin] PATH_INFO: `/v3/projects/6518e690d94b477990a450f166e344db` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:43.074024 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfcba4b-5a9b-4fe7-922e-bd24a3a5b72f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6518e690d94b477990a450f166e344db)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:43.075985 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfcba4b-5a9b-4fe7-922e-bd24a3a5b72f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:43.243345 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ccfcba4b-5a9b-4fe7-922e-bd24a3a5b72f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6518e690d94b477990a450f166e344db', 'request_id': 'req-ccfcba4b-5a9b-4fe7-922e-bd24a3a5b72f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:43.367532 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ccfcba4b-5a9b-4fe7-922e-bd24a3a5b72f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6518e690d94b477990a450f166e344db', 'request_id': 'req-ccfcba4b-5a9b-4fe7-922e-bd24a3a5b72f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:43.374825 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ccfcba4b-5a9b-4fe7-922e-bd24a3a5b72f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6518e690d94b477990a450f166e344db', 'request_id': 'req-ccfcba4b-5a9b-4fe7-922e-bd24a3a5b72f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:43.386469 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ccfcba4b-5a9b-4fe7-922e-bd24a3a5b72f admin admin] The token cache is being invalidate because project 6518e690d94b477990a450f166e344db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:54:43.386876 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ccfcba4b-5a9b-4fe7-922e-bd24a3a5b72f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:43.387412 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ccfcba4b-5a9b-4fe7-922e-bd24a3a5b72f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:43.388886 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1268/2577] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:54:42 2022] DELETE /identity/v3/projects/6518e690d94b477990a450f166e344db => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:54:43.394021 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a258e87-0075-42c5-b123-ca334d6b411a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:43.398035 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a258e87-0075-42c5-b123-ca334d6b411a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:43.398035 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a258e87-0075-42c5-b123-ca334d6b411a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:43.439943 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:43.460100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0a258e87-0075-42c5-b123-ca334d6b411a None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:54:43.461421 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0a258e87-0075-42c5-b123-ca334d6b411a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:43.529413 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1310/2578] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:54:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:54:43.538198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ec928-6673-4860-a2aa-7af95914bb2e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:43.541302 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ec928-6673-4860-a2aa-7af95914bb2e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:43.541302 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ec928-6673-4860-a2aa-7af95914bb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:43.561136 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-759ec928-6673-4860-a2aa-7af95914bb2e None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:54:43.562383 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-759ec928-6673-4860-a2aa-7af95914bb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:43.571137 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1269/2579] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:54:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:54:43.575293 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a258e87-0075-42c5-b123-ca334d6b411a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:43.585760 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a258e87-0075-42c5-b123-ca334d6b411a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:43.590757 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bde98f-841b-4171-acfc-fb1913fa4f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:43.591441 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bde98f-841b-4171-acfc-fb1913fa4f2e admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:43.591732 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bde98f-841b-4171-acfc-fb1913fa4f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:43.592062 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bde98f-841b-4171-acfc-fb1913fa4f2e admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:43.593143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bde98f-841b-4171-acfc-fb1913fa4f2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:54:43.593143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bde98f-841b-4171-acfc-fb1913fa4f2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:43.594831 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bde98f-841b-4171-acfc-fb1913fa4f2e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:43.608033 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1311/2580] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:54:43.616878 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ec928-6673-4860-a2aa-7af95914bb2e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:43.627531 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ec928-6673-4860-a2aa-7af95914bb2e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:43.632755 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a93cb-fd16-4873-9361-af6fdb677442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:43.633377 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a93cb-fd16-4873-9361-af6fdb677442 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:43.633675 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a93cb-fd16-4873-9361-af6fdb677442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:43.633952 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a93cb-fd16-4873-9361-af6fdb677442 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:43.634641 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a93cb-fd16-4873-9361-af6fdb677442 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:43.636878 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a93cb-fd16-4873-9361-af6fdb677442 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:43.763626 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1270/2581] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:54:43 2022] POST /identity/v3/projects => generated 401 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:54:43.764664 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bde98f-841b-4171-acfc-fb1913fa4f2e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:43.779163 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bde98f-841b-4171-acfc-fb1913fa4f2e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:43.884069 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5ea5e-4f73-48ca-aee0-f9764db84e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:43.884704 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5ea5e-4f73-48ca-aee0-f9764db84e58 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:43.884985 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5ea5e-4f73-48ca-aee0-f9764db84e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:43.885259 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5ea5e-4f73-48ca-aee0-f9764db84e58 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:43.885938 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a5ea5e-4f73-48ca-aee0-f9764db84e58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:43.888012 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a5ea5e-4f73-48ca-aee0-f9764db84e58 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:44.454152 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1312/2582] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:54:43 2022] POST /identity/v3/users => generated 301 bytes in 690 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:54:44.458639 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a93cb-fd16-4873-9361-af6fdb677442 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:44.469367 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a93cb-fd16-4873-9361-af6fdb677442 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:44.474572 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f84562-686b-4e8d-80fa-f2057311f42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:44.475198 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f84562-686b-4e8d-80fa-f2057311f42c admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:44.475508 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f84562-686b-4e8d-80fa-f2057311f42c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:44.475783 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f84562-686b-4e8d-80fa-f2057311f42c admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:44.476422 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f84562-686b-4e8d-80fa-f2057311f42c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:44.478060 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f84562-686b-4e8d-80fa-f2057311f42c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:44.493359 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1271/2583] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:54:44.494208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5ea5e-4f73-48ca-aee0-f9764db84e58 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:44.504256 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5ea5e-4f73-48ca-aee0-f9764db84e58 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:44.508947 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35637f56-9877-4a40-83f9-31478fa9fe79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:44.521404 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35637f56-9877-4a40-83f9-31478fa9fe79 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:44.521404 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35637f56-9877-4a40-83f9-31478fa9fe79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:44.521404 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35637f56-9877-4a40-83f9-31478fa9fe79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:44.521404 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35637f56-9877-4a40-83f9-31478fa9fe79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:44.521404 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35637f56-9877-4a40-83f9-31478fa9fe79 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:44.523089 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1313/2584] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:54:44.527268 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f84562-686b-4e8d-80fa-f2057311f42c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:44.537763 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f84562-686b-4e8d-80fa-f2057311f42c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:44.542710 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bc029-8f25-47c8-879f-14921e9bb996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:44.543381 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bc029-8f25-47c8-879f-14921e9bb996 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:44.543664 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bc029-8f25-47c8-879f-14921e9bb996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:44.543942 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bc029-8f25-47c8-879f-14921e9bb996 admin admin] PATH_INFO: `/v3/projects/89d7fb8502c845f194f18472e4aa953c/users/5e4c2d87da2141f8b25afcf058e5b683/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:44.558931 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670bc029-8f25-47c8-879f-14921e9bb996 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89d7fb8502c845f194f18472e4aa953c, user_id=5e4c2d87da2141f8b25afcf058e5b683, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:44.561617 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670bc029-8f25-47c8-879f-14921e9bb996 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:44.688428 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1272/2585] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:54:44 2022] PUT /identity/v3/projects/89d7fb8502c845f194f18472e4aa953c/users/5e4c2d87da2141f8b25afcf058e5b683/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:54:44.699538 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe77287-54cd-4204-8ed7-b6e7523bae27 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:44.699825 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe77287-54cd-4204-8ed7-b6e7523bae27 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:44.700101 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe77287-54cd-4204-8ed7-b6e7523bae27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:44.728292 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6fe77287-54cd-4204-8ed7-b6e7523bae27 None None] MFA Rules not processed for user `5e4c2d87da2141f8b25afcf058e5b683`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:54:44.733518 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6fe77287-54cd-4204-8ed7-b6e7523bae27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:44.795308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1314/2586] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:54:44 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:54:44.799952 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bc029-8f25-47c8-879f-14921e9bb996 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:44.860151 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:44.871336 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bc029-8f25-47c8-879f-14921e9bb996 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:44.876324 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721b4ee-b982-47ba-9328-fe89f8638e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:44.877525 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721b4ee-b982-47ba-9328-fe89f8638e71 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:44.877835 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721b4ee-b982-47ba-9328-fe89f8638e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:44.878105 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721b4ee-b982-47ba-9328-fe89f8638e71 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:44.878757 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5721b4ee-b982-47ba-9328-fe89f8638e71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:44.880737 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5721b4ee-b982-47ba-9328-fe89f8638e71 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:45.029073 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1273/2587] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:54:44 2022] POST /identity/v3/projects => generated 401 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:54:45.031360 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe77287-54cd-4204-8ed7-b6e7523bae27 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:45.043700 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe77287-54cd-4204-8ed7-b6e7523bae27 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:45.073484 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:45.112285 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58346e8f-4879-42f5-9fb2-79422db56c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:45.112285 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58346e8f-4879-42f5-9fb2-79422db56c6e admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:45.112285 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58346e8f-4879-42f5-9fb2-79422db56c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:45.112285 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58346e8f-4879-42f5-9fb2-79422db56c6e admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:45.112659 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58346e8f-4879-42f5-9fb2-79422db56c6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:45.113344 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58346e8f-4879-42f5-9fb2-79422db56c6e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:45.239800 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1315/2588] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:54:45 2022] POST /identity/v3/users => generated 307 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:54:45.241120 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721b4ee-b982-47ba-9328-fe89f8638e71 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:45.251333 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721b4ee-b982-47ba-9328-fe89f8638e71 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:45.258717 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3d277-d0ec-4082-9c3f-0c0ffc2cf18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:45.259341 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3d277-d0ec-4082-9c3f-0c0ffc2cf18b admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:45.261276 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3d277-d0ec-4082-9c3f-0c0ffc2cf18b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:45.261276 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3d277-d0ec-4082-9c3f-0c0ffc2cf18b admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:45.261276 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3d277-d0ec-4082-9c3f-0c0ffc2cf18b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:45.262259 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3d277-d0ec-4082-9c3f-0c0ffc2cf18b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:45.273114 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1274/2589] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:54:45.277306 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58346e8f-4879-42f5-9fb2-79422db56c6e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:45.288358 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58346e8f-4879-42f5-9fb2-79422db56c6e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:45.293463 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dae7de-26fe-4624-8ae6-c9358435c7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:45.294219 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dae7de-26fe-4624-8ae6-c9358435c7ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:45.294575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dae7de-26fe-4624-8ae6-c9358435c7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:45.294954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dae7de-26fe-4624-8ae6-c9358435c7ec admin admin] PATH_INFO: `/v3/projects/64c5973390244d9daa38e782ca27fda4/users/ad9955baf5d3420d91156398a00b018b/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:45.310207 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dae7de-26fe-4624-8ae6-c9358435c7ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=64c5973390244d9daa38e782ca27fda4, user_id=ad9955baf5d3420d91156398a00b018b, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:45.312888 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dae7de-26fe-4624-8ae6-c9358435c7ec admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:45.414466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1316/2590] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:54:45 2022] PUT /identity/v3/projects/64c5973390244d9daa38e782ca27fda4/users/ad9955baf5d3420d91156398a00b018b/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:54:45.418562 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3d277-d0ec-4082-9c3f-0c0ffc2cf18b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:45.428476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3d277-d0ec-4082-9c3f-0c0ffc2cf18b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:45.484222 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8ebd7-337f-4aff-85b0-858d343fcaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:45.484853 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8ebd7-337f-4aff-85b0-858d343fcaea admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:45.485104 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8ebd7-337f-4aff-85b0-858d343fcaea admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:45.485380 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8ebd7-337f-4aff-85b0-858d343fcaea admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:45.486097 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8ebd7-337f-4aff-85b0-858d343fcaea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:45.490866 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8ebd7-337f-4aff-85b0-858d343fcaea admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:45.498084 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1275/2591] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:54:45.503127 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dae7de-26fe-4624-8ae6-c9358435c7ec admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:45.513400 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dae7de-26fe-4624-8ae6-c9358435c7ec admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:45.518249 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821b3f4-e966-4a79-9ec0-0d0908ea71ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:45.519452 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821b3f4-e966-4a79-9ec0-0d0908ea71ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:45.519452 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821b3f4-e966-4a79-9ec0-0d0908ea71ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:45.519452 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821b3f4-e966-4a79-9ec0-0d0908ea71ac admin admin] PATH_INFO: `/v3/projects/64c5973390244d9daa38e782ca27fda4/users/ad9955baf5d3420d91156398a00b018b/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:45.521490 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821b3f4-e966-4a79-9ec0-0d0908ea71ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=64c5973390244d9daa38e782ca27fda4, user_id=ad9955baf5d3420d91156398a00b018b, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:45.524175 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821b3f4-e966-4a79-9ec0-0d0908ea71ac admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:45.534515 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1317/2592] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:54:45 2022] PUT /identity/v3/projects/64c5973390244d9daa38e782ca27fda4/users/ad9955baf5d3420d91156398a00b018b/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:54:45.546222 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cc4f6-7d49-451f-bd91-a09f4bb8d19b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:45.548111 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cc4f6-7d49-451f-bd91-a09f4bb8d19b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:45.548111 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cc4f6-7d49-451f-bd91-a09f4bb8d19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:45.576731 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9c8cc4f6-7d49-451f-bd91-a09f4bb8d19b None None] MFA Rules not processed for user `ad9955baf5d3420d91156398a00b018b`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:54:45.576731 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9c8cc4f6-7d49-451f-bd91-a09f4bb8d19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:45.644941 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1276/2593] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:54:45 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:54:45.656178 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821b3f4-e966-4a79-9ec0-0d0908ea71ac admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:45.657922 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5821b3f4-e966-4a79-9ec0-0d0908ea71ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:45.756933 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821b3f4-e966-4a79-9ec0-0d0908ea71ac admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:45.760744 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f20f0-4669-4d71-be49-f3b23889bf3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:45.761344 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f20f0-4669-4d71-be49-f3b23889bf3a service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:45.761626 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f20f0-4669-4d71-be49-f3b23889bf3a service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:45.761933 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f20f0-4669-4d71-be49-f3b23889bf3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:45.771017 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f20f0-4669-4d71-be49-f3b23889bf3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:45.772441 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f20f0-4669-4d71-be49-f3b23889bf3a service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:45.781976 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1318/2594] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:54:45 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:54:46.027396 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8cc4f6-7d49-451f-bd91-a09f4bb8d19b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:46.037003 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8cc4f6-7d49-451f-bd91-a09f4bb8d19b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:46.040846 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37efe8-7904-470b-b36b-94d1605347e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:46.051610 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37efe8-7904-470b-b36b-94d1605347e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:46.051610 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37efe8-7904-470b-b36b-94d1605347e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:46.051610 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37efe8-7904-470b-b36b-94d1605347e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:46.088525 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:46.100261 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37efe8-7904-470b-b36b-94d1605347e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:46.103092 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37efe8-7904-470b-b36b-94d1605347e7 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:46.110553 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1277/2595] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:54:46 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:54:46.436275 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f20f0-4669-4d71-be49-f3b23889bf3a service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:46.437565 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-358f20f0-4669-4d71-be49-f3b23889bf3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:46.449835 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f20f0-4669-4d71-be49-f3b23889bf3a service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:46.453806 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af16d0-9bac-4ea2-b346-7383f09bd350 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:46.454521 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af16d0-9bac-4ea2-b346-7383f09bd350 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:46.454921 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af16d0-9bac-4ea2-b346-7383f09bd350 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:46.455309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af16d0-9bac-4ea2-b346-7383f09bd350 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:46.457130 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-70af16d0-9bac-4ea2-b346-7383f09bd350 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:46.467682 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:46.518593 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af16d0-9bac-4ea2-b346-7383f09bd350 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:46.520030 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af16d0-9bac-4ea2-b346-7383f09bd350 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:46.528777 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1319/2596] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:54:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:54:50.873567 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37efe8-7904-470b-b36b-94d1605347e7 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:50.875191 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ad37efe8-7904-470b-b36b-94d1605347e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:50.946487 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37efe8-7904-470b-b36b-94d1605347e7 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:50.951197 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b862fa-17d9-4228-8ac0-cd8e343965a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:50.951903 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b862fa-17d9-4228-8ac0-cd8e343965a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:50.954762 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b862fa-17d9-4228-8ac0-cd8e343965a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:50.954762 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b862fa-17d9-4228-8ac0-cd8e343965a9 admin admin] PATH_INFO: `/v3/users/d0524535b0c04d968120514c30bfd4dc` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:50.954762 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b862fa-17d9-4228-8ac0-cd8e343965a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0524535b0c04d968120514c30bfd4dc)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:50.955710 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b862fa-17d9-4228-8ac0-cd8e343965a9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:51.172478 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e7b862fa-17d9-4228-8ac0-cd8e343965a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0524535b0c04d968120514c30bfd4dc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:51.173207 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e7b862fa-17d9-4228-8ac0-cd8e343965a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0524535b0c04d968120514c30bfd4dc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:51.182588 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e7b862fa-17d9-4228-8ac0-cd8e343965a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0524535b0c04d968120514c30bfd4dc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:51.204739 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e7b862fa-17d9-4228-8ac0-cd8e343965a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0524535b0c04d968120514c30bfd4dc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:51.206032 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e7b862fa-17d9-4228-8ac0-cd8e343965a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0524535b0c04d968120514c30bfd4dc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:51.281163 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af16d0-9bac-4ea2-b346-7383f09bd350 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:51.292338 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af16d0-9bac-4ea2-b346-7383f09bd350 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:51.297948 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccff28e-48a0-4a47-8d90-dad2e7e03254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:51.299009 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccff28e-48a0-4a47-8d90-dad2e7e03254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:51.299385 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccff28e-48a0-4a47-8d90-dad2e7e03254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:51.299843 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccff28e-48a0-4a47-8d90-dad2e7e03254 admin admin] PATH_INFO: `/v3/users/5e4c2d87da2141f8b25afcf058e5b683` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:51.301794 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccff28e-48a0-4a47-8d90-dad2e7e03254 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e4c2d87da2141f8b25afcf058e5b683)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:51.303739 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccff28e-48a0-4a47-8d90-dad2e7e03254 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:51.363385 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1278/2597] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:54:50 2022] DELETE /identity/v3/users/d0524535b0c04d968120514c30bfd4dc => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:54:51.367803 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5cbf0-8a3e-4d82-b34d-747270c079ad None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:51.368089 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5cbf0-8a3e-4d82-b34d-747270c079ad None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:51.368360 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5cbf0-8a3e-4d82-b34d-747270c079ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:51.389223 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-6fb5cbf0-8a3e-4d82-b34d-747270c079ad None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:54:51.390452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6fb5cbf0-8a3e-4d82-b34d-747270c079ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:51.456513 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1279/2598] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:54:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:54:51.466387 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5cbf0-8a3e-4d82-b34d-747270c079ad None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:51.467753 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6fb5cbf0-8a3e-4d82-b34d-747270c079ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:51.477870 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:51.496476 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4ccff28e-48a0-4a47-8d90-dad2e7e03254 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e4c2d87da2141f8b25afcf058e5b683'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:51.497119 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4ccff28e-48a0-4a47-8d90-dad2e7e03254 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e4c2d87da2141f8b25afcf058e5b683'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:51.504751 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4ccff28e-48a0-4a47-8d90-dad2e7e03254 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e4c2d87da2141f8b25afcf058e5b683'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:51.517006 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4ccff28e-48a0-4a47-8d90-dad2e7e03254 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e4c2d87da2141f8b25afcf058e5b683'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:51.517713 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4ccff28e-48a0-4a47-8d90-dad2e7e03254 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e4c2d87da2141f8b25afcf058e5b683'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:51.552325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5cbf0-8a3e-4d82-b34d-747270c079ad None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:51.556430 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cede108-282c-4193-b8bd-cbdac0979485 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:51.557035 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cede108-282c-4193-b8bd-cbdac0979485 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:51.557314 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cede108-282c-4193-b8bd-cbdac0979485 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:51.557583 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cede108-282c-4193-b8bd-cbdac0979485 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:51.559327 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4cede108-282c-4193-b8bd-cbdac0979485 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:51.573535 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cede108-282c-4193-b8bd-cbdac0979485 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:51.575206 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cede108-282c-4193-b8bd-cbdac0979485 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:51.587308 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1280/2599] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:54:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 03:54:51.619169 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1320/2600] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:54:51 2022] DELETE /identity/v3/users/5e4c2d87da2141f8b25afcf058e5b683 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:54:51.623836 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b93a9f-0892-48b2-baad-3d3b3f9a2e20 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:51.624490 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b93a9f-0892-48b2-baad-3d3b3f9a2e20 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:51.624956 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b93a9f-0892-48b2-baad-3d3b3f9a2e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:51.646491 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-85b93a9f-0892-48b2-baad-3d3b3f9a2e20 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:54:51.647720 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-85b93a9f-0892-48b2-baad-3d3b3f9a2e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:51.712013 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1281/2601] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:54:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:54:51.722215 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccff28e-48a0-4a47-8d90-dad2e7e03254 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:51.723737 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4ccff28e-48a0-4a47-8d90-dad2e7e03254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:51.787158 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccff28e-48a0-4a47-8d90-dad2e7e03254 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:51.794058 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7b084-d9e7-464d-b5d3-432badea5b0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:51.794751 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7b084-d9e7-464d-b5d3-432badea5b0c service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:51.795034 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7b084-d9e7-464d-b5d3-432badea5b0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:51.795340 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7b084-d9e7-464d-b5d3-432badea5b0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:51.808653 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e7b084-d9e7-464d-b5d3-432badea5b0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:51.810135 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e7b084-d9e7-464d-b5d3-432badea5b0c service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:51.820293 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1321/2602] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:54:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:54:52.084775 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b93a9f-0892-48b2-baad-3d3b3f9a2e20 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:52.086490 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-85b93a9f-0892-48b2-baad-3d3b3f9a2e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:52.098677 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b93a9f-0892-48b2-baad-3d3b3f9a2e20 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:52.103558 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc9d43-04ca-43f3-b139-c38cc8c378ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:52.104314 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc9d43-04ca-43f3-b139-c38cc8c378ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:52.104660 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc9d43-04ca-43f3-b139-c38cc8c378ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:52.104939 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc9d43-04ca-43f3-b139-c38cc8c378ac admin admin] PATH_INFO: `/v3/projects/33b1ed7605f1445faf589f55187e4f94` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:52.106327 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dc9d43-04ca-43f3-b139-c38cc8c378ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=33b1ed7605f1445faf589f55187e4f94)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:52.108363 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dc9d43-04ca-43f3-b139-c38cc8c378ac admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:52.287180 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-68dc9d43-04ca-43f3-b139-c38cc8c378ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33b1ed7605f1445faf589f55187e4f94', 'request_id': 'req-68dc9d43-04ca-43f3-b139-c38cc8c378ac'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:52.378193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7b084-d9e7-464d-b5d3-432badea5b0c service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:52.378193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-96e7b084-d9e7-464d-b5d3-432badea5b0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:52.395967 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7b084-d9e7-464d-b5d3-432badea5b0c service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:52.408205 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-68dc9d43-04ca-43f3-b139-c38cc8c378ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33b1ed7605f1445faf589f55187e4f94', 'request_id': 'req-68dc9d43-04ca-43f3-b139-c38cc8c378ac'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:52.416977 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-68dc9d43-04ca-43f3-b139-c38cc8c378ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33b1ed7605f1445faf589f55187e4f94', 'request_id': 'req-68dc9d43-04ca-43f3-b139-c38cc8c378ac'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:52.437388 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:52.437668 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-68dc9d43-04ca-43f3-b139-c38cc8c378ac admin admin] The token cache is being invalidate because project 33b1ed7605f1445faf589f55187e4f94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:54:52.437771 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-68dc9d43-04ca-43f3-b139-c38cc8c378ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:52.438520 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-68dc9d43-04ca-43f3-b139-c38cc8c378ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:52.440092 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1282/2603] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:54:52 2022] DELETE /identity/v3/projects/33b1ed7605f1445faf589f55187e4f94 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:54:52.443880 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc9d43-04ca-43f3-b139-c38cc8c378ac admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:52.445734 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-68dc9d43-04ca-43f3-b139-c38cc8c378ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:52.466523 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:52.493666 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc9657-da99-4903-8b65-cb4ecc46b4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:52.498618 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc9657-da99-4903-8b65-cb4ecc46b4c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:52.498618 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc9657-da99-4903-8b65-cb4ecc46b4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:52.498618 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc9657-da99-4903-8b65-cb4ecc46b4c4 admin admin] PATH_INFO: `/v3/projects/89d7fb8502c845f194f18472e4aa953c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:52.498618 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc9657-da99-4903-8b65-cb4ecc46b4c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89d7fb8502c845f194f18472e4aa953c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:52.498618 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc9657-da99-4903-8b65-cb4ecc46b4c4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:52.528553 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc9d43-04ca-43f3-b139-c38cc8c378ac admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:52.534908 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d15ee-45b2-49cb-a1e2-6a076e539f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:52.535551 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d15ee-45b2-49cb-a1e2-6a076e539f4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:52.535835 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d15ee-45b2-49cb-a1e2-6a076e539f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:52.538703 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d15ee-45b2-49cb-a1e2-6a076e539f4a admin admin] PATH_INFO: `/v3/users/8516be2f9bf04c509d2e2881fe4fcdfb` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:52.538703 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d15ee-45b2-49cb-a1e2-6a076e539f4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8516be2f9bf04c509d2e2881fe4fcdfb)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:52.540094 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d15ee-45b2-49cb-a1e2-6a076e539f4a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:52.728443 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-44dc9657-da99-4903-8b65-cb4ecc46b4c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89d7fb8502c845f194f18472e4aa953c', 'request_id': 'req-44dc9657-da99-4903-8b65-cb4ecc46b4c4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:52.729945 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-816d15ee-45b2-49cb-a1e2-6a076e539f4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8516be2f9bf04c509d2e2881fe4fcdfb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:52.730862 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-816d15ee-45b2-49cb-a1e2-6a076e539f4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8516be2f9bf04c509d2e2881fe4fcdfb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:52.739372 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-816d15ee-45b2-49cb-a1e2-6a076e539f4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8516be2f9bf04c509d2e2881fe4fcdfb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:52.752776 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-816d15ee-45b2-49cb-a1e2-6a076e539f4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8516be2f9bf04c509d2e2881fe4fcdfb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:52.753504 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-816d15ee-45b2-49cb-a1e2-6a076e539f4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8516be2f9bf04c509d2e2881fe4fcdfb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:52.807539 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-44dc9657-da99-4903-8b65-cb4ecc46b4c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89d7fb8502c845f194f18472e4aa953c', 'request_id': 'req-44dc9657-da99-4903-8b65-cb4ecc46b4c4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:52.814480 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-44dc9657-da99-4903-8b65-cb4ecc46b4c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89d7fb8502c845f194f18472e4aa953c', 'request_id': 'req-44dc9657-da99-4903-8b65-cb4ecc46b4c4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:52.824880 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-44dc9657-da99-4903-8b65-cb4ecc46b4c4 admin admin] The token cache is being invalidate because project 89d7fb8502c845f194f18472e4aa953c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:54:52.825173 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-44dc9657-da99-4903-8b65-cb4ecc46b4c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:52.826515 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-44dc9657-da99-4903-8b65-cb4ecc46b4c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:52.828005 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1322/2604] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:54:52 2022] DELETE /identity/v3/projects/89d7fb8502c845f194f18472e4aa953c => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:54:52.832367 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc9657-da99-4903-8b65-cb4ecc46b4c4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:52.833694 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-44dc9657-da99-4903-8b65-cb4ecc46b4c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:52.881700 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1283/2605] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:54:52 2022] DELETE /identity/v3/users/8516be2f9bf04c509d2e2881fe4fcdfb => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:54:52.914638 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc9657-da99-4903-8b65-cb4ecc46b4c4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:52.980322 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fae90c-7138-4a52-aec7-e01550bbbaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:52.980966 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fae90c-7138-4a52-aec7-e01550bbbaf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:52.981251 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fae90c-7138-4a52-aec7-e01550bbbaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:52.981531 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fae90c-7138-4a52-aec7-e01550bbbaf4 admin admin] PATH_INFO: `/v3/users/ad9955baf5d3420d91156398a00b018b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:52.983393 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fae90c-7138-4a52-aec7-e01550bbbaf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad9955baf5d3420d91156398a00b018b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:52.985317 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fae90c-7138-4a52-aec7-e01550bbbaf4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:52.990957 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:53.192282 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-45fae90c-7138-4a52-aec7-e01550bbbaf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad9955baf5d3420d91156398a00b018b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:53.193382 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-45fae90c-7138-4a52-aec7-e01550bbbaf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad9955baf5d3420d91156398a00b018b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:53.201430 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-45fae90c-7138-4a52-aec7-e01550bbbaf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad9955baf5d3420d91156398a00b018b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:53.215909 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-45fae90c-7138-4a52-aec7-e01550bbbaf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad9955baf5d3420d91156398a00b018b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:53.216880 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-45fae90c-7138-4a52-aec7-e01550bbbaf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad9955baf5d3420d91156398a00b018b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:53.436176 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1323/2606] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:54:52 2022] DELETE /identity/v3/users/ad9955baf5d3420d91156398a00b018b => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:54:53.485111 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d15ee-45b2-49cb-a1e2-6a076e539f4a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:53.536142 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-816d15ee-45b2-49cb-a1e2-6a076e539f4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:53.536142 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d15ee-45b2-49cb-a1e2-6a076e539f4a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:53.561331 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd3555-6460-4ce7-b051-d5df07802915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:53.562003 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd3555-6460-4ce7-b051-d5df07802915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:53.562278 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd3555-6460-4ce7-b051-d5df07802915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:53.562546 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd3555-6460-4ce7-b051-d5df07802915 admin admin] PATH_INFO: `/v3/projects/b8ebef1077d5492b83b68b5c9c8a5fe9` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:53.563660 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd3555-6460-4ce7-b051-d5df07802915 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8ebef1077d5492b83b68b5c9c8a5fe9)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:53.566275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd3555-6460-4ce7-b051-d5df07802915 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:53.788259 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:53.798122 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9efd3555-6460-4ce7-b051-d5df07802915 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8ebef1077d5492b83b68b5c9c8a5fe9', 'request_id': 'req-9efd3555-6460-4ce7-b051-d5df07802915'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:53.899289 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9efd3555-6460-4ce7-b051-d5df07802915 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8ebef1077d5492b83b68b5c9c8a5fe9', 'request_id': 'req-9efd3555-6460-4ce7-b051-d5df07802915'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:53.906624 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9efd3555-6460-4ce7-b051-d5df07802915 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8ebef1077d5492b83b68b5c9c8a5fe9', 'request_id': 'req-9efd3555-6460-4ce7-b051-d5df07802915'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:53.917013 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9efd3555-6460-4ce7-b051-d5df07802915 admin admin] The token cache is being invalidate because project b8ebef1077d5492b83b68b5c9c8a5fe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:54:53.917293 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9efd3555-6460-4ce7-b051-d5df07802915 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:53.917945 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9efd3555-6460-4ce7-b051-d5df07802915 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:53.919545 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1284/2607] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:54:53 2022] DELETE /identity/v3/projects/b8ebef1077d5492b83b68b5c9c8a5fe9 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:54:53.923633 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fae90c-7138-4a52-aec7-e01550bbbaf4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:53.925083 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-45fae90c-7138-4a52-aec7-e01550bbbaf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:53.940290 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fae90c-7138-4a52-aec7-e01550bbbaf4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:53.945222 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd3555-6460-4ce7-b051-d5df07802915 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:53.945222 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9efd3555-6460-4ce7-b051-d5df07802915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:54.008709 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3edefb-8944-4174-8efc-b86c72a972a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:54.008709 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3edefb-8944-4174-8efc-b86c72a972a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:54.008709 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3edefb-8944-4174-8efc-b86c72a972a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:54.008709 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3edefb-8944-4174-8efc-b86c72a972a9 admin admin] PATH_INFO: `/v3/users/e56d738e14384034a612345d60153619` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:54.023634 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3edefb-8944-4174-8efc-b86c72a972a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e56d738e14384034a612345d60153619)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:54.023634 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3edefb-8944-4174-8efc-b86c72a972a9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:54.023838 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd3555-6460-4ce7-b051-d5df07802915 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:54.029043 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707aad43-54c0-4a63-a4c3-e8813b3d6939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:54.029732 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707aad43-54c0-4a63-a4c3-e8813b3d6939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:54.030014 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707aad43-54c0-4a63-a4c3-e8813b3d6939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:54.030314 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707aad43-54c0-4a63-a4c3-e8813b3d6939 admin admin] PATH_INFO: `/v3/projects/64c5973390244d9daa38e782ca27fda4` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:54.031523 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707aad43-54c0-4a63-a4c3-e8813b3d6939 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64c5973390244d9daa38e782ca27fda4)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:54.033468 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707aad43-54c0-4a63-a4c3-e8813b3d6939 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:54.235633 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-707aad43-54c0-4a63-a4c3-e8813b3d6939 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64c5973390244d9daa38e782ca27fda4', 'request_id': 'req-707aad43-54c0-4a63-a4c3-e8813b3d6939'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:54.235904 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ed3edefb-8944-4174-8efc-b86c72a972a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e56d738e14384034a612345d60153619'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:54.237154 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ed3edefb-8944-4174-8efc-b86c72a972a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e56d738e14384034a612345d60153619'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:54.245117 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ed3edefb-8944-4174-8efc-b86c72a972a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e56d738e14384034a612345d60153619'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:54.258316 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ed3edefb-8944-4174-8efc-b86c72a972a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e56d738e14384034a612345d60153619'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:54.259102 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ed3edefb-8944-4174-8efc-b86c72a972a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e56d738e14384034a612345d60153619'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:54.367293 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-707aad43-54c0-4a63-a4c3-e8813b3d6939 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64c5973390244d9daa38e782ca27fda4', 'request_id': 'req-707aad43-54c0-4a63-a4c3-e8813b3d6939'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:54.374445 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-707aad43-54c0-4a63-a4c3-e8813b3d6939 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64c5973390244d9daa38e782ca27fda4', 'request_id': 'req-707aad43-54c0-4a63-a4c3-e8813b3d6939'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:54.384645 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-707aad43-54c0-4a63-a4c3-e8813b3d6939 admin admin] The token cache is being invalidate because project 64c5973390244d9daa38e782ca27fda4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:54:54.384936 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-707aad43-54c0-4a63-a4c3-e8813b3d6939 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:54.385592 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-707aad43-54c0-4a63-a4c3-e8813b3d6939 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:54.387141 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1285/2608] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:54:53 2022] DELETE /identity/v3/projects/64c5973390244d9daa38e782ca27fda4 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:54:54.392261 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a20905-2f2d-4ee4-8061-2360b62bd1bc None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:54.393043 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a20905-2f2d-4ee4-8061-2360b62bd1bc None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:54.393321 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a20905-2f2d-4ee4-8061-2360b62bd1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:54.415196 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-98a20905-2f2d-4ee4-8061-2360b62bd1bc None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:54:54.416384 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-98a20905-2f2d-4ee4-8061-2360b62bd1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:54.458925 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1324/2609] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:54:53 2022] DELETE /identity/v3/users/e56d738e14384034a612345d60153619 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:54:54.479096 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1286/2610] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:54:54.488957 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8a844-510e-44c4-920c-66c14a5e429b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:54.489180 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8a844-510e-44c4-920c-66c14a5e429b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:54.489462 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8a844-510e-44c4-920c-66c14a5e429b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:54.498946 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:54.510957 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-74e8a844-510e-44c4-920c-66c14a5e429b None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:54:54.512223 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-74e8a844-510e-44c4-920c-66c14a5e429b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:54.575643 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1325/2611] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:54:54.580065 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a20905-2f2d-4ee4-8061-2360b62bd1bc None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:54.591339 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a20905-2f2d-4ee4-8061-2360b62bd1bc None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:54.596441 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c310efb-353c-4c6e-8d6a-bb2fa448c405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:54.597035 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c310efb-353c-4c6e-8d6a-bb2fa448c405 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:54.597312 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c310efb-353c-4c6e-8d6a-bb2fa448c405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:54.597576 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c310efb-353c-4c6e-8d6a-bb2fa448c405 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:54.598247 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c310efb-353c-4c6e-8d6a-bb2fa448c405 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:54:54.598545 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c310efb-353c-4c6e-8d6a-bb2fa448c405 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:54.600114 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c310efb-353c-4c6e-8d6a-bb2fa448c405 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:54.614225 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1287/2612] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:54:54.618696 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8a844-510e-44c4-920c-66c14a5e429b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:54.627986 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8a844-510e-44c4-920c-66c14a5e429b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:54.632978 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eed4ed-9c43-48b3-bbeb-9bbc51a5f7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:54.633646 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eed4ed-9c43-48b3-bbeb-9bbc51a5f7de admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:54.633939 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eed4ed-9c43-48b3-bbeb-9bbc51a5f7de admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:54.634212 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eed4ed-9c43-48b3-bbeb-9bbc51a5f7de admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:54.634912 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eed4ed-9c43-48b3-bbeb-9bbc51a5f7de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:54.636823 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eed4ed-9c43-48b3-bbeb-9bbc51a5f7de admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:54.758351 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1326/2613] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:54:54 2022] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:54:54.762244 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c310efb-353c-4c6e-8d6a-bb2fa448c405 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:54.773210 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c310efb-353c-4c6e-8d6a-bb2fa448c405 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:54.829285 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b81fc4d-4bc1-4612-bd74-69a10163ae8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:54.829948 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81fc4d-4bc1-4612-bd74-69a10163ae8f admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:54.830760 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81fc4d-4bc1-4612-bd74-69a10163ae8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:54.831035 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81fc4d-4bc1-4612-bd74-69a10163ae8f admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:54.831670 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b81fc4d-4bc1-4612-bd74-69a10163ae8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:54.833613 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b81fc4d-4bc1-4612-bd74-69a10163ae8f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:54.940643 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eed4ed-9c43-48b3-bbeb-9bbc51a5f7de admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:54.942481 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-28eed4ed-9c43-48b3-bbeb-9bbc51a5f7de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:54.956843 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eed4ed-9c43-48b3-bbeb-9bbc51a5f7de admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:54.961814 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ac9bd-20da-4510-a9ef-dc2e135589ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:54.962528 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ac9bd-20da-4510-a9ef-dc2e135589ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:54.962807 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ac9bd-20da-4510-a9ef-dc2e135589ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:54.963095 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ac9bd-20da-4510-a9ef-dc2e135589ca admin admin] PATH_INFO: `/v3/projects/8aabbd27b09e45e68e564d0b9c7e352e` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:54.964324 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ac9bd-20da-4510-a9ef-dc2e135589ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=8aabbd27b09e45e68e564d0b9c7e352e)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:54.966288 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ac9bd-20da-4510-a9ef-dc2e135589ca admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:54.980699 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1288/2614] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:54:54 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:54:54.986524 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b81fc4d-4bc1-4612-bd74-69a10163ae8f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:54.996882 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b81fc4d-4bc1-4612-bd74-69a10163ae8f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:55.002986 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ffadcd-0cc0-474c-a280-5b34cae9c9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:55.003580 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffadcd-0cc0-474c-a280-5b34cae9c9a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:55.003861 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffadcd-0cc0-474c-a280-5b34cae9c9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:55.004136 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffadcd-0cc0-474c-a280-5b34cae9c9a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:55.004922 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ffadcd-0cc0-474c-a280-5b34cae9c9a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:55.006534 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ffadcd-0cc0-474c-a280-5b34cae9c9a6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:55.018815 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1289/2615] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:54:55.022968 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ffadcd-0cc0-474c-a280-5b34cae9c9a6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:55.032225 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ffadcd-0cc0-474c-a280-5b34cae9c9a6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:55.038264 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449a632-853c-4619-b878-6c61797e005a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:55.039546 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449a632-853c-4619-b878-6c61797e005a admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:55.039819 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449a632-853c-4619-b878-6c61797e005a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:55.040243 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449a632-853c-4619-b878-6c61797e005a admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:55.040732 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449a632-853c-4619-b878-6c61797e005a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:55.042300 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449a632-853c-4619-b878-6c61797e005a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:55.053107 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1290/2616] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:54:55.058425 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449a632-853c-4619-b878-6c61797e005a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:55.068631 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449a632-853c-4619-b878-6c61797e005a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:55.073319 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4631b-3134-46e3-aa51-8b1441dd95af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:55.073999 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4631b-3134-46e3-aa51-8b1441dd95af admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:55.074281 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4631b-3134-46e3-aa51-8b1441dd95af admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:55.074556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4631b-3134-46e3-aa51-8b1441dd95af admin admin] PATH_INFO: `/v3/projects/48d431d69a1a4a96838b9e7c7ace0cf1/users/e09d897b738f4e5e9f17832664cbb6de/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:55.093089 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb4631b-3134-46e3-aa51-8b1441dd95af admin admin] RBAC: Authorizing `identity:create_grant(project_id=48d431d69a1a4a96838b9e7c7ace0cf1, user_id=e09d897b738f4e5e9f17832664cbb6de, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:55.096016 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb4631b-3134-46e3-aa51-8b1441dd95af admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:55.101290 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-600ac9bd-20da-4510-a9ef-dc2e135589ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8aabbd27b09e45e68e564d0b9c7e352e', 'request_id': 'req-600ac9bd-20da-4510-a9ef-dc2e135589ca'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:55.104932 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:55.168603 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1291/2617] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:54:55 2022] PUT /identity/v3/projects/48d431d69a1a4a96838b9e7c7ace0cf1/users/e09d897b738f4e5e9f17832664cbb6de/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:54:55.183721 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62afa1f-b519-43bb-9619-979242b3dd75 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:55.184027 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62afa1f-b519-43bb-9619-979242b3dd75 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:55.184293 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62afa1f-b519-43bb-9619-979242b3dd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:55.202611 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-600ac9bd-20da-4510-a9ef-dc2e135589ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8aabbd27b09e45e68e564d0b9c7e352e', 'request_id': 'req-600ac9bd-20da-4510-a9ef-dc2e135589ca'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:55.212814 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-600ac9bd-20da-4510-a9ef-dc2e135589ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8aabbd27b09e45e68e564d0b9c7e352e', 'request_id': 'req-600ac9bd-20da-4510-a9ef-dc2e135589ca'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:55.215298 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b62afa1f-b519-43bb-9619-979242b3dd75 None None] MFA Rules not processed for user `e09d897b738f4e5e9f17832664cbb6de`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:54:55.216644 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b62afa1f-b519-43bb-9619-979242b3dd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:55.226736 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-600ac9bd-20da-4510-a9ef-dc2e135589ca admin admin] The token cache is being invalidate because project 8aabbd27b09e45e68e564d0b9c7e352e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:54:55.227335 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-600ac9bd-20da-4510-a9ef-dc2e135589ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:55.228440 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-600ac9bd-20da-4510-a9ef-dc2e135589ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:55.230591 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1327/2618] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:54:54 2022] DELETE /identity/v3/projects/8aabbd27b09e45e68e564d0b9c7e352e => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:54:55.240114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e7d8b-e586-41d6-8dab-575e62388ae3 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:55.240584 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e7d8b-e586-41d6-8dab-575e62388ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:55.240861 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e7d8b-e586-41d6-8dab-575e62388ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:55.264787 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-399e7d8b-e586-41d6-8dab-575e62388ae3 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:54:55.267032 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-399e7d8b-e586-41d6-8dab-575e62388ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:55.301500 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1292/2619] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:54:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:54:55.303920 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62afa1f-b519-43bb-9619-979242b3dd75 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:55.305862 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b62afa1f-b519-43bb-9619-979242b3dd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:55.337094 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1328/2620] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:54:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:54:55.346359 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e6903-1743-47ef-9aaa-b7605366e92f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:55.346651 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e6903-1743-47ef-9aaa-b7605366e92f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:55.346961 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e6903-1743-47ef-9aaa-b7605366e92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:55.367472 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5c9e6903-1743-47ef-9aaa-b7605366e92f None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:54:55.368778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5c9e6903-1743-47ef-9aaa-b7605366e92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:55.377621 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1329/2621] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:54:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:54:55.381520 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e6903-1743-47ef-9aaa-b7605366e92f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:55.383109 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62afa1f-b519-43bb-9619-979242b3dd75 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:55.387287 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc03eb-a01c-4a8c-8724-3d6d1af46c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:55.390033 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc03eb-a01c-4a8c-8724-3d6d1af46c0d admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:55.390033 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc03eb-a01c-4a8c-8724-3d6d1af46c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:55.390033 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc03eb-a01c-4a8c-8724-3d6d1af46c0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:55.390033 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cc03eb-a01c-4a8c-8724-3d6d1af46c0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:55.391223 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cc03eb-a01c-4a8c-8724-3d6d1af46c0d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:55.392128 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e6903-1743-47ef-9aaa-b7605366e92f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:55.397805 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2815bf-aaf9-452d-a64d-6cad0aebf909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:55.398403 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2815bf-aaf9-452d-a64d-6cad0aebf909 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:55.398680 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2815bf-aaf9-452d-a64d-6cad0aebf909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:55.398948 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2815bf-aaf9-452d-a64d-6cad0aebf909 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:55.399582 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2815bf-aaf9-452d-a64d-6cad0aebf909 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:54:55.399881 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2815bf-aaf9-452d-a64d-6cad0aebf909 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:55.401667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2815bf-aaf9-452d-a64d-6cad0aebf909 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:55.417745 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1330/2622] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:54:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:54:55.419684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2815bf-aaf9-452d-a64d-6cad0aebf909 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:55.430751 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2815bf-aaf9-452d-a64d-6cad0aebf909 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:55.435722 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e59ee8-3cb4-45d6-b4fa-5def5f250882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:55.436308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e59ee8-3cb4-45d6-b4fa-5def5f250882 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:55.436584 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e59ee8-3cb4-45d6-b4fa-5def5f250882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:55.436853 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e59ee8-3cb4-45d6-b4fa-5def5f250882 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:55.437464 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e59ee8-3cb4-45d6-b4fa-5def5f250882 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:55.439436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e59ee8-3cb4-45d6-b4fa-5def5f250882 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:55.467151 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1293/2623] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:54:55 2022] POST /identity/v3/projects => generated 385 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:54:55.471035 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:55.471599 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc03eb-a01c-4a8c-8724-3d6d1af46c0d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:55.537620 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc03eb-a01c-4a8c-8724-3d6d1af46c0d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:55.541710 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1331/2624] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:54:55 2022] POST /identity/v3/projects => generated 371 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:54:55.542492 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517dfb38-f529-4689-b45e-06f07c139776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:55.543105 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517dfb38-f529-4689-b45e-06f07c139776 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:55.544961 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517dfb38-f529-4689-b45e-06f07c139776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:55.544961 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517dfb38-f529-4689-b45e-06f07c139776 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:55.544961 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517dfb38-f529-4689-b45e-06f07c139776 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:55.546113 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e59ee8-3cb4-45d6-b4fa-5def5f250882 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:55.546265 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517dfb38-f529-4689-b45e-06f07c139776 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:55.608705 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e59ee8-3cb4-45d6-b4fa-5def5f250882 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:55.613558 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16a0e1-4566-4437-94ed-8ad7cde9c707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:55.614206 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16a0e1-4566-4437-94ed-8ad7cde9c707 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:55.614481 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16a0e1-4566-4437-94ed-8ad7cde9c707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:55.614749 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16a0e1-4566-4437-94ed-8ad7cde9c707 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:55.615373 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e16a0e1-4566-4437-94ed-8ad7cde9c707 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:55.617451 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e16a0e1-4566-4437-94ed-8ad7cde9c707 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:55.630884 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1294/2625] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:54:55 2022] POST /identity/v3/users => generated 299 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:54:55.632029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517dfb38-f529-4689-b45e-06f07c139776 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:55.642234 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517dfb38-f529-4689-b45e-06f07c139776 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:55.647866 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e58c1-e76b-4342-86d9-05d9f6b04e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:55.648401 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e58c1-e76b-4342-86d9-05d9f6b04e2f admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:55.648687 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e58c1-e76b-4342-86d9-05d9f6b04e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:55.648960 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e58c1-e76b-4342-86d9-05d9f6b04e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:55.649605 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e58c1-e76b-4342-86d9-05d9f6b04e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:55.651253 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e58c1-e76b-4342-86d9-05d9f6b04e2f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:55.661187 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1295/2626] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:54:55.666556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e58c1-e76b-4342-86d9-05d9f6b04e2f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:55.676984 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e58c1-e76b-4342-86d9-05d9f6b04e2f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:55.681787 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188f0b2-6c7e-42d7-84f8-6c7213598b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:55.682407 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188f0b2-6c7e-42d7-84f8-6c7213598b50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:55.682692 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188f0b2-6c7e-42d7-84f8-6c7213598b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:55.682962 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188f0b2-6c7e-42d7-84f8-6c7213598b50 admin admin] PATH_INFO: `/v3/projects/760e5bebef164e4895e2ab727ea170cd/users/4b71bb52c3074c0c95dea3e584486246/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:55.699875 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:55.702268 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d188f0b2-6c7e-42d7-84f8-6c7213598b50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=760e5bebef164e4895e2ab727ea170cd, user_id=4b71bb52c3074c0c95dea3e584486246, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:55.707781 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d188f0b2-6c7e-42d7-84f8-6c7213598b50 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:55.739667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1332/2627] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:54:55 2022] POST /identity/v3/users => generated 286 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:54:55.743860 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16a0e1-4566-4437-94ed-8ad7cde9c707 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:55.754034 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16a0e1-4566-4437-94ed-8ad7cde9c707 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:55.759170 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812e366-c2ff-43b5-ba3a-6fd7b1fb9497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:55.762752 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812e366-c2ff-43b5-ba3a-6fd7b1fb9497 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:55.762752 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812e366-c2ff-43b5-ba3a-6fd7b1fb9497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:55.762752 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812e366-c2ff-43b5-ba3a-6fd7b1fb9497 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:55.762752 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d812e366-c2ff-43b5-ba3a-6fd7b1fb9497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:55.762752 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d812e366-c2ff-43b5-ba3a-6fd7b1fb9497 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:55.772456 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1333/2628] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:54:55.776192 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812e366-c2ff-43b5-ba3a-6fd7b1fb9497 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:55.785772 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812e366-c2ff-43b5-ba3a-6fd7b1fb9497 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:55.790767 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7d0e0-e811-49a2-ab8b-abbedea43e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:55.791255 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7d0e0-e811-49a2-ab8b-abbedea43e46 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:55.791547 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7d0e0-e811-49a2-ab8b-abbedea43e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:55.791810 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7d0e0-e811-49a2-ab8b-abbedea43e46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:55.792422 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc7d0e0-e811-49a2-ab8b-abbedea43e46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:55.793998 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc7d0e0-e811-49a2-ab8b-abbedea43e46 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:55.805008 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1334/2629] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:54:55.809108 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7d0e0-e811-49a2-ab8b-abbedea43e46 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:55.813652 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1296/2630] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:54:55 2022] PUT /identity/v3/projects/760e5bebef164e4895e2ab727ea170cd/users/4b71bb52c3074c0c95dea3e584486246/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:54:55.818885 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7d0e0-e811-49a2-ab8b-abbedea43e46 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:55.820676 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188f0b2-6c7e-42d7-84f8-6c7213598b50 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:55.879072 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f6264-879f-4a93-8429-98c1b092d37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:55.879739 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f6264-879f-4a93-8429-98c1b092d37f admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:55.880023 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f6264-879f-4a93-8429-98c1b092d37f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:55.880303 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f6264-879f-4a93-8429-98c1b092d37f admin admin] PATH_INFO: `/v3/projects/eb4f1511040a45cb99633b3ded958178/users/d9021dbaaa5148f1839ba2e37e870686/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:55.889895 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188f0b2-6c7e-42d7-84f8-6c7213598b50 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:55.895500 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209ac4e-f189-4bc7-a56c-611e3ecfc68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:55.895658 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f6264-879f-4a93-8429-98c1b092d37f admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb4f1511040a45cb99633b3ded958178, user_id=d9021dbaaa5148f1839ba2e37e870686, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:55.896109 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209ac4e-f189-4bc7-a56c-611e3ecfc68c admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:55.896387 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209ac4e-f189-4bc7-a56c-611e3ecfc68c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:55.896658 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209ac4e-f189-4bc7-a56c-611e3ecfc68c admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:55.897430 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d209ac4e-f189-4bc7-a56c-611e3ecfc68c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:55.898332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f6264-879f-4a93-8429-98c1b092d37f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:55.899037 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d209ac4e-f189-4bc7-a56c-611e3ecfc68c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:55.909390 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1297/2631] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:54:55.913515 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209ac4e-f189-4bc7-a56c-611e3ecfc68c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:55.929801 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209ac4e-f189-4bc7-a56c-611e3ecfc68c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:55.934738 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2d7cd-3595-4af7-8842-a6235cf77ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:55.935428 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2d7cd-3595-4af7-8842-a6235cf77ca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:55.935717 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2d7cd-3595-4af7-8842-a6235cf77ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:55.936075 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2d7cd-3595-4af7-8842-a6235cf77ca4 admin admin] PATH_INFO: `/v3/projects/760e5bebef164e4895e2ab727ea170cd/users/4b71bb52c3074c0c95dea3e584486246/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:55.938176 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2d7cd-3595-4af7-8842-a6235cf77ca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=760e5bebef164e4895e2ab727ea170cd, user_id=4b71bb52c3074c0c95dea3e584486246, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:55.941623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2d7cd-3595-4af7-8842-a6235cf77ca4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:55.952296 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1298/2632] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:54:55 2022] PUT /identity/v3/projects/760e5bebef164e4895e2ab727ea170cd/users/4b71bb52c3074c0c95dea3e584486246/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:54:55.958095 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1335/2633] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:54:55 2022] PUT /identity/v3/projects/eb4f1511040a45cb99633b3ded958178/users/d9021dbaaa5148f1839ba2e37e870686/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:54:55.965254 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815da9af-21d6-44be-bb95-75d860ea2f3b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:55.965546 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815da9af-21d6-44be-bb95-75d860ea2f3b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:55.965867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815da9af-21d6-44be-bb95-75d860ea2f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:55.968136 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4376722-477a-44f8-82cb-08154e8947ef None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:55.968421 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4376722-477a-44f8-82cb-08154e8947ef None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:55.968717 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4376722-477a-44f8-82cb-08154e8947ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:55.983210 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:55.994767 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:55.997839 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a4376722-477a-44f8-82cb-08154e8947ef None None] MFA Rules not processed for user `d9021dbaaa5148f1839ba2e37e870686`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:54:55.999193 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a4376722-477a-44f8-82cb-08154e8947ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:56.000484 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-815da9af-21d6-44be-bb95-75d860ea2f3b None None] MFA Rules not processed for user `4b71bb52c3074c0c95dea3e584486246`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:54:56.001726 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-815da9af-21d6-44be-bb95-75d860ea2f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:56.066656 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1336/2634] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:54:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:54:56.078514 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1299/2635] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:54:55 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:54:56.078680 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4376722-477a-44f8-82cb-08154e8947ef None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:56.081864 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a4376722-477a-44f8-82cb-08154e8947ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:56.086178 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815da9af-21d6-44be-bb95-75d860ea2f3b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:56.087671 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-815da9af-21d6-44be-bb95-75d860ea2f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:56.140771 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4376722-477a-44f8-82cb-08154e8947ef None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:56.144657 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08441a4-7105-4de2-8fdb-207db55fa30e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:56.145048 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815da9af-21d6-44be-bb95-75d860ea2f3b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:56.145262 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08441a4-7105-4de2-8fdb-207db55fa30e service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:56.145608 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08441a4-7105-4de2-8fdb-207db55fa30e service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:56.145988 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08441a4-7105-4de2-8fdb-207db55fa30e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:56.148773 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac1c83-421d-4b57-a516-a2833732bae7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:56.149402 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac1c83-421d-4b57-a516-a2833732bae7 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:56.149705 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac1c83-421d-4b57-a516-a2833732bae7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:56.150010 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac1c83-421d-4b57-a516-a2833732bae7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:56.155412 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08441a4-7105-4de2-8fdb-207db55fa30e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:56.156876 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08441a4-7105-4de2-8fdb-207db55fa30e service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:56.160834 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac1c83-421d-4b57-a516-a2833732bae7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:56.162399 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac1c83-421d-4b57-a516-a2833732bae7 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:56.168661 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1337/2636] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:54:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:54:56.174987 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1300/2637] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:54:56 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 03:54:58.039659 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08441a4-7105-4de2-8fdb-207db55fa30e service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:58.103259 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08441a4-7105-4de2-8fdb-207db55fa30e service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:58.108494 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec3472-4568-445a-8e61-368b39910c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:58.109149 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec3472-4568-445a-8e61-368b39910c07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:58.109431 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec3472-4568-445a-8e61-368b39910c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:58.109734 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec3472-4568-445a-8e61-368b39910c07 admin admin] PATH_INFO: `/v3/users/e09d897b738f4e5e9f17832664cbb6de` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:58.110867 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec3472-4568-445a-8e61-368b39910c07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e09d897b738f4e5e9f17832664cbb6de)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:58.112798 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec3472-4568-445a-8e61-368b39910c07 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:58.194150 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1194e1b-d8db-444d-aa4d-0a871575b356 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:58.194719 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1194e1b-d8db-444d-aa4d-0a871575b356 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:58.194719 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1194e1b-d8db-444d-aa4d-0a871575b356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:58.214488 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a1194e1b-d8db-444d-aa4d-0a871575b356 None None] MFA Rules not processed for user `d9021dbaaa5148f1839ba2e37e870686`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:54:58.215674 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a1194e1b-d8db-444d-aa4d-0a871575b356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:58.223219 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1301/2638] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:54:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:54:58.410612 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-71ec3472-4568-445a-8e61-368b39910c07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e09d897b738f4e5e9f17832664cbb6de'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:58.411260 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-71ec3472-4568-445a-8e61-368b39910c07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e09d897b738f4e5e9f17832664cbb6de'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:58.412522 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:58.418896 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-71ec3472-4568-445a-8e61-368b39910c07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e09d897b738f4e5e9f17832664cbb6de'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:58.434554 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-71ec3472-4568-445a-8e61-368b39910c07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e09d897b738f4e5e9f17832664cbb6de'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:58.435283 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-71ec3472-4568-445a-8e61-368b39910c07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e09d897b738f4e5e9f17832664cbb6de'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:58.545877 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1338/2639] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:54:58 2022] DELETE /identity/v3/users/e09d897b738f4e5e9f17832664cbb6de => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:54:58.550582 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9f9c1-d59c-4059-aee3-d93599c6e5a6 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:58.551254 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9f9c1-d59c-4059-aee3-d93599c6e5a6 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:58.551254 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9f9c1-d59c-4059-aee3-d93599c6e5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:58.572732 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-51d9f9c1-d59c-4059-aee3-d93599c6e5a6 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:54:58.573991 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-51d9f9c1-d59c-4059-aee3-d93599c6e5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:58.631679 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:58.642009 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1302/2640] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:54:58.651794 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec3472-4568-445a-8e61-368b39910c07 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:58.653409 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-71ec3472-4568-445a-8e61-368b39910c07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:58.716497 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec3472-4568-445a-8e61-368b39910c07 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:58.720099 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4111c-c21c-4b0d-80e3-8020a300b451 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:58.720707 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4111c-c21c-4b0d-80e3-8020a300b451 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:58.721017 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4111c-c21c-4b0d-80e3-8020a300b451 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:58.721291 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4111c-c21c-4b0d-80e3-8020a300b451 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:58.732031 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4111c-c21c-4b0d-80e3-8020a300b451 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:58.733467 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4111c-c21c-4b0d-80e3-8020a300b451 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:58.744835 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1339/2641] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:54:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:54:59.191635 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9f9c1-d59c-4059-aee3-d93599c6e5a6 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:59.193189 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-51d9f9c1-d59c-4059-aee3-d93599c6e5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:59.205351 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9f9c1-d59c-4059-aee3-d93599c6e5a6 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:59.210222 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f0281-44b4-43be-b29e-681b36a17406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:59.212578 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f0281-44b4-43be-b29e-681b36a17406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:59.212578 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f0281-44b4-43be-b29e-681b36a17406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:59.212578 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f0281-44b4-43be-b29e-681b36a17406 admin admin] PATH_INFO: `/v3/projects/48d431d69a1a4a96838b9e7c7ace0cf1` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:59.212578 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f0281-44b4-43be-b29e-681b36a17406 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48d431d69a1a4a96838b9e7c7ace0cf1)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:59.214629 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f0281-44b4-43be-b29e-681b36a17406 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:59.391133 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b05f0281-44b4-43be-b29e-681b36a17406 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48d431d69a1a4a96838b9e7c7ace0cf1', 'request_id': 'req-b05f0281-44b4-43be-b29e-681b36a17406'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:59.482010 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b05f0281-44b4-43be-b29e-681b36a17406 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48d431d69a1a4a96838b9e7c7ace0cf1', 'request_id': 'req-b05f0281-44b4-43be-b29e-681b36a17406'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:59.491359 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b05f0281-44b4-43be-b29e-681b36a17406 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48d431d69a1a4a96838b9e7c7ace0cf1', 'request_id': 'req-b05f0281-44b4-43be-b29e-681b36a17406'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:59.502452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b05f0281-44b4-43be-b29e-681b36a17406 admin admin] The token cache is being invalidate because project 48d431d69a1a4a96838b9e7c7ace0cf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:54:59.502750 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b05f0281-44b4-43be-b29e-681b36a17406 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:59.503440 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b05f0281-44b4-43be-b29e-681b36a17406 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:59.504945 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1303/2642] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:54:59 2022] DELETE /identity/v3/projects/48d431d69a1a4a96838b9e7c7ace0cf1 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:54:59.508932 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4111c-c21c-4b0d-80e3-8020a300b451 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:59.522191 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4111c-c21c-4b0d-80e3-8020a300b451 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:54:59.581990 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00f2fc-fa10-4337-b404-9e7a59aedb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:54:59.582624 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00f2fc-fa10-4337-b404-9e7a59aedb8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:54:59.582909 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00f2fc-fa10-4337-b404-9e7a59aedb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:54:59.583175 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00f2fc-fa10-4337-b404-9e7a59aedb8a admin admin] PATH_INFO: `/v3/users/4b71bb52c3074c0c95dea3e584486246` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:54:59.584510 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00f2fc-fa10-4337-b404-9e7a59aedb8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b71bb52c3074c0c95dea3e584486246)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:54:59.586388 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00f2fc-fa10-4337-b404-9e7a59aedb8a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:54:59.753228 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7e00f2fc-fa10-4337-b404-9e7a59aedb8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b71bb52c3074c0c95dea3e584486246'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:59.753901 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7e00f2fc-fa10-4337-b404-9e7a59aedb8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b71bb52c3074c0c95dea3e584486246'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:59.760735 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7e00f2fc-fa10-4337-b404-9e7a59aedb8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b71bb52c3074c0c95dea3e584486246'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:59.772198 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:54:59.776679 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7e00f2fc-fa10-4337-b404-9e7a59aedb8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b71bb52c3074c0c95dea3e584486246'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:59.779355 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7e00f2fc-fa10-4337-b404-9e7a59aedb8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b71bb52c3074c0c95dea3e584486246'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:54:59.856588 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1340/2643] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:54:59 2022] DELETE /identity/v3/users/4b71bb52c3074c0c95dea3e584486246 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:54:59.877046 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f0281-44b4-43be-b29e-681b36a17406 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:54:59.878937 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b05f0281-44b4-43be-b29e-681b36a17406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:54:59.974331 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f0281-44b4-43be-b29e-681b36a17406 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:00.026415 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05206ae1-b195-4866-8df8-c0164ffa4a81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:00.027023 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05206ae1-b195-4866-8df8-c0164ffa4a81 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:00.027300 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05206ae1-b195-4866-8df8-c0164ffa4a81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:00.027570 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05206ae1-b195-4866-8df8-c0164ffa4a81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:00.029328 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-05206ae1-b195-4866-8df8-c0164ffa4a81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:00.081791 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:00.096806 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05206ae1-b195-4866-8df8-c0164ffa4a81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:00.098408 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05206ae1-b195-4866-8df8-c0164ffa4a81 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:00.108439 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1304/2644] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:54:59 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:55:00.683955 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00f2fc-fa10-4337-b404-9e7a59aedb8a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:00.685760 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7e00f2fc-fa10-4337-b404-9e7a59aedb8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:00.761393 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00f2fc-fa10-4337-b404-9e7a59aedb8a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:00.766216 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4c250-2b6f-4b36-877b-d5665cdcdcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:00.766880 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4c250-2b6f-4b36-877b-d5665cdcdcb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:00.767184 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4c250-2b6f-4b36-877b-d5665cdcdcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:00.768728 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4c250-2b6f-4b36-877b-d5665cdcdcb9 admin admin] PATH_INFO: `/v3/projects/760e5bebef164e4895e2ab727ea170cd` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:00.769968 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc4c250-2b6f-4b36-877b-d5665cdcdcb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=760e5bebef164e4895e2ab727ea170cd)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:00.771853 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc4c250-2b6f-4b36-877b-d5665cdcdcb9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:01.005999 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9cc4c250-2b6f-4b36-877b-d5665cdcdcb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '760e5bebef164e4895e2ab727ea170cd', 'request_id': 'req-9cc4c250-2b6f-4b36-877b-d5665cdcdcb9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:01.138940 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9cc4c250-2b6f-4b36-877b-d5665cdcdcb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '760e5bebef164e4895e2ab727ea170cd', 'request_id': 'req-9cc4c250-2b6f-4b36-877b-d5665cdcdcb9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:01.151634 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9cc4c250-2b6f-4b36-877b-d5665cdcdcb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '760e5bebef164e4895e2ab727ea170cd', 'request_id': 'req-9cc4c250-2b6f-4b36-877b-d5665cdcdcb9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:01.165424 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9cc4c250-2b6f-4b36-877b-d5665cdcdcb9 admin admin] The token cache is being invalidate because project 760e5bebef164e4895e2ab727ea170cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:55:01.167776 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9cc4c250-2b6f-4b36-877b-d5665cdcdcb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:01.167776 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9cc4c250-2b6f-4b36-877b-d5665cdcdcb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:01.168311 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1341/2645] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:55:00 2022] DELETE /identity/v3/projects/760e5bebef164e4895e2ab727ea170cd => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:55:01.173257 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cc8ad-c20b-47bb-8ab1-aced1fd717b6 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:01.173779 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cc8ad-c20b-47bb-8ab1-aced1fd717b6 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:01.173886 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cc8ad-c20b-47bb-8ab1-aced1fd717b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:01.203750 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a77cc8ad-c20b-47bb-8ab1-aced1fd717b6 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:55:01.205350 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a77cc8ad-c20b-47bb-8ab1-aced1fd717b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:01.275535 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1305/2646] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:55:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:55:01.282935 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ea175-8a94-4e1e-9182-7c2de8075200 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:01.283617 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ea175-8a94-4e1e-9182-7c2de8075200 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:01.284092 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ea175-8a94-4e1e-9182-7c2de8075200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:01.315517 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-582ea175-8a94-4e1e-9182-7c2de8075200 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:55:01.316802 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-582ea175-8a94-4e1e-9182-7c2de8075200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:01.336186 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1342/2647] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:55:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:55:01.341212 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cc8ad-c20b-47bb-8ab1-aced1fd717b6 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:01.352324 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cc8ad-c20b-47bb-8ab1-aced1fd717b6 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:01.357237 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ff8b1-3fa1-4529-a9e2-c6a6cae41736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:01.357987 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ff8b1-3fa1-4529-a9e2-c6a6cae41736 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:01.358207 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ff8b1-3fa1-4529-a9e2-c6a6cae41736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:01.358795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ff8b1-3fa1-4529-a9e2-c6a6cae41736 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:01.359320 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ff8b1-3fa1-4529-a9e2-c6a6cae41736 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:55:01.359477 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ff8b1-3fa1-4529-a9e2-c6a6cae41736 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:01.361113 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ff8b1-3fa1-4529-a9e2-c6a6cae41736 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:01.385794 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1306/2648] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:55:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:55:01.387367 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ea175-8a94-4e1e-9182-7c2de8075200 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:01.398325 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ea175-8a94-4e1e-9182-7c2de8075200 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:01.409399 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6d075-e314-4aa0-8ffa-f71be1abc2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:01.409399 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6d075-e314-4aa0-8ffa-f71be1abc2b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:01.409399 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6d075-e314-4aa0-8ffa-f71be1abc2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:01.409399 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6d075-e314-4aa0-8ffa-f71be1abc2b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:01.409871 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6d075-e314-4aa0-8ffa-f71be1abc2b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:01.411363 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6d075-e314-4aa0-8ffa-f71be1abc2b7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:01.597776 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1343/2649] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:55:01 2022] POST /identity/v3/projects => generated 377 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:55:01.605184 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ff8b1-3fa1-4529-a9e2-c6a6cae41736 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:01.615126 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ff8b1-3fa1-4529-a9e2-c6a6cae41736 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:01.675021 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568110c-2f79-4a78-8173-293baa69b7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:01.675642 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568110c-2f79-4a78-8173-293baa69b7fc admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:01.675910 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568110c-2f79-4a78-8173-293baa69b7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:01.676180 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568110c-2f79-4a78-8173-293baa69b7fc admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:01.676862 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568110c-2f79-4a78-8173-293baa69b7fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:01.678790 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568110c-2f79-4a78-8173-293baa69b7fc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:01.834334 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1307/2650] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:55:01 2022] POST /identity/v3/users => generated 289 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:55:01.835517 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6d075-e314-4aa0-8ffa-f71be1abc2b7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:01.847705 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6d075-e314-4aa0-8ffa-f71be1abc2b7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:01.853507 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc74b1-d9f6-4f18-9347-692612ba9aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:01.854198 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc74b1-d9f6-4f18-9347-692612ba9aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:01.854475 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc74b1-d9f6-4f18-9347-692612ba9aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:01.854747 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc74b1-d9f6-4f18-9347-692612ba9aa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:01.855387 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc74b1-d9f6-4f18-9347-692612ba9aa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:01.856984 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc74b1-d9f6-4f18-9347-692612ba9aa8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:01.868184 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1344/2651] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:55:01.872485 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568110c-2f79-4a78-8173-293baa69b7fc admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:01.883233 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568110c-2f79-4a78-8173-293baa69b7fc admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:01.887969 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9c0a0-5a38-45e5-b85d-87d8c02103dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:01.890914 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9c0a0-5a38-45e5-b85d-87d8c02103dc admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:01.890914 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9c0a0-5a38-45e5-b85d-87d8c02103dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:01.890914 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9c0a0-5a38-45e5-b85d-87d8c02103dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:01.890914 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d9c0a0-5a38-45e5-b85d-87d8c02103dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:01.891467 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d9c0a0-5a38-45e5-b85d-87d8c02103dc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:01.903193 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1308/2652] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:55:01.907402 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc74b1-d9f6-4f18-9347-692612ba9aa8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:01.918960 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc74b1-d9f6-4f18-9347-692612ba9aa8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:01.923777 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a4358-b48a-4736-870a-dcb956a623a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:01.925250 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a4358-b48a-4736-870a-dcb956a623a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:01.925361 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a4358-b48a-4736-870a-dcb956a623a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:01.925579 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a4358-b48a-4736-870a-dcb956a623a2 admin admin] PATH_INFO: `/v3/projects/ffff0ed61a484be190c17d7189682ede/users/6d42e34a2d9e4bdcae362a489e016cc6/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:01.942821 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a4358-b48a-4736-870a-dcb956a623a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffff0ed61a484be190c17d7189682ede, user_id=6d42e34a2d9e4bdcae362a489e016cc6, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:01.945143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a4358-b48a-4736-870a-dcb956a623a2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:02.054372 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1345/2653] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:55:01 2022] PUT /identity/v3/projects/ffff0ed61a484be190c17d7189682ede/users/6d42e34a2d9e4bdcae362a489e016cc6/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:55:02.066829 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb0af0-954e-410c-9acc-aacfd1a23f02 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:02.067356 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb0af0-954e-410c-9acc-aacfd1a23f02 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:02.067822 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb0af0-954e-410c-9acc-aacfd1a23f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:02.122683 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-61fb0af0-954e-410c-9acc-aacfd1a23f02 None None] MFA Rules not processed for user `6d42e34a2d9e4bdcae362a489e016cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:55:02.123582 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-61fb0af0-954e-410c-9acc-aacfd1a23f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:02.173485 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:02.231618 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1309/2654] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:55:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:55:02.232332 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a4358-b48a-4736-870a-dcb956a623a2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:02.263065 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:02.322397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a4358-b48a-4736-870a-dcb956a623a2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:02.328592 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07994308-0cfa-41cc-a1a8-333dc7007ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:02.328592 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07994308-0cfa-41cc-a1a8-333dc7007ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:02.328592 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07994308-0cfa-41cc-a1a8-333dc7007ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:02.328861 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07994308-0cfa-41cc-a1a8-333dc7007ef7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:02.329326 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07994308-0cfa-41cc-a1a8-333dc7007ef7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:02.331376 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07994308-0cfa-41cc-a1a8-333dc7007ef7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:02.433437 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1346/2655] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:55:02 2022] POST /identity/v3/projects => generated 381 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:55:02.437262 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb0af0-954e-410c-9acc-aacfd1a23f02 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:02.447905 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb0af0-954e-410c-9acc-aacfd1a23f02 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:02.505888 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672789bc-c8d9-4a06-92e3-dc07d6d65a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:02.506510 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672789bc-c8d9-4a06-92e3-dc07d6d65a64 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:02.506797 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672789bc-c8d9-4a06-92e3-dc07d6d65a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:02.507071 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672789bc-c8d9-4a06-92e3-dc07d6d65a64 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:02.507722 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672789bc-c8d9-4a06-92e3-dc07d6d65a64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:02.509708 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672789bc-c8d9-4a06-92e3-dc07d6d65a64 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:02.606525 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1310/2656] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:55:02 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:55:02.607778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07994308-0cfa-41cc-a1a8-333dc7007ef7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:02.619158 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07994308-0cfa-41cc-a1a8-333dc7007ef7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:02.625398 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e995eeb-6806-42d4-9ee9-b69a44fc9b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:02.626054 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e995eeb-6806-42d4-9ee9-b69a44fc9b32 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:02.626337 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e995eeb-6806-42d4-9ee9-b69a44fc9b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:02.626619 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e995eeb-6806-42d4-9ee9-b69a44fc9b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:02.627271 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e995eeb-6806-42d4-9ee9-b69a44fc9b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:02.629299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e995eeb-6806-42d4-9ee9-b69a44fc9b32 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:02.646637 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1347/2657] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:55:02.648073 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672789bc-c8d9-4a06-92e3-dc07d6d65a64 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:02.659740 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672789bc-c8d9-4a06-92e3-dc07d6d65a64 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:02.664898 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24fa84-ae02-45c5-8000-08b7a6ecb0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:02.665613 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24fa84-ae02-45c5-8000-08b7a6ecb0bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:02.665937 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24fa84-ae02-45c5-8000-08b7a6ecb0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:02.666216 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24fa84-ae02-45c5-8000-08b7a6ecb0bd admin admin] PATH_INFO: `/v3/projects/e9d8c30122c247dd83307a8215b598fd/users/546365d482b949beaae6bfd9f5f23cbf/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:02.682821 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c24fa84-ae02-45c5-8000-08b7a6ecb0bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9d8c30122c247dd83307a8215b598fd, user_id=546365d482b949beaae6bfd9f5f23cbf, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:02.686769 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c24fa84-ae02-45c5-8000-08b7a6ecb0bd admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:02.825538 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1311/2658] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:55:02 2022] PUT /identity/v3/projects/e9d8c30122c247dd83307a8215b598fd/users/546365d482b949beaae6bfd9f5f23cbf/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:55:02.829224 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e995eeb-6806-42d4-9ee9-b69a44fc9b32 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:02.840173 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e995eeb-6806-42d4-9ee9-b69a44fc9b32 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:02.898768 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61663bec-8595-43f3-a58e-7f35be917bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:02.899473 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61663bec-8595-43f3-a58e-7f35be917bbf admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:02.899954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61663bec-8595-43f3-a58e-7f35be917bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:02.900309 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61663bec-8595-43f3-a58e-7f35be917bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:02.901021 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61663bec-8595-43f3-a58e-7f35be917bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:02.902773 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61663bec-8595-43f3-a58e-7f35be917bbf admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:02.914372 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1348/2659] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:55:02.918311 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24fa84-ae02-45c5-8000-08b7a6ecb0bd admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:02.929080 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24fa84-ae02-45c5-8000-08b7a6ecb0bd admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:02.934059 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb3c45b-af88-4b37-93c3-408d4f54f594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:02.934720 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3c45b-af88-4b37-93c3-408d4f54f594 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:02.935128 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3c45b-af88-4b37-93c3-408d4f54f594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:02.935261 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3c45b-af88-4b37-93c3-408d4f54f594 admin admin] PATH_INFO: `/v3/projects/e9d8c30122c247dd83307a8215b598fd/users/546365d482b949beaae6bfd9f5f23cbf/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:02.937314 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb3c45b-af88-4b37-93c3-408d4f54f594 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9d8c30122c247dd83307a8215b598fd, user_id=546365d482b949beaae6bfd9f5f23cbf, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:02.940548 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb3c45b-af88-4b37-93c3-408d4f54f594 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:02.952066 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1312/2660] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:55:02 2022] PUT /identity/v3/projects/e9d8c30122c247dd83307a8215b598fd/users/546365d482b949beaae6bfd9f5f23cbf/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:55:02.963549 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4117cd-f5c2-47e2-bb5a-e399998cd6fc None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:02.963769 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4117cd-f5c2-47e2-bb5a-e399998cd6fc None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:02.964121 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4117cd-f5c2-47e2-bb5a-e399998cd6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:02.992523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8b4117cd-f5c2-47e2-bb5a-e399998cd6fc None None] MFA Rules not processed for user `546365d482b949beaae6bfd9f5f23cbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:55:02.993878 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8b4117cd-f5c2-47e2-bb5a-e399998cd6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:03.066274 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1349/2661] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:55:02 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:55:03.080974 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb3c45b-af88-4b37-93c3-408d4f54f594 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:03.083172 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ffb3c45b-af88-4b37-93c3-408d4f54f594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:03.163172 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb3c45b-af88-4b37-93c3-408d4f54f594 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:03.166679 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8baa03b-58e4-4f8e-bdae-32317e358e3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:03.167459 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8baa03b-58e4-4f8e-bdae-32317e358e3a service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:03.167837 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8baa03b-58e4-4f8e-bdae-32317e358e3a service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:03.168538 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8baa03b-58e4-4f8e-bdae-32317e358e3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:03.188632 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8baa03b-58e4-4f8e-bdae-32317e358e3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:03.191285 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8baa03b-58e4-4f8e-bdae-32317e358e3a service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:03.203127 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1313/2662] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:55:03 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:55:03.952265 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4117cd-f5c2-47e2-bb5a-e399998cd6fc None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:03.965333 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:04.061300 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4117cd-f5c2-47e2-bb5a-e399998cd6fc None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:04.072265 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a3525-826f-490d-b860-4ae58a01a6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:04.073278 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a3525-826f-490d-b860-4ae58a01a6ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:04.073908 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a3525-826f-490d-b860-4ae58a01a6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:04.074406 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a3525-826f-490d-b860-4ae58a01a6ee admin admin] PATH_INFO: `/v3/users/6d42e34a2d9e4bdcae362a489e016cc6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:04.075891 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a3525-826f-490d-b860-4ae58a01a6ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d42e34a2d9e4bdcae362a489e016cc6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:04.078198 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a3525-826f-490d-b860-4ae58a01a6ee admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:04.371564 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d60a3525-826f-490d-b860-4ae58a01a6ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d42e34a2d9e4bdcae362a489e016cc6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:04.372427 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d60a3525-826f-490d-b860-4ae58a01a6ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d42e34a2d9e4bdcae362a489e016cc6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:04.385266 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d60a3525-826f-490d-b860-4ae58a01a6ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d42e34a2d9e4bdcae362a489e016cc6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:04.409743 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d60a3525-826f-490d-b860-4ae58a01a6ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d42e34a2d9e4bdcae362a489e016cc6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:04.410976 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d60a3525-826f-490d-b860-4ae58a01a6ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d42e34a2d9e4bdcae362a489e016cc6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:04.512186 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1350/2663] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:55:03 2022] DELETE /identity/v3/users/6d42e34a2d9e4bdcae362a489e016cc6 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:55:04.516553 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359b5c1-1d54-4c0a-8bc2-501047d1db2d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:04.517096 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359b5c1-1d54-4c0a-8bc2-501047d1db2d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:04.517196 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359b5c1-1d54-4c0a-8bc2-501047d1db2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:04.549296 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f359b5c1-1d54-4c0a-8bc2-501047d1db2d None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:55:04.550574 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f359b5c1-1d54-4c0a-8bc2-501047d1db2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:04.597840 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:04.659400 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1314/2664] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:55:04.678690 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a3525-826f-490d-b860-4ae58a01a6ee admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:04.680549 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d60a3525-826f-490d-b860-4ae58a01a6ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:04.756648 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a3525-826f-490d-b860-4ae58a01a6ee admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:04.762031 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26717e-f9a9-4943-b7ce-b4076459c963 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:04.762661 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26717e-f9a9-4943-b7ce-b4076459c963 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:04.762990 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26717e-f9a9-4943-b7ce-b4076459c963 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:04.763282 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26717e-f9a9-4943-b7ce-b4076459c963 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:04.794025 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b26717e-f9a9-4943-b7ce-b4076459c963 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:04.795258 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b26717e-f9a9-4943-b7ce-b4076459c963 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:04.805868 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1351/2665] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:55:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:55:05.554645 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359b5c1-1d54-4c0a-8bc2-501047d1db2d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:05.556130 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f359b5c1-1d54-4c0a-8bc2-501047d1db2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:05.573125 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359b5c1-1d54-4c0a-8bc2-501047d1db2d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:05.585017 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19fba1-256f-496f-bb2b-e3962c850736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:05.585897 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19fba1-256f-496f-bb2b-e3962c850736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:05.586182 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19fba1-256f-496f-bb2b-e3962c850736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:05.586575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19fba1-256f-496f-bb2b-e3962c850736 admin admin] PATH_INFO: `/v3/projects/ffff0ed61a484be190c17d7189682ede` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:05.588308 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19fba1-256f-496f-bb2b-e3962c850736 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffff0ed61a484be190c17d7189682ede)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:05.590452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19fba1-256f-496f-bb2b-e3962c850736 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:05.710242 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-aa19fba1-256f-496f-bb2b-e3962c850736 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffff0ed61a484be190c17d7189682ede', 'request_id': 'req-aa19fba1-256f-496f-bb2b-e3962c850736'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:05.785610 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-aa19fba1-256f-496f-bb2b-e3962c850736 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffff0ed61a484be190c17d7189682ede', 'request_id': 'req-aa19fba1-256f-496f-bb2b-e3962c850736'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:05.796372 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-aa19fba1-256f-496f-bb2b-e3962c850736 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffff0ed61a484be190c17d7189682ede', 'request_id': 'req-aa19fba1-256f-496f-bb2b-e3962c850736'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:05.813049 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-aa19fba1-256f-496f-bb2b-e3962c850736 admin admin] The token cache is being invalidate because project ffff0ed61a484be190c17d7189682ede was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:55:05.813548 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-aa19fba1-256f-496f-bb2b-e3962c850736 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:05.815049 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-aa19fba1-256f-496f-bb2b-e3962c850736 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:05.820102 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1315/2666] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:55:05 2022] DELETE /identity/v3/projects/ffff0ed61a484be190c17d7189682ede => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:55:05.821759 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26717e-f9a9-4943-b7ce-b4076459c963 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:05.840088 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26717e-f9a9-4943-b7ce-b4076459c963 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:05.880395 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:05.923463 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca3f68d-dfe7-4946-94d6-fafc5978d602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:05.924336 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3f68d-dfe7-4946-94d6-fafc5978d602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:05.924857 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3f68d-dfe7-4946-94d6-fafc5978d602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:05.925203 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3f68d-dfe7-4946-94d6-fafc5978d602 admin admin] PATH_INFO: `/v3/users/546365d482b949beaae6bfd9f5f23cbf` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:05.926571 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca3f68d-dfe7-4946-94d6-fafc5978d602 admin admin] RBAC: Authorizing `identity:delete_user(user_id=546365d482b949beaae6bfd9f5f23cbf)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:05.929005 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca3f68d-dfe7-4946-94d6-fafc5978d602 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:06.078517 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4ca3f68d-dfe7-4946-94d6-fafc5978d602 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '546365d482b949beaae6bfd9f5f23cbf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:06.079176 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4ca3f68d-dfe7-4946-94d6-fafc5978d602 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '546365d482b949beaae6bfd9f5f23cbf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:06.086666 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4ca3f68d-dfe7-4946-94d6-fafc5978d602 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '546365d482b949beaae6bfd9f5f23cbf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:06.098057 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4ca3f68d-dfe7-4946-94d6-fafc5978d602 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '546365d482b949beaae6bfd9f5f23cbf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:06.098799 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4ca3f68d-dfe7-4946-94d6-fafc5978d602 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '546365d482b949beaae6bfd9f5f23cbf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:06.190974 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1352/2667] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:55:05 2022] DELETE /identity/v3/users/546365d482b949beaae6bfd9f5f23cbf => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:55:06.651112 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19fba1-256f-496f-bb2b-e3962c850736 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:06.652373 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-aa19fba1-256f-496f-bb2b-e3962c850736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:06.668938 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19fba1-256f-496f-bb2b-e3962c850736 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:06.734575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9352304-4e6d-44bb-988a-ed01729fe391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:06.735207 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9352304-4e6d-44bb-988a-ed01729fe391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:06.735513 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9352304-4e6d-44bb-988a-ed01729fe391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:06.735789 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9352304-4e6d-44bb-988a-ed01729fe391 admin admin] PATH_INFO: `/v3/projects/e9d8c30122c247dd83307a8215b598fd` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:06.737581 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9352304-4e6d-44bb-988a-ed01729fe391 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9d8c30122c247dd83307a8215b598fd)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:06.739541 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9352304-4e6d-44bb-988a-ed01729fe391 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:06.881323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b9352304-4e6d-44bb-988a-ed01729fe391 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9d8c30122c247dd83307a8215b598fd', 'request_id': 'req-b9352304-4e6d-44bb-988a-ed01729fe391'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:06.973147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b9352304-4e6d-44bb-988a-ed01729fe391 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9d8c30122c247dd83307a8215b598fd', 'request_id': 'req-b9352304-4e6d-44bb-988a-ed01729fe391'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:06.982549 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b9352304-4e6d-44bb-988a-ed01729fe391 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9d8c30122c247dd83307a8215b598fd', 'request_id': 'req-b9352304-4e6d-44bb-988a-ed01729fe391'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:06.989151 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:06.995528 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b9352304-4e6d-44bb-988a-ed01729fe391 admin admin] The token cache is being invalidate because project e9d8c30122c247dd83307a8215b598fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:55:06.996286 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b9352304-4e6d-44bb-988a-ed01729fe391 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:06.996460 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b9352304-4e6d-44bb-988a-ed01729fe391 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:06.999556 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1316/2668] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:55:06 2022] DELETE /identity/v3/projects/e9d8c30122c247dd83307a8215b598fd => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:55:07.003371 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d53f0b-83d7-4b30-9a05-2602fa3fd0dc None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:07.003828 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d53f0b-83d7-4b30-9a05-2602fa3fd0dc None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:07.004107 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d53f0b-83d7-4b30-9a05-2602fa3fd0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:07.024760 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-70d53f0b-83d7-4b30-9a05-2602fa3fd0dc None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:55:07.026023 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-70d53f0b-83d7-4b30-9a05-2602fa3fd0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:07.094338 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1353/2669] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:55:07.103509 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea25156-ecf3-4cb6-a788-2fc571fe3d5d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:07.103839 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea25156-ecf3-4cb6-a788-2fc571fe3d5d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:07.104135 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea25156-ecf3-4cb6-a788-2fc571fe3d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:07.128234 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8ea25156-ecf3-4cb6-a788-2fc571fe3d5d None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:55:07.129462 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8ea25156-ecf3-4cb6-a788-2fc571fe3d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:07.138592 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1317/2670] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:55:07.143576 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d53f0b-83d7-4b30-9a05-2602fa3fd0dc None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:07.154532 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d53f0b-83d7-4b30-9a05-2602fa3fd0dc None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:07.162368 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5d5c0-2738-46cb-b67c-da6a8abacf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:07.163006 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5d5c0-2738-46cb-b67c-da6a8abacf69 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:07.163317 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5d5c0-2738-46cb-b67c-da6a8abacf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:07.163625 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5d5c0-2738-46cb-b67c-da6a8abacf69 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:07.164500 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5d5c0-2738-46cb-b67c-da6a8abacf69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:55:07.164805 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5d5c0-2738-46cb-b67c-da6a8abacf69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:07.166691 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5d5c0-2738-46cb-b67c-da6a8abacf69 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:07.184841 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1354/2671] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:55:07.190959 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea25156-ecf3-4cb6-a788-2fc571fe3d5d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:07.204255 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea25156-ecf3-4cb6-a788-2fc571fe3d5d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:07.210409 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575c23b-f454-4c32-abec-0c3ccbd80800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:07.211019 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575c23b-f454-4c32-abec-0c3ccbd80800 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:07.211299 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575c23b-f454-4c32-abec-0c3ccbd80800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:07.215082 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575c23b-f454-4c32-abec-0c3ccbd80800 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:07.215836 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575c23b-f454-4c32-abec-0c3ccbd80800 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:07.218804 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575c23b-f454-4c32-abec-0c3ccbd80800 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:07.310539 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1318/2672] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:55:07 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:55:07.314245 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5d5c0-2738-46cb-b67c-da6a8abacf69 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:07.325379 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5d5c0-2738-46cb-b67c-da6a8abacf69 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:07.362080 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:07.390393 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12850b-39f1-4db5-84db-2143577c4b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:07.391010 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12850b-39f1-4db5-84db-2143577c4b25 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:07.391469 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12850b-39f1-4db5-84db-2143577c4b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:07.391628 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12850b-39f1-4db5-84db-2143577c4b25 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:07.392188 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c12850b-39f1-4db5-84db-2143577c4b25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:07.394712 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c12850b-39f1-4db5-84db-2143577c4b25 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:07.492877 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1355/2673] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:55:07 2022] POST /identity/v3/users => generated 292 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:55:07.496852 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575c23b-f454-4c32-abec-0c3ccbd80800 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:07.497044 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12850b-39f1-4db5-84db-2143577c4b25 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:07.498709 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c575c23b-f454-4c32-abec-0c3ccbd80800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:07.512243 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12850b-39f1-4db5-84db-2143577c4b25 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:07.519412 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a823f9-7e30-407c-8729-0b84dfe644c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:07.520771 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a823f9-7e30-407c-8729-0b84dfe644c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:07.521167 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a823f9-7e30-407c-8729-0b84dfe644c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:07.521510 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a823f9-7e30-407c-8729-0b84dfe644c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:07.522537 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a823f9-7e30-407c-8729-0b84dfe644c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:07.526251 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a823f9-7e30-407c-8729-0b84dfe644c6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:07.540717 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1356/2674] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:55:07.544744 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a823f9-7e30-407c-8729-0b84dfe644c6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:07.559870 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a823f9-7e30-407c-8729-0b84dfe644c6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:07.569570 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a84db-c9df-4874-996b-0ba485c4672c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:07.570453 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a84db-c9df-4874-996b-0ba485c4672c admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:07.570860 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a84db-c9df-4874-996b-0ba485c4672c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:07.571323 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a84db-c9df-4874-996b-0ba485c4672c admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:07.572550 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a84db-c9df-4874-996b-0ba485c4672c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:07.574728 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a84db-c9df-4874-996b-0ba485c4672c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:07.592211 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1357/2675] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:55:07.596162 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a84db-c9df-4874-996b-0ba485c4672c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:07.609680 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a84db-c9df-4874-996b-0ba485c4672c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:07.616473 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110a819-098c-4618-ad91-d399fc137258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:07.617386 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110a819-098c-4618-ad91-d399fc137258 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:07.617919 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110a819-098c-4618-ad91-d399fc137258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:07.618212 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110a819-098c-4618-ad91-d399fc137258 admin admin] PATH_INFO: `/v3/projects/b095823780fa414db95a70922150534d/users/9255b7b1cb174c13a8ba2b8cd2098616/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:07.622961 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575c23b-f454-4c32-abec-0c3ccbd80800 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:07.633400 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1445d8-4275-4a88-a62f-00212c583841 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:07.635074 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1445d8-4275-4a88-a62f-00212c583841 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:07.635580 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1445d8-4275-4a88-a62f-00212c583841 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:07.636076 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1445d8-4275-4a88-a62f-00212c583841 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:07.638384 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8110a819-098c-4618-ad91-d399fc137258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b095823780fa414db95a70922150534d, user_id=9255b7b1cb174c13a8ba2b8cd2098616, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:07.639280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cb1445d8-4275-4a88-a62f-00212c583841 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:07.641366 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8110a819-098c-4618-ad91-d399fc137258 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:07.654041 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1445d8-4275-4a88-a62f-00212c583841 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:07.658118 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1445d8-4275-4a88-a62f-00212c583841 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:07.677858 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1319/2676] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:55:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 03:55:07.715604 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1358/2677] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:55:07 2022] PUT /identity/v3/projects/b095823780fa414db95a70922150534d/users/9255b7b1cb174c13a8ba2b8cd2098616/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:55:07.730318 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2c34b-a200-4e86-b2ee-19e7fc557188 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:07.730318 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2c34b-a200-4e86-b2ee-19e7fc557188 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:07.730318 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2c34b-a200-4e86-b2ee-19e7fc557188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:07.778357 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-dfc2c34b-a200-4e86-b2ee-19e7fc557188 None None] MFA Rules not processed for user `9255b7b1cb174c13a8ba2b8cd2098616`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:55:07.779898 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dfc2c34b-a200-4e86-b2ee-19e7fc557188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:07.863714 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1320/2678] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:55:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:55:07.868039 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110a819-098c-4618-ad91-d399fc137258 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:07.975813 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110a819-098c-4618-ad91-d399fc137258 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:07.983168 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105116c-5420-4ad5-8774-357f637903c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:07.983782 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105116c-5420-4ad5-8774-357f637903c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:07.984080 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105116c-5420-4ad5-8774-357f637903c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:07.984378 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105116c-5420-4ad5-8774-357f637903c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:07.984998 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5105116c-5420-4ad5-8774-357f637903c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:07.988490 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5105116c-5420-4ad5-8774-357f637903c9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:08.091563 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1359/2679] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:55:07 2022] POST /identity/v3/projects => generated 383 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:55:08.094802 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc2c34b-a200-4e86-b2ee-19e7fc557188 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:08.116630 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc2c34b-a200-4e86-b2ee-19e7fc557188 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:08.166752 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:08.197042 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada4600-929b-4adf-bcc9-0344f43c231e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:08.197723 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada4600-929b-4adf-bcc9-0344f43c231e admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:08.197968 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada4600-929b-4adf-bcc9-0344f43c231e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:08.198378 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada4600-929b-4adf-bcc9-0344f43c231e admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:08.199027 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada4600-929b-4adf-bcc9-0344f43c231e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:08.200961 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada4600-929b-4adf-bcc9-0344f43c231e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:08.393522 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1321/2680] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:55:08 2022] POST /identity/v3/users => generated 298 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:55:08.397574 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105116c-5420-4ad5-8774-357f637903c9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:08.414929 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105116c-5420-4ad5-8774-357f637903c9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:08.428009 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b360ba-d891-4db6-afc4-5cfccd24b8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:08.429102 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b360ba-d891-4db6-afc4-5cfccd24b8b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:08.429827 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b360ba-d891-4db6-afc4-5cfccd24b8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:08.431059 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b360ba-d891-4db6-afc4-5cfccd24b8b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:08.432165 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b360ba-d891-4db6-afc4-5cfccd24b8b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:08.434116 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b360ba-d891-4db6-afc4-5cfccd24b8b9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:08.447289 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1360/2681] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:55:08.451465 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada4600-929b-4adf-bcc9-0344f43c231e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:08.468522 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada4600-929b-4adf-bcc9-0344f43c231e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:08.476783 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea167d5-021a-4298-9f0d-36492ba5ab4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:08.477811 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea167d5-021a-4298-9f0d-36492ba5ab4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:08.478093 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea167d5-021a-4298-9f0d-36492ba5ab4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:08.478544 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea167d5-021a-4298-9f0d-36492ba5ab4c admin admin] PATH_INFO: `/v3/projects/511b220fc6f443ad89ff22741e447e81/users/4b06cefe44ee44308f814a7d0b9503e2/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:08.497993 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea167d5-021a-4298-9f0d-36492ba5ab4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=511b220fc6f443ad89ff22741e447e81, user_id=4b06cefe44ee44308f814a7d0b9503e2, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:08.500800 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea167d5-021a-4298-9f0d-36492ba5ab4c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:08.610784 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1322/2682] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:55:08 2022] PUT /identity/v3/projects/511b220fc6f443ad89ff22741e447e81/users/4b06cefe44ee44308f814a7d0b9503e2/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:55:08.615708 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b360ba-d891-4db6-afc4-5cfccd24b8b9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:08.626373 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b360ba-d891-4db6-afc4-5cfccd24b8b9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:08.679505 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:08.686132 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778cde0-f887-46c9-a20e-ed7e4ad9275b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:08.686738 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778cde0-f887-46c9-a20e-ed7e4ad9275b admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:08.687014 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778cde0-f887-46c9-a20e-ed7e4ad9275b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:08.687287 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778cde0-f887-46c9-a20e-ed7e4ad9275b admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:08.687972 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4778cde0-f887-46c9-a20e-ed7e4ad9275b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:08.689611 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4778cde0-f887-46c9-a20e-ed7e4ad9275b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:08.700050 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1361/2683] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:55:08.708066 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea167d5-021a-4298-9f0d-36492ba5ab4c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:08.720117 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea167d5-021a-4298-9f0d-36492ba5ab4c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:08.725376 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2e2a9-a60c-4dd2-81d5-1379be3975b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:08.726076 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2e2a9-a60c-4dd2-81d5-1379be3975b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:08.726355 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2e2a9-a60c-4dd2-81d5-1379be3975b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:08.726651 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2e2a9-a60c-4dd2-81d5-1379be3975b5 admin admin] PATH_INFO: `/v3/projects/511b220fc6f443ad89ff22741e447e81/users/4b06cefe44ee44308f814a7d0b9503e2/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:08.728612 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e2e2a9-a60c-4dd2-81d5-1379be3975b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=511b220fc6f443ad89ff22741e447e81, user_id=4b06cefe44ee44308f814a7d0b9503e2, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:08.731344 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e2e2a9-a60c-4dd2-81d5-1379be3975b5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:08.742036 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1323/2684] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:55:08 2022] PUT /identity/v3/projects/511b220fc6f443ad89ff22741e447e81/users/4b06cefe44ee44308f814a7d0b9503e2/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:55:08.752435 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c898583-210e-4225-b7f5-c276e60e305c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:08.752728 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c898583-210e-4225-b7f5-c276e60e305c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:08.753008 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c898583-210e-4225-b7f5-c276e60e305c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:08.781858 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8c898583-210e-4225-b7f5-c276e60e305c None None] MFA Rules not processed for user `4b06cefe44ee44308f814a7d0b9503e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:55:08.783115 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8c898583-210e-4225-b7f5-c276e60e305c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:08.854094 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1362/2685] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:55:08 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:55:08.866420 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2e2a9-a60c-4dd2-81d5-1379be3975b5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:08.868135 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-28e2e2a9-a60c-4dd2-81d5-1379be3975b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:08.927096 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2e2a9-a60c-4dd2-81d5-1379be3975b5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:08.930913 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df9495-d9b2-4496-ad52-46e6cf289942 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:08.931467 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df9495-d9b2-4496-ad52-46e6cf289942 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:08.931744 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df9495-d9b2-4496-ad52-46e6cf289942 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:08.932015 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df9495-d9b2-4496-ad52-46e6cf289942 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:08.941504 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df9495-d9b2-4496-ad52-46e6cf289942 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:08.942967 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df9495-d9b2-4496-ad52-46e6cf289942 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:08.952414 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1324/2686] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:55:08 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:55:09.090944 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c898583-210e-4225-b7f5-c276e60e305c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:09.100921 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c898583-210e-4225-b7f5-c276e60e305c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:09.104708 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a376a7-bb90-46b7-b0cf-dac6e1025185 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:09.105500 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a376a7-bb90-46b7-b0cf-dac6e1025185 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:09.105883 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a376a7-bb90-46b7-b0cf-dac6e1025185 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:09.106158 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a376a7-bb90-46b7-b0cf-dac6e1025185 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:09.164700 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a376a7-bb90-46b7-b0cf-dac6e1025185 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:09.166242 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a376a7-bb90-46b7-b0cf-dac6e1025185 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:09.175378 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1363/2687] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:55:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:55:09.716092 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df9495-d9b2-4496-ad52-46e6cf289942 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:09.785290 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df9495-d9b2-4496-ad52-46e6cf289942 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:09.790429 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886da343-a022-4c38-a5b6-1670d89c53d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:09.791067 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886da343-a022-4c38-a5b6-1670d89c53d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:09.791347 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886da343-a022-4c38-a5b6-1670d89c53d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:09.791625 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886da343-a022-4c38-a5b6-1670d89c53d5 admin admin] PATH_INFO: `/v3/users/9255b7b1cb174c13a8ba2b8cd2098616` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:09.792778 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886da343-a022-4c38-a5b6-1670d89c53d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9255b7b1cb174c13a8ba2b8cd2098616)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:09.794767 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886da343-a022-4c38-a5b6-1670d89c53d5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:09.943705 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:09.952763 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-886da343-a022-4c38-a5b6-1670d89c53d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9255b7b1cb174c13a8ba2b8cd2098616'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:09.953439 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-886da343-a022-4c38-a5b6-1670d89c53d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9255b7b1cb174c13a8ba2b8cd2098616'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:09.960762 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-886da343-a022-4c38-a5b6-1670d89c53d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9255b7b1cb174c13a8ba2b8cd2098616'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:09.973472 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-886da343-a022-4c38-a5b6-1670d89c53d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9255b7b1cb174c13a8ba2b8cd2098616'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:09.974183 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-886da343-a022-4c38-a5b6-1670d89c53d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9255b7b1cb174c13a8ba2b8cd2098616'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:10.060293 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1325/2688] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:55:09 2022] DELETE /identity/v3/users/9255b7b1cb174c13a8ba2b8cd2098616 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:55:10.065287 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5866ff-224d-4009-9ce0-ffaaedd3bd70 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:10.065570 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5866ff-224d-4009-9ce0-ffaaedd3bd70 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:10.065873 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5866ff-224d-4009-9ce0-ffaaedd3bd70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:10.085835 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2e5866ff-224d-4009-9ce0-ffaaedd3bd70 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:55:10.087019 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2e5866ff-224d-4009-9ce0-ffaaedd3bd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:10.144280 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1364/2689] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:55:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:55:10.154069 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886da343-a022-4c38-a5b6-1670d89c53d5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:10.155592 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-886da343-a022-4c38-a5b6-1670d89c53d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:10.212492 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886da343-a022-4c38-a5b6-1670d89c53d5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:10.216086 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9000d-6d81-40a0-bdf8-3278645e1f88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:10.216689 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9000d-6d81-40a0-bdf8-3278645e1f88 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:10.216975 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9000d-6d81-40a0-bdf8-3278645e1f88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:10.217339 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9000d-6d81-40a0-bdf8-3278645e1f88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:10.226887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed9000d-6d81-40a0-bdf8-3278645e1f88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:10.235574 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed9000d-6d81-40a0-bdf8-3278645e1f88 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:10.237530 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1326/2690] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:55:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:55:10.684482 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5866ff-224d-4009-9ce0-ffaaedd3bd70 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:10.687716 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2e5866ff-224d-4009-9ce0-ffaaedd3bd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:10.708889 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5866ff-224d-4009-9ce0-ffaaedd3bd70 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:10.713858 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3e90d-acdb-4bec-b45c-5e535fd5db17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:10.715940 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3e90d-acdb-4bec-b45c-5e535fd5db17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:10.715940 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3e90d-acdb-4bec-b45c-5e535fd5db17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:10.715940 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3e90d-acdb-4bec-b45c-5e535fd5db17 admin admin] PATH_INFO: `/v3/projects/b095823780fa414db95a70922150534d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:10.716565 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e3e90d-acdb-4bec-b45c-5e535fd5db17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b095823780fa414db95a70922150534d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:10.718533 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e3e90d-acdb-4bec-b45c-5e535fd5db17 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:10.730250 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:10.842722 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-45e3e90d-acdb-4bec-b45c-5e535fd5db17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b095823780fa414db95a70922150534d', 'request_id': 'req-45e3e90d-acdb-4bec-b45c-5e535fd5db17'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:10.921724 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-45e3e90d-acdb-4bec-b45c-5e535fd5db17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b095823780fa414db95a70922150534d', 'request_id': 'req-45e3e90d-acdb-4bec-b45c-5e535fd5db17'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:10.928917 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-45e3e90d-acdb-4bec-b45c-5e535fd5db17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b095823780fa414db95a70922150534d', 'request_id': 'req-45e3e90d-acdb-4bec-b45c-5e535fd5db17'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:10.939512 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-45e3e90d-acdb-4bec-b45c-5e535fd5db17 admin admin] The token cache is being invalidate because project b095823780fa414db95a70922150534d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:55:10.939801 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-45e3e90d-acdb-4bec-b45c-5e535fd5db17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:10.940468 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-45e3e90d-acdb-4bec-b45c-5e535fd5db17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:10.942008 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1365/2691] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:55:10 2022] DELETE /identity/v3/projects/b095823780fa414db95a70922150534d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:55:10.947829 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9000d-6d81-40a0-bdf8-3278645e1f88 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:10.956153 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9000d-6d81-40a0-bdf8-3278645e1f88 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:11.016932 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fbfbe-a950-438a-a9f3-071110bf9810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:11.017616 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fbfbe-a950-438a-a9f3-071110bf9810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:11.018400 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fbfbe-a950-438a-a9f3-071110bf9810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:11.018673 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fbfbe-a950-438a-a9f3-071110bf9810 admin admin] PATH_INFO: `/v3/users/4b06cefe44ee44308f814a7d0b9503e2` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:11.019924 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1fbfbe-a950-438a-a9f3-071110bf9810 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b06cefe44ee44308f814a7d0b9503e2)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:11.021967 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1fbfbe-a950-438a-a9f3-071110bf9810 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:11.226546 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ed1fbfbe-a950-438a-a9f3-071110bf9810 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b06cefe44ee44308f814a7d0b9503e2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:11.227191 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ed1fbfbe-a950-438a-a9f3-071110bf9810 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b06cefe44ee44308f814a7d0b9503e2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:11.234230 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ed1fbfbe-a950-438a-a9f3-071110bf9810 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b06cefe44ee44308f814a7d0b9503e2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:11.235322 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:11.246260 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ed1fbfbe-a950-438a-a9f3-071110bf9810 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b06cefe44ee44308f814a7d0b9503e2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:11.246891 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ed1fbfbe-a950-438a-a9f3-071110bf9810 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b06cefe44ee44308f814a7d0b9503e2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:11.315572 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1327/2692] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:55:10 2022] DELETE /identity/v3/users/4b06cefe44ee44308f814a7d0b9503e2 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:55:11.740352 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3e90d-acdb-4bec-b45c-5e535fd5db17 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:11.741924 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-45e3e90d-acdb-4bec-b45c-5e535fd5db17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:11.755464 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3e90d-acdb-4bec-b45c-5e535fd5db17 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:11.812897 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1a656-2a56-4d97-8c42-e53b8d2f235d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:11.813555 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1a656-2a56-4d97-8c42-e53b8d2f235d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:11.813868 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1a656-2a56-4d97-8c42-e53b8d2f235d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:11.814148 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1a656-2a56-4d97-8c42-e53b8d2f235d admin admin] PATH_INFO: `/v3/projects/511b220fc6f443ad89ff22741e447e81` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:11.815797 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1a656-2a56-4d97-8c42-e53b8d2f235d admin admin] RBAC: Authorizing `identity:delete_project(project_id=511b220fc6f443ad89ff22741e447e81)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:11.817766 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1a656-2a56-4d97-8c42-e53b8d2f235d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:11.951939 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-daa1a656-2a56-4d97-8c42-e53b8d2f235d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '511b220fc6f443ad89ff22741e447e81', 'request_id': 'req-daa1a656-2a56-4d97-8c42-e53b8d2f235d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:12.047357 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-daa1a656-2a56-4d97-8c42-e53b8d2f235d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '511b220fc6f443ad89ff22741e447e81', 'request_id': 'req-daa1a656-2a56-4d97-8c42-e53b8d2f235d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:12.054267 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-daa1a656-2a56-4d97-8c42-e53b8d2f235d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '511b220fc6f443ad89ff22741e447e81', 'request_id': 'req-daa1a656-2a56-4d97-8c42-e53b8d2f235d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:12.064459 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-daa1a656-2a56-4d97-8c42-e53b8d2f235d admin admin] The token cache is being invalidate because project 511b220fc6f443ad89ff22741e447e81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:55:12.065251 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-daa1a656-2a56-4d97-8c42-e53b8d2f235d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:12.065904 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-daa1a656-2a56-4d97-8c42-e53b8d2f235d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:12.067368 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1366/2693] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:55:11 2022] DELETE /identity/v3/projects/511b220fc6f443ad89ff22741e447e81 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:55:12.072310 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480cfc7-3695-4dec-874a-4e8a5c973450 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:12.072775 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480cfc7-3695-4dec-874a-4e8a5c973450 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:12.072870 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480cfc7-3695-4dec-874a-4e8a5c973450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:12.092733 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0480cfc7-3695-4dec-874a-4e8a5c973450 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:55:12.093987 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0480cfc7-3695-4dec-874a-4e8a5c973450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:12.152866 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1328/2694] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:55:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:55:12.219505 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9eabb6-0691-4dbb-89c7-ad4d4aa71ff9 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:12.219790 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9eabb6-0691-4dbb-89c7-ad4d4aa71ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:12.220089 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9eabb6-0691-4dbb-89c7-ad4d4aa71ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:12.240776 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0e9eabb6-0691-4dbb-89c7-ad4d4aa71ff9 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:55:12.241955 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0e9eabb6-0691-4dbb-89c7-ad4d4aa71ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:12.253614 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1367/2695] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:55:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:55:12.255104 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480cfc7-3695-4dec-874a-4e8a5c973450 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:12.265015 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480cfc7-3695-4dec-874a-4e8a5c973450 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:12.270208 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ffcaa8-9d20-4607-ac80-a8977859dd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:12.270879 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffcaa8-9d20-4607-ac80-a8977859dd0d admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:12.271168 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffcaa8-9d20-4607-ac80-a8977859dd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:12.271670 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffcaa8-9d20-4607-ac80-a8977859dd0d admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:12.272336 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ffcaa8-9d20-4607-ac80-a8977859dd0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:55:12.272666 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ffcaa8-9d20-4607-ac80-a8977859dd0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:12.274299 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ffcaa8-9d20-4607-ac80-a8977859dd0d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:12.287988 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1329/2696] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:55:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:55:12.292523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9eabb6-0691-4dbb-89c7-ad4d4aa71ff9 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:12.305549 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9eabb6-0691-4dbb-89c7-ad4d4aa71ff9 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:12.310399 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d73f9-7b68-4819-9620-eb318156a161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:12.311058 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d73f9-7b68-4819-9620-eb318156a161 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:12.314060 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d73f9-7b68-4819-9620-eb318156a161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:12.314060 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d73f9-7b68-4819-9620-eb318156a161 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:12.314060 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d73f9-7b68-4819-9620-eb318156a161 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:12.318340 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d73f9-7b68-4819-9620-eb318156a161 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:12.403299 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:12.410102 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1368/2697] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:55:12 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:55:12.414462 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ffcaa8-9d20-4607-ac80-a8977859dd0d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:12.425144 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ffcaa8-9d20-4607-ac80-a8977859dd0d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:12.483555 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd02c08-4ff4-417b-bd4b-5cf9e22d3e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:12.484157 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd02c08-4ff4-417b-bd4b-5cf9e22d3e3c admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:12.484436 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd02c08-4ff4-417b-bd4b-5cf9e22d3e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:12.484710 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd02c08-4ff4-417b-bd4b-5cf9e22d3e3c admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:12.485338 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd02c08-4ff4-417b-bd4b-5cf9e22d3e3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:12.487845 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd02c08-4ff4-417b-bd4b-5cf9e22d3e3c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:12.595801 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1330/2698] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:55:12 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:55:12.599875 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d73f9-7b68-4819-9620-eb318156a161 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:12.610886 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d73f9-7b68-4819-9620-eb318156a161 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:12.615802 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374a958-5d45-4a86-b747-ad79f3516683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:12.616432 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374a958-5d45-4a86-b747-ad79f3516683 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:12.616709 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374a958-5d45-4a86-b747-ad79f3516683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:12.616965 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374a958-5d45-4a86-b747-ad79f3516683 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:12.617660 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374a958-5d45-4a86-b747-ad79f3516683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:12.619277 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374a958-5d45-4a86-b747-ad79f3516683 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:12.629501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1369/2699] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:55:12.633451 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd02c08-4ff4-417b-bd4b-5cf9e22d3e3c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:12.644222 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd02c08-4ff4-417b-bd4b-5cf9e22d3e3c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:12.648979 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670a634-6352-476e-9654-8cc7c4f110fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:12.649579 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670a634-6352-476e-9654-8cc7c4f110fe admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:12.649897 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670a634-6352-476e-9654-8cc7c4f110fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:12.650190 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670a634-6352-476e-9654-8cc7c4f110fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:12.650824 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670a634-6352-476e-9654-8cc7c4f110fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:12.652427 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670a634-6352-476e-9654-8cc7c4f110fe admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:12.664161 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1331/2700] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:55:12.674915 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374a958-5d45-4a86-b747-ad79f3516683 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:12.684812 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374a958-5d45-4a86-b747-ad79f3516683 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:12.691605 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4546c88-63bf-42b6-8f66-ef338bfd330c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:12.692272 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4546c88-63bf-42b6-8f66-ef338bfd330c admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:12.692548 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4546c88-63bf-42b6-8f66-ef338bfd330c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:12.692817 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4546c88-63bf-42b6-8f66-ef338bfd330c admin admin] PATH_INFO: `/v3/projects/43086e4638394c00849331bfc792f69f/users/6022084f3e1d49049ce81b6f6d0cd2e5/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:12.710388 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4546c88-63bf-42b6-8f66-ef338bfd330c admin admin] RBAC: Authorizing `identity:create_grant(project_id=43086e4638394c00849331bfc792f69f, user_id=6022084f3e1d49049ce81b6f6d0cd2e5, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:12.713169 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4546c88-63bf-42b6-8f66-ef338bfd330c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:12.818944 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1370/2701] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:55:12 2022] PUT /identity/v3/projects/43086e4638394c00849331bfc792f69f/users/6022084f3e1d49049ce81b6f6d0cd2e5/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:55:12.829076 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ce502-2bc5-4b12-b3b1-fcba4061eac0 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:12.829362 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ce502-2bc5-4b12-b3b1-fcba4061eac0 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:12.829657 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ce502-2bc5-4b12-b3b1-fcba4061eac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:12.857331 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4b3ce502-2bc5-4b12-b3b1-fcba4061eac0 None None] MFA Rules not processed for user `6022084f3e1d49049ce81b6f6d0cd2e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:55:12.858498 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4b3ce502-2bc5-4b12-b3b1-fcba4061eac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:12.887173 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:12.922120 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1332/2702] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:55:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:55:12.926611 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4546c88-63bf-42b6-8f66-ef338bfd330c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:12.985743 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4546c88-63bf-42b6-8f66-ef338bfd330c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:12.990953 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb63b9-07df-4d05-89d2-05c867a81197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:12.991545 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb63b9-07df-4d05-89d2-05c867a81197 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:12.991829 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb63b9-07df-4d05-89d2-05c867a81197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:12.992097 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb63b9-07df-4d05-89d2-05c867a81197 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:12.992711 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb63b9-07df-4d05-89d2-05c867a81197 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:12.994689 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb63b9-07df-4d05-89d2-05c867a81197 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:13.112862 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1371/2703] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:55:12 2022] POST /identity/v3/projects => generated 385 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:55:13.116824 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ce502-2bc5-4b12-b3b1-fcba4061eac0 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:13.128585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ce502-2bc5-4b12-b3b1-fcba4061eac0 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:13.185957 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d20ab9-d83a-4f4c-88f1-0248eee49b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:13.186645 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d20ab9-d83a-4f4c-88f1-0248eee49b8c admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:13.187015 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d20ab9-d83a-4f4c-88f1-0248eee49b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:13.187348 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d20ab9-d83a-4f4c-88f1-0248eee49b8c admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:13.188038 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d20ab9-d83a-4f4c-88f1-0248eee49b8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:13.190643 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d20ab9-d83a-4f4c-88f1-0248eee49b8c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:13.322316 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1333/2704] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:55:13 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:55:13.326403 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb63b9-07df-4d05-89d2-05c867a81197 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:13.337556 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb63b9-07df-4d05-89d2-05c867a81197 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:13.342349 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915fb4b-9b84-49a3-a920-1b02ced4ae33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:13.342948 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915fb4b-9b84-49a3-a920-1b02ced4ae33 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:13.343224 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915fb4b-9b84-49a3-a920-1b02ced4ae33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:13.343496 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915fb4b-9b84-49a3-a920-1b02ced4ae33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:13.344129 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a915fb4b-9b84-49a3-a920-1b02ced4ae33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:13.346245 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a915fb4b-9b84-49a3-a920-1b02ced4ae33 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:13.356952 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1372/2705] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:55:13.361250 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d20ab9-d83a-4f4c-88f1-0248eee49b8c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:13.372062 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d20ab9-d83a-4f4c-88f1-0248eee49b8c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:13.377006 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371dbed6-e0dd-49d0-a199-e867601af3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:13.377743 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371dbed6-e0dd-49d0-a199-e867601af3c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:13.378083 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371dbed6-e0dd-49d0-a199-e867601af3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:13.378364 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371dbed6-e0dd-49d0-a199-e867601af3c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:13.379010 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371dbed6-e0dd-49d0-a199-e867601af3c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:13.384185 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371dbed6-e0dd-49d0-a199-e867601af3c8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:13.398265 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1334/2706] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:55:13.399534 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915fb4b-9b84-49a3-a920-1b02ced4ae33 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:13.411183 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915fb4b-9b84-49a3-a920-1b02ced4ae33 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:13.418715 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef0322-3293-4455-b3e8-2170258bc5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:13.419597 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef0322-3293-4455-b3e8-2170258bc5b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:13.420112 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef0322-3293-4455-b3e8-2170258bc5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:13.420425 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef0322-3293-4455-b3e8-2170258bc5b9 admin admin] PATH_INFO: `/v3/projects/052bcb4c1be34a2a941dc977acc76342/users/127145174ee44b89b9380e8e0af1b485/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:13.437858 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef0322-3293-4455-b3e8-2170258bc5b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=052bcb4c1be34a2a941dc977acc76342, user_id=127145174ee44b89b9380e8e0af1b485, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:13.440686 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef0322-3293-4455-b3e8-2170258bc5b9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:13.521659 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1373/2707] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:55:13 2022] PUT /identity/v3/projects/052bcb4c1be34a2a941dc977acc76342/users/127145174ee44b89b9380e8e0af1b485/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:55:13.536885 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308402c2-7904-4ef8-b275-c4b6aaef9455 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:13.537196 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308402c2-7904-4ef8-b275-c4b6aaef9455 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:13.537519 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308402c2-7904-4ef8-b275-c4b6aaef9455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:13.566617 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-308402c2-7904-4ef8-b275-c4b6aaef9455 None None] MFA Rules not processed for user `127145174ee44b89b9380e8e0af1b485`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:55:13.567975 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-308402c2-7904-4ef8-b275-c4b6aaef9455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:13.637973 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1335/2708] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:55:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:55:13.642611 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef0322-3293-4455-b3e8-2170258bc5b9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:13.712411 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef0322-3293-4455-b3e8-2170258bc5b9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:13.717154 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e8cd9-e246-46f7-8d55-45957a94804f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:13.717794 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e8cd9-e246-46f7-8d55-45957a94804f admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:13.718076 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e8cd9-e246-46f7-8d55-45957a94804f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:13.718351 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e8cd9-e246-46f7-8d55-45957a94804f admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:13.718985 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e8cd9-e246-46f7-8d55-45957a94804f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:13.721513 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e8cd9-e246-46f7-8d55-45957a94804f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:13.814461 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:13.820873 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1374/2709] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:55:13 2022] POST /identity/v3/projects => generated 385 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:55:13.824919 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308402c2-7904-4ef8-b275-c4b6aaef9455 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:13.835964 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308402c2-7904-4ef8-b275-c4b6aaef9455 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:13.868547 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:13.890454 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a3465-8a5c-4ec5-8135-d5593163819a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:13.891113 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a3465-8a5c-4ec5-8135-d5593163819a admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:13.891421 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a3465-8a5c-4ec5-8135-d5593163819a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:13.891694 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a3465-8a5c-4ec5-8135-d5593163819a admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:13.892325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a3465-8a5c-4ec5-8135-d5593163819a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:13.894769 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a3465-8a5c-4ec5-8135-d5593163819a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:13.978736 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1336/2710] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:55:13 2022] POST /identity/v3/users => generated 299 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:55:13.982726 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e8cd9-e246-46f7-8d55-45957a94804f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:13.993166 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e8cd9-e246-46f7-8d55-45957a94804f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:13.997841 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d8f20-f6d6-4b0f-9574-a0fb15bea440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:13.998450 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d8f20-f6d6-4b0f-9574-a0fb15bea440 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:13.998719 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d8f20-f6d6-4b0f-9574-a0fb15bea440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:13.998992 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d8f20-f6d6-4b0f-9574-a0fb15bea440 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:13.999631 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d8f20-f6d6-4b0f-9574-a0fb15bea440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:14.001218 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d8f20-f6d6-4b0f-9574-a0fb15bea440 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:14.012414 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1375/2711] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:55:14.016506 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a3465-8a5c-4ec5-8135-d5593163819a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:14.026933 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a3465-8a5c-4ec5-8135-d5593163819a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:14.031458 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371f030-c85e-491f-b04d-a9f47ee55cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:14.032098 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371f030-c85e-491f-b04d-a9f47ee55cd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:14.032378 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371f030-c85e-491f-b04d-a9f47ee55cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:14.032652 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371f030-c85e-491f-b04d-a9f47ee55cd4 admin admin] PATH_INFO: `/v3/projects/b3859795355b4350adea72029649b5ce/users/e7e2328e9c5747a2b7008ffc1a539868/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:14.048477 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371f030-c85e-491f-b04d-a9f47ee55cd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3859795355b4350adea72029649b5ce, user_id=e7e2328e9c5747a2b7008ffc1a539868, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:14.051182 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371f030-c85e-491f-b04d-a9f47ee55cd4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:14.167709 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1337/2712] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:55:14 2022] PUT /identity/v3/projects/b3859795355b4350adea72029649b5ce/users/e7e2328e9c5747a2b7008ffc1a539868/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:55:14.171545 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d8f20-f6d6-4b0f-9574-a0fb15bea440 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:14.181692 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d8f20-f6d6-4b0f-9574-a0fb15bea440 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:14.236837 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3757c50-5142-4736-b2e4-8ccb995c3510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:14.237440 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3757c50-5142-4736-b2e4-8ccb995c3510 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:14.237753 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3757c50-5142-4736-b2e4-8ccb995c3510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:14.238027 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3757c50-5142-4736-b2e4-8ccb995c3510 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:14.238652 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3757c50-5142-4736-b2e4-8ccb995c3510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:14.240221 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3757c50-5142-4736-b2e4-8ccb995c3510 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:14.249558 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1376/2713] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:55:14 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:55:14.254209 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371f030-c85e-491f-b04d-a9f47ee55cd4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:14.264204 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371f030-c85e-491f-b04d-a9f47ee55cd4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:14.269474 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f062f7-38d8-4e81-9db4-5d57b0afa86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:14.270165 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f062f7-38d8-4e81-9db4-5d57b0afa86e admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:14.270451 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f062f7-38d8-4e81-9db4-5d57b0afa86e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:14.270729 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f062f7-38d8-4e81-9db4-5d57b0afa86e admin admin] PATH_INFO: `/v3/projects/b3859795355b4350adea72029649b5ce/users/e7e2328e9c5747a2b7008ffc1a539868/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:14.272738 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f062f7-38d8-4e81-9db4-5d57b0afa86e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3859795355b4350adea72029649b5ce, user_id=e7e2328e9c5747a2b7008ffc1a539868, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:14.275395 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f062f7-38d8-4e81-9db4-5d57b0afa86e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:14.285598 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1338/2714] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:55:14 2022] PUT /identity/v3/projects/b3859795355b4350adea72029649b5ce/users/e7e2328e9c5747a2b7008ffc1a539868/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:55:14.297265 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bc70b-9565-4d86-882d-9cb65c86b113 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:14.297553 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bc70b-9565-4d86-882d-9cb65c86b113 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:14.297857 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bc70b-9565-4d86-882d-9cb65c86b113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:14.325351 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6f2bc70b-9565-4d86-882d-9cb65c86b113 None None] MFA Rules not processed for user `e7e2328e9c5747a2b7008ffc1a539868`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:55:14.326677 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6f2bc70b-9565-4d86-882d-9cb65c86b113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:14.393743 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1377/2715] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:55:14 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:55:14.404750 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f062f7-38d8-4e81-9db4-5d57b0afa86e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:14.406488 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-67f062f7-38d8-4e81-9db4-5d57b0afa86e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:14.464239 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f062f7-38d8-4e81-9db4-5d57b0afa86e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:14.467831 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a56a22-0b5c-46c1-8487-54cadae89377 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:14.468453 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a56a22-0b5c-46c1-8487-54cadae89377 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:14.468758 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a56a22-0b5c-46c1-8487-54cadae89377 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:14.468999 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a56a22-0b5c-46c1-8487-54cadae89377 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:14.526081 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a56a22-0b5c-46c1-8487-54cadae89377 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:14.527586 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a56a22-0b5c-46c1-8487-54cadae89377 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:14.537941 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1339/2716] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:55:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:55:17.020124 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2bc70b-9565-4d86-882d-9cb65c86b113 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:17.022403 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6f2bc70b-9565-4d86-882d-9cb65c86b113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:17.038229 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2bc70b-9565-4d86-882d-9cb65c86b113 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:17.042945 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9356d23-7b6e-43bd-a2cc-b58bb8492425 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:17.044421 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9356d23-7b6e-43bd-a2cc-b58bb8492425 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:17.044421 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9356d23-7b6e-43bd-a2cc-b58bb8492425 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:17.044421 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9356d23-7b6e-43bd-a2cc-b58bb8492425 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:17.140717 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9356d23-7b6e-43bd-a2cc-b58bb8492425 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:17.142258 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9356d23-7b6e-43bd-a2cc-b58bb8492425 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:17.155188 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1378/2717] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:55:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:55:18.057701 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999e38b-3d76-470a-976c-14c4d57e065f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:18.058203 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999e38b-3d76-470a-976c-14c4d57e065f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:18.058304 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999e38b-3d76-470a-976c-14c4d57e065f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:18.087234 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1999e38b-3d76-470a-976c-14c4d57e065f None None] MFA Rules not processed for user `b0812002d7b14bcb81a42eb380231feb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:55:18.088440 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1999e38b-3d76-470a-976c-14c4d57e065f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:18.122479 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:18.147184 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1340/2718] 10.222.0.33 () {58 vars in 1009 bytes} [Fri Sep 16 03:55:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:55:18.170957 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9356d23-7b6e-43bd-a2cc-b58bb8492425 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:18.172410 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d9356d23-7b6e-43bd-a2cc-b58bb8492425 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:18.192204 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:18.267265 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9356d23-7b6e-43bd-a2cc-b58bb8492425 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:18.272832 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a03dd-d727-4edd-9cbb-6911085a85d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f784d98d5f440c681f53ae70f6d1cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:18.273442 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a03dd-d727-4edd-9cbb-6911085a85d1 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:18.273763 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a03dd-d727-4edd-9cbb-6911085a85d1 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:18.274036 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a03dd-d727-4edd-9cbb-6911085a85d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:18.289868 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a03dd-d727-4edd-9cbb-6911085a85d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:18.289868 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a03dd-d727-4edd-9cbb-6911085a85d1 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:18.294304 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1379/2719] 10.222.0.33 () {60 vars in 1384 bytes} [Fri Sep 16 03:55:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 03:55:18.631739 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058f70d-bbec-4074-87fc-2b4c2f3008b4 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:18.636221 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058f70d-bbec-4074-87fc-2b4c2f3008b4 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:18.636221 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058f70d-bbec-4074-87fc-2b4c2f3008b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:18.658082 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e058f70d-bbec-4074-87fc-2b4c2f3008b4 None None] MFA Rules not processed for user `b0812002d7b14bcb81a42eb380231feb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:55:18.659983 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e058f70d-bbec-4074-87fc-2b4c2f3008b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:18.667991 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1341/2720] 10.222.0.33 () {58 vars in 1009 bytes} [Fri Sep 16 03:55:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:55:18.683376 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a03dd-d727-4edd-9cbb-6911085a85d1 service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:18.707844 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a03dd-d727-4edd-9cbb-6911085a85d1 service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:18.713606 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f6c913-cac3-4ce5-8a81-90c41996a7fb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f784d98d5f440c681f53ae70f6d1cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:18.714300 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6c913-cac3-4ce5-8a81-90c41996a7fb service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:18.714902 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6c913-cac3-4ce5-8a81-90c41996a7fb service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:18.715374 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6c913-cac3-4ce5-8a81-90c41996a7fb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:18.727000 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f6c913-cac3-4ce5-8a81-90c41996a7fb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:18.728846 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f6c913-cac3-4ce5-8a81-90c41996a7fb service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:18.739004 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1380/2721] 10.222.0.33 () {60 vars in 1384 bytes} [Fri Sep 16 03:55:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 03:55:19.079686 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058f70d-bbec-4074-87fc-2b4c2f3008b4 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:19.089747 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058f70d-bbec-4074-87fc-2b4c2f3008b4 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:19.094370 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7de3be-234f-4b21-a173-c351c59f53fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:19.095187 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7de3be-234f-4b21-a173-c351c59f53fb service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:19.095469 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7de3be-234f-4b21-a173-c351c59f53fb service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:19.095742 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7de3be-234f-4b21-a173-c351c59f53fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:19.106895 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7de3be-234f-4b21-a173-c351c59f53fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:19.108332 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7de3be-234f-4b21-a173-c351c59f53fb service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:19.120602 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1342/2722] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:55:19 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:55:20.208478 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb784b-ea4c-4a40-9a44-3bd1f7a651ae None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:20.208979 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb784b-ea4c-4a40-9a44-3bd1f7a651ae None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:20.209096 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb784b-ea4c-4a40-9a44-3bd1f7a651ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:20.229928 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-79cb784b-ea4c-4a40-9a44-3bd1f7a651ae None None] MFA Rules not processed for user `b0812002d7b14bcb81a42eb380231feb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:55:20.231623 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-79cb784b-ea4c-4a40-9a44-3bd1f7a651ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:20.242368 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1381/2723] 10.222.0.33 () {58 vars in 967 bytes} [Fri Sep 16 03:55:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:55:20.259891 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7de3be-234f-4b21-a173-c351c59f53fb service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:20.275033 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7de3be-234f-4b21-a173-c351c59f53fb service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:20.280970 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ea93b-bd7f-48ba-9ee6-004b75f7dd51 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f784d98d5f440c681f53ae70f6d1cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:20.281577 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ea93b-bd7f-48ba-9ee6-004b75f7dd51 service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:20.281910 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ea93b-bd7f-48ba-9ee6-004b75f7dd51 service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:20.282186 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ea93b-bd7f-48ba-9ee6-004b75f7dd51 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:20.291369 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ea93b-bd7f-48ba-9ee6-004b75f7dd51 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:20.293172 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ea93b-bd7f-48ba-9ee6-004b75f7dd51 service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:20.303511 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1343/2724] 10.222.0.33 () {60 vars in 1384 bytes} [Fri Sep 16 03:55:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 16 03:55:21.478097 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32055f01-ee97-4100-9e4e-c9944df2f09d None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:21.478640 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32055f01-ee97-4100-9e4e-c9944df2f09d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:21.478743 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32055f01-ee97-4100-9e4e-c9944df2f09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:21.499461 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-32055f01-ee97-4100-9e4e-c9944df2f09d None None] MFA Rules not processed for user `b0812002d7b14bcb81a42eb380231feb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:55:21.500861 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-32055f01-ee97-4100-9e4e-c9944df2f09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:21.508555 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1382/2725] 10.222.0.33 () {58 vars in 1009 bytes} [Fri Sep 16 03:55:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:55:21.523815 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ea93b-bd7f-48ba-9ee6-004b75f7dd51 service swift] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:21.543841 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ea93b-bd7f-48ba-9ee6-004b75f7dd51 service swift] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:21.549020 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac5fcc-f079-47a4-b443-9e4f6a08c6b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f784d98d5f440c681f53ae70f6d1cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:21.550457 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac5fcc-f079-47a4-b443-9e4f6a08c6b2 service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:21.550972 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac5fcc-f079-47a4-b443-9e4f6a08c6b2 service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:21.551435 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac5fcc-f079-47a4-b443-9e4f6a08c6b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:21.563205 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac5fcc-f079-47a4-b443-9e4f6a08c6b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:21.565424 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac5fcc-f079-47a4-b443-9e4f6a08c6b2 service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:21.576199 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1344/2726] 10.222.0.33 () {60 vars in 1384 bytes} [Fri Sep 16 03:55:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 16 03:55:22.294991 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb91b9-7a6c-406a-8cbc-26c0e3374864 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:22.295390 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb91b9-7a6c-406a-8cbc-26c0e3374864 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:22.295867 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb91b9-7a6c-406a-8cbc-26c0e3374864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:22.316631 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-56eb91b9-7a6c-406a-8cbc-26c0e3374864 None None] MFA Rules not processed for user `b0812002d7b14bcb81a42eb380231feb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:55:22.318006 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-56eb91b9-7a6c-406a-8cbc-26c0e3374864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:22.326032 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1383/2727] 10.222.0.33 () {58 vars in 967 bytes} [Fri Sep 16 03:55:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:55:22.354589 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac5fcc-f079-47a4-b443-9e4f6a08c6b2 service swift] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:22.355420 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac5fcc-f079-47a4-b443-9e4f6a08c6b2 service swift] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:22.360626 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64878bb9-ca6b-4ee5-a1cc-0eefcf69518f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f784d98d5f440c681f53ae70f6d1cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:22.361236 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64878bb9-ca6b-4ee5-a1cc-0eefcf69518f service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:22.361517 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64878bb9-ca6b-4ee5-a1cc-0eefcf69518f service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:22.362401 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64878bb9-ca6b-4ee5-a1cc-0eefcf69518f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:22.371162 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64878bb9-ca6b-4ee5-a1cc-0eefcf69518f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:22.372759 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64878bb9-ca6b-4ee5-a1cc-0eefcf69518f service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:22.384295 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1345/2728] 10.222.0.33 () {60 vars in 1384 bytes} [Fri Sep 16 03:55:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 03:55:24.402197 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb91b9-7a6c-406a-8cbc-26c0e3374864 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:24.494406 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb91b9-7a6c-406a-8cbc-26c0e3374864 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:24.499057 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07630d3b-0268-42fe-ae79-bcfd0f1673e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:24.499725 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07630d3b-0268-42fe-ae79-bcfd0f1673e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:24.500010 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07630d3b-0268-42fe-ae79-bcfd0f1673e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:24.500282 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07630d3b-0268-42fe-ae79-bcfd0f1673e9 admin admin] PATH_INFO: `/v3/users/6022084f3e1d49049ce81b6f6d0cd2e5` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:24.501436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07630d3b-0268-42fe-ae79-bcfd0f1673e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6022084f3e1d49049ce81b6f6d0cd2e5)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:24.503929 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07630d3b-0268-42fe-ae79-bcfd0f1673e9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:25.773974 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-07630d3b-0268-42fe-ae79-bcfd0f1673e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6022084f3e1d49049ce81b6f6d0cd2e5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:25.774769 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-07630d3b-0268-42fe-ae79-bcfd0f1673e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6022084f3e1d49049ce81b6f6d0cd2e5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:25.783295 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-07630d3b-0268-42fe-ae79-bcfd0f1673e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6022084f3e1d49049ce81b6f6d0cd2e5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:25.793766 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:25.798116 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-07630d3b-0268-42fe-ae79-bcfd0f1673e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6022084f3e1d49049ce81b6f6d0cd2e5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:25.800010 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-07630d3b-0268-42fe-ae79-bcfd0f1673e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6022084f3e1d49049ce81b6f6d0cd2e5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:25.906793 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1384/2729] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:55:24 2022] DELETE /identity/v3/users/6022084f3e1d49049ce81b6f6d0cd2e5 => generated 0 bytes in 1505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:55:25.913109 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c4674-9468-4e8c-8f88-0825e717e614 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:25.913855 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c4674-9468-4e8c-8f88-0825e717e614 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:25.913855 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c4674-9468-4e8c-8f88-0825e717e614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:25.934252 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8a3c4674-9468-4e8c-8f88-0825e717e614 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:55:25.935468 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8a3c4674-9468-4e8c-8f88-0825e717e614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:26.001552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1346/2730] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:55:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:55:26.011900 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07630d3b-0268-42fe-ae79-bcfd0f1673e9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:26.013592 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-07630d3b-0268-42fe-ae79-bcfd0f1673e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:26.087512 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07630d3b-0268-42fe-ae79-bcfd0f1673e9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:26.092165 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93968cf-e4f2-4bbc-9a91-4e49987c3279 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:26.092786 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93968cf-e4f2-4bbc-9a91-4e49987c3279 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:26.093064 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93968cf-e4f2-4bbc-9a91-4e49987c3279 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:26.093468 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93968cf-e4f2-4bbc-9a91-4e49987c3279 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:26.103766 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93968cf-e4f2-4bbc-9a91-4e49987c3279 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:26.105209 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93968cf-e4f2-4bbc-9a91-4e49987c3279 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:26.115894 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1385/2731] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:55:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:55:26.569465 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c4674-9468-4e8c-8f88-0825e717e614 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:26.570992 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8a3c4674-9468-4e8c-8f88-0825e717e614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:26.584736 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c4674-9468-4e8c-8f88-0825e717e614 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:26.589400 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f265c1-ec03-4450-92e0-657a4083542c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:26.590186 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f265c1-ec03-4450-92e0-657a4083542c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:26.590470 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f265c1-ec03-4450-92e0-657a4083542c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:26.590906 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f265c1-ec03-4450-92e0-657a4083542c admin admin] PATH_INFO: `/v3/users/d9021dbaaa5148f1839ba2e37e870686` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:26.592044 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f265c1-ec03-4450-92e0-657a4083542c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9021dbaaa5148f1839ba2e37e870686)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:26.594010 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f265c1-ec03-4450-92e0-657a4083542c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:26.680858 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93968cf-e4f2-4bbc-9a91-4e49987c3279 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:26.682530 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f93968cf-e4f2-4bbc-9a91-4e49987c3279 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:26.714045 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93968cf-e4f2-4bbc-9a91-4e49987c3279 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:26.734298 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99de3e-1e61-4722-af68-2a2d102a6516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:26.735235 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99de3e-1e61-4722-af68-2a2d102a6516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:26.735795 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99de3e-1e61-4722-af68-2a2d102a6516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:26.736439 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99de3e-1e61-4722-af68-2a2d102a6516 admin admin] PATH_INFO: `/v3/projects/43086e4638394c00849331bfc792f69f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:26.742179 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa99de3e-1e61-4722-af68-2a2d102a6516 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43086e4638394c00849331bfc792f69f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:26.746512 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa99de3e-1e61-4722-af68-2a2d102a6516 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:26.806560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-16f265c1-ec03-4450-92e0-657a4083542c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9021dbaaa5148f1839ba2e37e870686'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:26.808394 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-16f265c1-ec03-4450-92e0-657a4083542c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9021dbaaa5148f1839ba2e37e870686'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:26.819025 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-16f265c1-ec03-4450-92e0-657a4083542c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9021dbaaa5148f1839ba2e37e870686'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:26.840508 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-16f265c1-ec03-4450-92e0-657a4083542c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9021dbaaa5148f1839ba2e37e870686'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:26.841253 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-16f265c1-ec03-4450-92e0-657a4083542c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9021dbaaa5148f1839ba2e37e870686'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:26.853896 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:26.870178 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fa99de3e-1e61-4722-af68-2a2d102a6516 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43086e4638394c00849331bfc792f69f', 'request_id': 'req-fa99de3e-1e61-4722-af68-2a2d102a6516'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:26.939418 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1347/2732] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:55:26 2022] DELETE /identity/v3/users/d9021dbaaa5148f1839ba2e37e870686 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:55:26.944509 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc93d9-b864-4f48-b35b-0cdc153d3e3a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:26.945043 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc93d9-b864-4f48-b35b-0cdc153d3e3a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:26.945532 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc93d9-b864-4f48-b35b-0cdc153d3e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:26.967157 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a6fc93d9-b864-4f48-b35b-0cdc153d3e3a None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:55:26.968497 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a6fc93d9-b864-4f48-b35b-0cdc153d3e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:26.978606 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fa99de3e-1e61-4722-af68-2a2d102a6516 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43086e4638394c00849331bfc792f69f', 'request_id': 'req-fa99de3e-1e61-4722-af68-2a2d102a6516'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:26.988961 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fa99de3e-1e61-4722-af68-2a2d102a6516 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43086e4638394c00849331bfc792f69f', 'request_id': 'req-fa99de3e-1e61-4722-af68-2a2d102a6516'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:27.014361 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fa99de3e-1e61-4722-af68-2a2d102a6516 admin admin] The token cache is being invalidate because project 43086e4638394c00849331bfc792f69f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:55:27.015359 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fa99de3e-1e61-4722-af68-2a2d102a6516 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:27.016263 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fa99de3e-1e61-4722-af68-2a2d102a6516 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:27.018429 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1386/2733] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:55:26 2022] DELETE /identity/v3/projects/43086e4638394c00849331bfc792f69f => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:55:27.022312 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99de3e-1e61-4722-af68-2a2d102a6516 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:27.025159 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fa99de3e-1e61-4722-af68-2a2d102a6516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:27.064210 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1348/2734] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:55:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:55:27.072938 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc93d9-b864-4f48-b35b-0cdc153d3e3a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:27.076560 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a6fc93d9-b864-4f48-b35b-0cdc153d3e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:27.116011 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99de3e-1e61-4722-af68-2a2d102a6516 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:27.121409 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343ab29-d8ef-4f63-b7fc-babf9327fb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:27.122551 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343ab29-d8ef-4f63-b7fc-babf9327fb34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:27.122888 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343ab29-d8ef-4f63-b7fc-babf9327fb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:27.123347 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343ab29-d8ef-4f63-b7fc-babf9327fb34 admin admin] PATH_INFO: `/v3/users/127145174ee44b89b9380e8e0af1b485` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:27.124331 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b343ab29-d8ef-4f63-b7fc-babf9327fb34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=127145174ee44b89b9380e8e0af1b485)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:27.126388 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b343ab29-d8ef-4f63-b7fc-babf9327fb34 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:27.151857 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:27.162926 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc93d9-b864-4f48-b35b-0cdc153d3e3a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:27.167606 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a57c64-0eeb-4df6-9740-4174fbed9297 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:27.168150 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a57c64-0eeb-4df6-9740-4174fbed9297 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:27.168435 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a57c64-0eeb-4df6-9740-4174fbed9297 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:27.168703 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a57c64-0eeb-4df6-9740-4174fbed9297 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:27.180452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a57c64-0eeb-4df6-9740-4174fbed9297 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:27.182051 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a57c64-0eeb-4df6-9740-4174fbed9297 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:27.193668 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1349/2735] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:55:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:55:27.309501 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b343ab29-d8ef-4f63-b7fc-babf9327fb34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '127145174ee44b89b9380e8e0af1b485'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:27.310935 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b343ab29-d8ef-4f63-b7fc-babf9327fb34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '127145174ee44b89b9380e8e0af1b485'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:27.320944 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b343ab29-d8ef-4f63-b7fc-babf9327fb34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '127145174ee44b89b9380e8e0af1b485'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:27.338307 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b343ab29-d8ef-4f63-b7fc-babf9327fb34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '127145174ee44b89b9380e8e0af1b485'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:27.338307 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b343ab29-d8ef-4f63-b7fc-babf9327fb34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '127145174ee44b89b9380e8e0af1b485'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:27.397383 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1387/2736] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:55:27 2022] DELETE /identity/v3/users/127145174ee44b89b9380e8e0af1b485 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:55:27.484304 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a57c64-0eeb-4df6-9740-4174fbed9297 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:27.489954 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-55a57c64-0eeb-4df6-9740-4174fbed9297 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:27.506404 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a57c64-0eeb-4df6-9740-4174fbed9297 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:27.600084 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a69296-ddd0-4d4d-9b22-19e80a2ae34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:27.611211 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a69296-ddd0-4d4d-9b22-19e80a2ae34a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:27.611742 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a69296-ddd0-4d4d-9b22-19e80a2ae34a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:27.612125 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a69296-ddd0-4d4d-9b22-19e80a2ae34a admin admin] PATH_INFO: `/v3/projects/eb4f1511040a45cb99633b3ded958178` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:27.613786 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a69296-ddd0-4d4d-9b22-19e80a2ae34a admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb4f1511040a45cb99633b3ded958178)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:27.616484 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a69296-ddd0-4d4d-9b22-19e80a2ae34a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:27.755677 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=4,keystone:SELECT=96 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:27.765660 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-97a69296-ddd0-4d4d-9b22-19e80a2ae34a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb4f1511040a45cb99633b3ded958178', 'request_id': 'req-97a69296-ddd0-4d4d-9b22-19e80a2ae34a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:27.835795 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-97a69296-ddd0-4d4d-9b22-19e80a2ae34a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb4f1511040a45cb99633b3ded958178', 'request_id': 'req-97a69296-ddd0-4d4d-9b22-19e80a2ae34a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:27.843328 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-97a69296-ddd0-4d4d-9b22-19e80a2ae34a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb4f1511040a45cb99633b3ded958178', 'request_id': 'req-97a69296-ddd0-4d4d-9b22-19e80a2ae34a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:27.866888 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343ab29-d8ef-4f63-b7fc-babf9327fb34 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:27.868892 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b343ab29-d8ef-4f63-b7fc-babf9327fb34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:27.870138 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-97a69296-ddd0-4d4d-9b22-19e80a2ae34a admin admin] The token cache is being invalidate because project eb4f1511040a45cb99633b3ded958178 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:55:27.870538 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-97a69296-ddd0-4d4d-9b22-19e80a2ae34a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:27.871287 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-97a69296-ddd0-4d4d-9b22-19e80a2ae34a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:27.873178 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1350/2737] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:55:27 2022] DELETE /identity/v3/projects/eb4f1511040a45cb99633b3ded958178 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:55:27.880616 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a7842-fa37-41b7-876c-a57194203329 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:27.881873 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a7842-fa37-41b7-876c-a57194203329 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:27.882322 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a7842-fa37-41b7-876c-a57194203329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:27.892595 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343ab29-d8ef-4f63-b7fc-babf9327fb34 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:27.936490 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1d2a7842-fa37-41b7-876c-a57194203329 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:55:27.938116 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1d2a7842-fa37-41b7-876c-a57194203329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:28.022382 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a044198-1ad4-496c-ba7a-a0b28ca6ec11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:28.023215 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a044198-1ad4-496c-ba7a-a0b28ca6ec11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:28.023671 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a044198-1ad4-496c-ba7a-a0b28ca6ec11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:28.024185 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a044198-1ad4-496c-ba7a-a0b28ca6ec11 admin admin] PATH_INFO: `/v3/projects/052bcb4c1be34a2a941dc977acc76342` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:28.025496 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a044198-1ad4-496c-ba7a-a0b28ca6ec11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=052bcb4c1be34a2a941dc977acc76342)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:28.027919 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a044198-1ad4-496c-ba7a-a0b28ca6ec11 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:28.034564 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1351/2738] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:55:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:55:28.042585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef212f1-11e6-4648-8d6b-c9c78a1d5774 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:28.043195 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef212f1-11e6-4648-8d6b-c9c78a1d5774 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:28.043582 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef212f1-11e6-4648-8d6b-c9c78a1d5774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:28.077464 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-fef212f1-11e6-4648-8d6b-c9c78a1d5774 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:55:28.078880 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fef212f1-11e6-4648-8d6b-c9c78a1d5774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:28.091213 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1352/2739] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:55:28.092400 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef212f1-11e6-4648-8d6b-c9c78a1d5774 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:28.103564 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef212f1-11e6-4648-8d6b-c9c78a1d5774 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:28.109059 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89aee06-1a0d-4173-86b1-939924ca4061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:28.112193 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89aee06-1a0d-4173-86b1-939924ca4061 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:28.112193 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89aee06-1a0d-4173-86b1-939924ca4061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:28.112193 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89aee06-1a0d-4173-86b1-939924ca4061 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:28.112193 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89aee06-1a0d-4173-86b1-939924ca4061 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:55:28.112193 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89aee06-1a0d-4173-86b1-939924ca4061 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:28.113721 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89aee06-1a0d-4173-86b1-939924ca4061 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:28.127112 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1353/2740] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:55:28.132264 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89aee06-1a0d-4173-86b1-939924ca4061 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:28.142661 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89aee06-1a0d-4173-86b1-939924ca4061 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:28.148167 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd261bcf-bff0-4fb3-a18e-bd3118e03198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:28.148847 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd261bcf-bff0-4fb3-a18e-bd3118e03198 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:28.149127 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd261bcf-bff0-4fb3-a18e-bd3118e03198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:28.149400 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd261bcf-bff0-4fb3-a18e-bd3118e03198 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:28.150070 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd261bcf-bff0-4fb3-a18e-bd3118e03198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:28.151964 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd261bcf-bff0-4fb3-a18e-bd3118e03198 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:28.220627 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2a044198-1ad4-496c-ba7a-a0b28ca6ec11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '052bcb4c1be34a2a941dc977acc76342', 'request_id': 'req-2a044198-1ad4-496c-ba7a-a0b28ca6ec11'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:28.258858 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1354/2741] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:55:28 2022] POST /identity/v3/projects => generated 397 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:55:28.259849 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd261bcf-bff0-4fb3-a18e-bd3118e03198 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:28.304280 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2a044198-1ad4-496c-ba7a-a0b28ca6ec11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '052bcb4c1be34a2a941dc977acc76342', 'request_id': 'req-2a044198-1ad4-496c-ba7a-a0b28ca6ec11'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:28.314286 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2a044198-1ad4-496c-ba7a-a0b28ca6ec11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '052bcb4c1be34a2a941dc977acc76342', 'request_id': 'req-2a044198-1ad4-496c-ba7a-a0b28ca6ec11'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:28.338386 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2a044198-1ad4-496c-ba7a-a0b28ca6ec11 admin admin] The token cache is being invalidate because project 052bcb4c1be34a2a941dc977acc76342 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:55:28.339294 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2a044198-1ad4-496c-ba7a-a0b28ca6ec11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:28.340253 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2a044198-1ad4-496c-ba7a-a0b28ca6ec11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:28.341970 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1388/2742] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:55:27 2022] DELETE /identity/v3/projects/052bcb4c1be34a2a941dc977acc76342 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:55:28.345931 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a044198-1ad4-496c-ba7a-a0b28ca6ec11 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:28.347488 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2a044198-1ad4-496c-ba7a-a0b28ca6ec11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:28.359773 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd261bcf-bff0-4fb3-a18e-bd3118e03198 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:28.365893 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf555bc-a6f5-4798-ab76-320c1e6510f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:28.366520 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf555bc-a6f5-4798-ab76-320c1e6510f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:28.366803 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf555bc-a6f5-4798-ab76-320c1e6510f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:28.367075 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf555bc-a6f5-4798-ab76-320c1e6510f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:28.367722 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf555bc-a6f5-4798-ab76-320c1e6510f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:28.370786 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf555bc-a6f5-4798-ab76-320c1e6510f2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:28.373245 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:28.431904 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a044198-1ad4-496c-ba7a-a0b28ca6ec11 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:28.443215 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ef050-4d98-479d-b50e-11ad299f5a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:28.443947 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ef050-4d98-479d-b50e-11ad299f5a06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:28.444227 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ef050-4d98-479d-b50e-11ad299f5a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:28.444586 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ef050-4d98-479d-b50e-11ad299f5a06 admin admin] PATH_INFO: `/v3/users/e7e2328e9c5747a2b7008ffc1a539868` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:28.446068 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ef050-4d98-479d-b50e-11ad299f5a06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7e2328e9c5747a2b7008ffc1a539868)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:28.448421 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ef050-4d98-479d-b50e-11ad299f5a06 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:29.191206 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1355/2743] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:55:28 2022] POST /identity/v3/users => generated 299 bytes in 932 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:55:29.196437 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf555bc-a6f5-4798-ab76-320c1e6510f2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:29.198521 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3cf555bc-a6f5-4798-ab76-320c1e6510f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:29.211685 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf555bc-a6f5-4798-ab76-320c1e6510f2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:29.217473 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8bcac-dd96-4cb0-8494-878944d2c34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:29.218440 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8bcac-dd96-4cb0-8494-878944d2c34a admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:29.218581 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8bcac-dd96-4cb0-8494-878944d2c34a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:29.218963 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8bcac-dd96-4cb0-8494-878944d2c34a admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:29.219764 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8bcac-dd96-4cb0-8494-878944d2c34a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:29.221479 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8bcac-dd96-4cb0-8494-878944d2c34a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:29.233270 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1356/2744] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:55:29.240898 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8bcac-dd96-4cb0-8494-878944d2c34a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:29.249876 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:29.255670 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8bcac-dd96-4cb0-8494-878944d2c34a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:29.260424 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc10ed2-acf7-4f66-8731-9cfef3d1ff92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:29.261043 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc10ed2-acf7-4f66-8731-9cfef3d1ff92 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:29.261328 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc10ed2-acf7-4f66-8731-9cfef3d1ff92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:29.261613 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc10ed2-acf7-4f66-8731-9cfef3d1ff92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:29.262355 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc10ed2-acf7-4f66-8731-9cfef3d1ff92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:29.264161 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc10ed2-acf7-4f66-8731-9cfef3d1ff92 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:29.276452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1357/2745] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:55:29.280700 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc10ed2-acf7-4f66-8731-9cfef3d1ff92 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:29.291245 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc10ed2-acf7-4f66-8731-9cfef3d1ff92 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:29.295883 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9832c2-1a5e-4c66-90cd-1880a2e8fbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:29.296594 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9832c2-1a5e-4c66-90cd-1880a2e8fbee admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:29.296820 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9832c2-1a5e-4c66-90cd-1880a2e8fbee admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:29.297251 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9832c2-1a5e-4c66-90cd-1880a2e8fbee admin admin] PATH_INFO: `/v3/projects/9e9d1e591e8b4d3b9b736c2ce7520c8e/users/19cd32c086444290a5cf34ccd4b630ff/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:29.325624 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9832c2-1a5e-4c66-90cd-1880a2e8fbee admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e9d1e591e8b4d3b9b736c2ce7520c8e, user_id=19cd32c086444290a5cf34ccd4b630ff, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:29.332897 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9832c2-1a5e-4c66-90cd-1880a2e8fbee admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:29.415650 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e57ef050-4d98-479d-b50e-11ad299f5a06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7e2328e9c5747a2b7008ffc1a539868'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:29.416451 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e57ef050-4d98-479d-b50e-11ad299f5a06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7e2328e9c5747a2b7008ffc1a539868'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:29.430767 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e57ef050-4d98-479d-b50e-11ad299f5a06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7e2328e9c5747a2b7008ffc1a539868'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:29.432719 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1358/2746] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:55:29 2022] PUT /identity/v3/projects/9e9d1e591e8b4d3b9b736c2ce7520c8e/users/19cd32c086444290a5cf34ccd4b630ff/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:55:29.444013 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57787104-922a-44db-8a1b-c2942ed69272 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:29.444296 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57787104-922a-44db-8a1b-c2942ed69272 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:29.444634 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57787104-922a-44db-8a1b-c2942ed69272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:29.447596 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e57ef050-4d98-479d-b50e-11ad299f5a06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7e2328e9c5747a2b7008ffc1a539868'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:29.448403 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e57ef050-4d98-479d-b50e-11ad299f5a06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7e2328e9c5747a2b7008ffc1a539868'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:29.487255 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-57787104-922a-44db-8a1b-c2942ed69272 None None] MFA Rules not processed for user `19cd32c086444290a5cf34ccd4b630ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:55:29.488603 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-57787104-922a-44db-8a1b-c2942ed69272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:29.553904 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1389/2747] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:55:28 2022] DELETE /identity/v3/users/e7e2328e9c5747a2b7008ffc1a539868 => generated 0 bytes in 1208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:55:29.581908 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1359/2748] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:55:29 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:55:29.589392 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ef050-4d98-479d-b50e-11ad299f5a06 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:29.595784 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e57ef050-4d98-479d-b50e-11ad299f5a06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:29.689165 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ef050-4d98-479d-b50e-11ad299f5a06 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:29.696340 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8250f91-7407-4e95-bff8-24b303e91abf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:29.697020 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8250f91-7407-4e95-bff8-24b303e91abf service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:29.697307 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8250f91-7407-4e95-bff8-24b303e91abf service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:29.697622 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8250f91-7407-4e95-bff8-24b303e91abf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:29.769317 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:29.773387 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8250f91-7407-4e95-bff8-24b303e91abf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:29.775061 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8250f91-7407-4e95-bff8-24b303e91abf service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:29.786343 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1390/2749] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:55:29 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:55:30.180268 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57787104-922a-44db-8a1b-c2942ed69272 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:30.181872 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-57787104-922a-44db-8a1b-c2942ed69272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:30.253710 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57787104-922a-44db-8a1b-c2942ed69272 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:30.313664 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1cb0e-f961-4ebe-b518-2d6d1ec0049b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:30.314318 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1cb0e-f961-4ebe-b518-2d6d1ec0049b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:30.315091 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1cb0e-f961-4ebe-b518-2d6d1ec0049b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:30.315749 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1cb0e-f961-4ebe-b518-2d6d1ec0049b admin admin] PATH_INFO: `/v3/projects/b3859795355b4350adea72029649b5ce` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:30.317457 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1cb0e-f961-4ebe-b518-2d6d1ec0049b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3859795355b4350adea72029649b5ce)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:30.320985 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1cb0e-f961-4ebe-b518-2d6d1ec0049b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:30.339218 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:30.483713 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-29e1cb0e-f961-4ebe-b518-2d6d1ec0049b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3859795355b4350adea72029649b5ce', 'request_id': 'req-29e1cb0e-f961-4ebe-b518-2d6d1ec0049b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:30.567891 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-29e1cb0e-f961-4ebe-b518-2d6d1ec0049b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3859795355b4350adea72029649b5ce', 'request_id': 'req-29e1cb0e-f961-4ebe-b518-2d6d1ec0049b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:30.581288 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-29e1cb0e-f961-4ebe-b518-2d6d1ec0049b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3859795355b4350adea72029649b5ce', 'request_id': 'req-29e1cb0e-f961-4ebe-b518-2d6d1ec0049b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:30.594428 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-29e1cb0e-f961-4ebe-b518-2d6d1ec0049b admin admin] The token cache is being invalidate because project b3859795355b4350adea72029649b5ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:55:30.594819 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-29e1cb0e-f961-4ebe-b518-2d6d1ec0049b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:30.595596 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-29e1cb0e-f961-4ebe-b518-2d6d1ec0049b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:30.597573 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1360/2750] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:55:30 2022] DELETE /identity/v3/projects/b3859795355b4350adea72029649b5ce => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:55:30.602384 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e3535-f2d0-43a9-a968-41922caa9b5c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:30.603237 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e3535-f2d0-43a9-a968-41922caa9b5c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:30.607926 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e3535-f2d0-43a9-a968-41922caa9b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:30.630127 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0c4e3535-f2d0-43a9-a968-41922caa9b5c None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:55:30.631519 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0c4e3535-f2d0-43a9-a968-41922caa9b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:30.715708 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1391/2751] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:55:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:55:30.724568 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f3c10-b488-4cdf-9e64-bed433d2bb23 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:30.725089 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f3c10-b488-4cdf-9e64-bed433d2bb23 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:30.725442 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f3c10-b488-4cdf-9e64-bed433d2bb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:30.758760 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f43f3c10-b488-4cdf-9e64-bed433d2bb23 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:55:30.760126 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f43f3c10-b488-4cdf-9e64-bed433d2bb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:30.781660 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1361/2752] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:55:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:55:30.781997 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e3535-f2d0-43a9-a968-41922caa9b5c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:30.790774 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e3535-f2d0-43a9-a968-41922caa9b5c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:30.798383 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf8ff5-fa7e-49f1-9347-5e429f26af41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:30.798383 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf8ff5-fa7e-49f1-9347-5e429f26af41 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:30.798383 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf8ff5-fa7e-49f1-9347-5e429f26af41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:30.798383 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf8ff5-fa7e-49f1-9347-5e429f26af41 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:30.799359 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf8ff5-fa7e-49f1-9347-5e429f26af41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:55:30.799359 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf8ff5-fa7e-49f1-9347-5e429f26af41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:30.800216 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf8ff5-fa7e-49f1-9347-5e429f26af41 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:30.817349 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1392/2753] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:55:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 03:55:30.818730 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f3c10-b488-4cdf-9e64-bed433d2bb23 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:30.828276 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f3c10-b488-4cdf-9e64-bed433d2bb23 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:30.833614 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7da1d8-2b01-43b2-8743-f467234c3f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:30.834306 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7da1d8-2b01-43b2-8743-f467234c3f7b admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:30.834614 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7da1d8-2b01-43b2-8743-f467234c3f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:30.834890 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7da1d8-2b01-43b2-8743-f467234c3f7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:30.835525 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7da1d8-2b01-43b2-8743-f467234c3f7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:30.837451 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7da1d8-2b01-43b2-8743-f467234c3f7b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:30.943933 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1362/2754] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:55:30 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:55:30.945433 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf8ff5-fa7e-49f1-9347-5e429f26af41 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:30.955696 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf8ff5-fa7e-49f1-9347-5e429f26af41 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:31.012379 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a24027-0543-450d-b648-ba25dddcbb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:31.012979 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a24027-0543-450d-b648-ba25dddcbb6f admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:31.013945 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a24027-0543-450d-b648-ba25dddcbb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:31.014228 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a24027-0543-450d-b648-ba25dddcbb6f admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:31.014865 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a24027-0543-450d-b648-ba25dddcbb6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:31.017024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a24027-0543-450d-b648-ba25dddcbb6f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:31.145334 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1393/2755] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:55:30 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:55:31.149589 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7da1d8-2b01-43b2-8743-f467234c3f7b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:31.161581 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7da1d8-2b01-43b2-8743-f467234c3f7b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:31.166477 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c137e-957e-4b70-9137-5bc7250302ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:31.167090 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c137e-957e-4b70-9137-5bc7250302ca admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:31.167369 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c137e-957e-4b70-9137-5bc7250302ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:31.167658 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c137e-957e-4b70-9137-5bc7250302ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:31.168305 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c137e-957e-4b70-9137-5bc7250302ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:31.169943 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c137e-957e-4b70-9137-5bc7250302ca admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:31.181230 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1363/2756] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:55:31.185242 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a24027-0543-450d-b648-ba25dddcbb6f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:31.196097 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a24027-0543-450d-b648-ba25dddcbb6f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:31.201659 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b61d99-94d2-46a5-b782-80ed0ccd104d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:31.202466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b61d99-94d2-46a5-b782-80ed0ccd104d admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:31.202757 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b61d99-94d2-46a5-b782-80ed0ccd104d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:31.203032 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b61d99-94d2-46a5-b782-80ed0ccd104d admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:31.203676 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b61d99-94d2-46a5-b782-80ed0ccd104d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:31.205359 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b61d99-94d2-46a5-b782-80ed0ccd104d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:31.216307 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1394/2757] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:55:31.220509 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c137e-957e-4b70-9137-5bc7250302ca admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:31.236430 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c137e-957e-4b70-9137-5bc7250302ca admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:31.242165 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730882ce-335c-4fa6-936d-80d0c86c6240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:31.242837 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730882ce-335c-4fa6-936d-80d0c86c6240 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:31.243116 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730882ce-335c-4fa6-936d-80d0c86c6240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:31.243417 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730882ce-335c-4fa6-936d-80d0c86c6240 admin admin] PATH_INFO: `/v3/projects/c1164d4b287d416abed324fbc11ba29b/users/2a67c21ee8d641458b54c2574107f24f/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:31.260239 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730882ce-335c-4fa6-936d-80d0c86c6240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1164d4b287d416abed324fbc11ba29b, user_id=2a67c21ee8d641458b54c2574107f24f, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:31.268173 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730882ce-335c-4fa6-936d-80d0c86c6240 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:31.414082 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1364/2758] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:55:31 2022] PUT /identity/v3/projects/c1164d4b287d416abed324fbc11ba29b/users/2a67c21ee8d641458b54c2574107f24f/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:55:31.425861 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246983f-96e9-44d2-ab4b-d17d3344abf6 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:31.426156 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246983f-96e9-44d2-ab4b-d17d3344abf6 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:31.426440 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246983f-96e9-44d2-ab4b-d17d3344abf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:31.454174 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b246983f-96e9-44d2-ab4b-d17d3344abf6 None None] MFA Rules not processed for user `2a67c21ee8d641458b54c2574107f24f`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:55:31.455966 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b246983f-96e9-44d2-ab4b-d17d3344abf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:31.504098 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:31.522686 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1395/2759] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:55:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:55:31.527397 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730882ce-335c-4fa6-936d-80d0c86c6240 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:31.595902 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730882ce-335c-4fa6-936d-80d0c86c6240 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:31.601653 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a714c-1418-46c5-896c-637ab968c7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:31.602678 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a714c-1418-46c5-896c-637ab968c7be admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:31.602986 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a714c-1418-46c5-896c-637ab968c7be admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:31.603263 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a714c-1418-46c5-896c-637ab968c7be admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:31.604021 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a714c-1418-46c5-896c-637ab968c7be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:31.606021 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a714c-1418-46c5-896c-637ab968c7be admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:31.685013 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1365/2760] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:55:31 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:55:31.689040 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246983f-96e9-44d2-ab4b-d17d3344abf6 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:31.704041 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246983f-96e9-44d2-ab4b-d17d3344abf6 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:31.761281 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c65e2-5b44-4543-a029-d11192b440bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:31.761924 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c65e2-5b44-4543-a029-d11192b440bb admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:31.762202 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c65e2-5b44-4543-a029-d11192b440bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:31.762474 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c65e2-5b44-4543-a029-d11192b440bb admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:31.763145 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c65e2-5b44-4543-a029-d11192b440bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:31.765197 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c65e2-5b44-4543-a029-d11192b440bb admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:31.851928 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1396/2761] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:55:31 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:55:31.862080 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a714c-1418-46c5-896c-637ab968c7be admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:31.872986 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a714c-1418-46c5-896c-637ab968c7be admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:31.878850 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5396408-7114-41c4-8748-1d3c1db1d220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:31.879528 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5396408-7114-41c4-8748-1d3c1db1d220 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:31.879873 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5396408-7114-41c4-8748-1d3c1db1d220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:31.880317 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5396408-7114-41c4-8748-1d3c1db1d220 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:31.881080 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5396408-7114-41c4-8748-1d3c1db1d220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:31.882827 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5396408-7114-41c4-8748-1d3c1db1d220 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:31.895626 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1366/2762] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:55:31.900044 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c65e2-5b44-4543-a029-d11192b440bb admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:31.912942 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c65e2-5b44-4543-a029-d11192b440bb admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:31.938368 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37902da-b443-4839-a8f9-c4f4b2229938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:31.941270 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37902da-b443-4839-a8f9-c4f4b2229938 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:31.941747 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37902da-b443-4839-a8f9-c4f4b2229938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:31.945670 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37902da-b443-4839-a8f9-c4f4b2229938 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:31.946625 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37902da-b443-4839-a8f9-c4f4b2229938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:31.948595 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37902da-b443-4839-a8f9-c4f4b2229938 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:31.968007 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1397/2763] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:55:31.972396 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5396408-7114-41c4-8748-1d3c1db1d220 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:31.983913 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5396408-7114-41c4-8748-1d3c1db1d220 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:31.990305 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237ebc1-8829-49fc-b4d3-834b9b55919c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:31.995979 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237ebc1-8829-49fc-b4d3-834b9b55919c admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:31.995979 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237ebc1-8829-49fc-b4d3-834b9b55919c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:31.995979 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237ebc1-8829-49fc-b4d3-834b9b55919c admin admin] PATH_INFO: `/v3/projects/9506034da7714e88bcad69e1952abb8f/users/e146eed948ea46d5979a28769e9afb61/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:32.001037 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:32.016573 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237ebc1-8829-49fc-b4d3-834b9b55919c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9506034da7714e88bcad69e1952abb8f, user_id=e146eed948ea46d5979a28769e9afb61, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:32.020181 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237ebc1-8829-49fc-b4d3-834b9b55919c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:32.104554 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1367/2764] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:55:31 2022] PUT /identity/v3/projects/9506034da7714e88bcad69e1952abb8f/users/e146eed948ea46d5979a28769e9afb61/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:55:32.116037 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249e2e5-48f0-48d7-b379-4d6d23e5674d None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:32.116324 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249e2e5-48f0-48d7-b379-4d6d23e5674d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:32.116598 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249e2e5-48f0-48d7-b379-4d6d23e5674d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:32.149460 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e249e2e5-48f0-48d7-b379-4d6d23e5674d None None] MFA Rules not processed for user `e146eed948ea46d5979a28769e9afb61`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:55:32.150753 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e249e2e5-48f0-48d7-b379-4d6d23e5674d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:32.215353 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1398/2765] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:55:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:55:32.219271 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237ebc1-8829-49fc-b4d3-834b9b55919c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:32.281105 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237ebc1-8829-49fc-b4d3-834b9b55919c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:32.286578 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e74cc-2fa1-4d1c-abd1-d9b80476cff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:32.287186 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e74cc-2fa1-4d1c-abd1-d9b80476cff8 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:32.287462 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e74cc-2fa1-4d1c-abd1-d9b80476cff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:32.287733 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e74cc-2fa1-4d1c-abd1-d9b80476cff8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:32.288381 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e74cc-2fa1-4d1c-abd1-d9b80476cff8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:32.290573 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e74cc-2fa1-4d1c-abd1-d9b80476cff8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:32.375843 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1368/2766] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:55:32 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:55:32.380225 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249e2e5-48f0-48d7-b379-4d6d23e5674d None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:32.390773 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249e2e5-48f0-48d7-b379-4d6d23e5674d None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:32.441702 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:32.447418 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3996945-f5d1-4519-aebf-b128b8bbcc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:32.448026 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3996945-f5d1-4519-aebf-b128b8bbcc81 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:32.448307 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3996945-f5d1-4519-aebf-b128b8bbcc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:32.448587 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3996945-f5d1-4519-aebf-b128b8bbcc81 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:32.449204 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3996945-f5d1-4519-aebf-b128b8bbcc81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:32.451176 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3996945-f5d1-4519-aebf-b128b8bbcc81 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:32.584861 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1399/2767] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:55:32 2022] POST /identity/v3/users => generated 299 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:55:32.588602 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e74cc-2fa1-4d1c-abd1-d9b80476cff8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:32.598691 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e74cc-2fa1-4d1c-abd1-d9b80476cff8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:32.603206 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61325a09-0e33-4137-b2d8-a45d5d54f3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:32.603803 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61325a09-0e33-4137-b2d8-a45d5d54f3e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:32.604085 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61325a09-0e33-4137-b2d8-a45d5d54f3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:32.604357 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61325a09-0e33-4137-b2d8-a45d5d54f3e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:32.604992 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61325a09-0e33-4137-b2d8-a45d5d54f3e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:32.606602 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61325a09-0e33-4137-b2d8-a45d5d54f3e6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:32.617136 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1369/2768] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:55:32.625418 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3996945-f5d1-4519-aebf-b128b8bbcc81 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:32.636371 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3996945-f5d1-4519-aebf-b128b8bbcc81 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:32.641049 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa190134-4829-4cb2-a54c-6a1c266e28cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:32.641735 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa190134-4829-4cb2-a54c-6a1c266e28cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:32.642018 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa190134-4829-4cb2-a54c-6a1c266e28cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:32.642285 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa190134-4829-4cb2-a54c-6a1c266e28cc admin admin] PATH_INFO: `/v3/projects/71b28744fe0b4f92a2db75bb4663824e/users/8ad72d18b99a41bb830245b1b99c2463/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:32.657257 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa190134-4829-4cb2-a54c-6a1c266e28cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=71b28744fe0b4f92a2db75bb4663824e, user_id=8ad72d18b99a41bb830245b1b99c2463, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:32.659966 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa190134-4829-4cb2-a54c-6a1c266e28cc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:32.738512 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1400/2769] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:55:32 2022] PUT /identity/v3/projects/71b28744fe0b4f92a2db75bb4663824e/users/8ad72d18b99a41bb830245b1b99c2463/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:55:32.742645 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61325a09-0e33-4137-b2d8-a45d5d54f3e6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:32.753230 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61325a09-0e33-4137-b2d8-a45d5d54f3e6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:32.811218 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b1d4b-0751-4358-8d26-d2549d8b2409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:32.811862 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b1d4b-0751-4358-8d26-d2549d8b2409 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:32.812141 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b1d4b-0751-4358-8d26-d2549d8b2409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:32.812410 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b1d4b-0751-4358-8d26-d2549d8b2409 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:32.813038 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b1d4b-0751-4358-8d26-d2549d8b2409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:32.815246 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b1d4b-0751-4358-8d26-d2549d8b2409 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:32.824882 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1370/2770] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:55:32.829266 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa190134-4829-4cb2-a54c-6a1c266e28cc admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:32.840178 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa190134-4829-4cb2-a54c-6a1c266e28cc admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:32.846056 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316434d-d357-4e12-9d86-a338b66f5b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:32.846056 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316434d-d357-4e12-9d86-a338b66f5b46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:32.846056 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316434d-d357-4e12-9d86-a338b66f5b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:32.846056 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316434d-d357-4e12-9d86-a338b66f5b46 admin admin] PATH_INFO: `/v3/projects/71b28744fe0b4f92a2db75bb4663824e/users/8ad72d18b99a41bb830245b1b99c2463/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:32.848062 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316434d-d357-4e12-9d86-a338b66f5b46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71b28744fe0b4f92a2db75bb4663824e, user_id=8ad72d18b99a41bb830245b1b99c2463, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:32.850763 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316434d-d357-4e12-9d86-a338b66f5b46 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:32.861082 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1401/2771] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:55:32 2022] PUT /identity/v3/projects/71b28744fe0b4f92a2db75bb4663824e/users/8ad72d18b99a41bb830245b1b99c2463/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:55:32.871635 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24346491-1925-40b7-8e9c-03c0e33aeecd None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:32.871924 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24346491-1925-40b7-8e9c-03c0e33aeecd None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:32.872573 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24346491-1925-40b7-8e9c-03c0e33aeecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:32.903257 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-24346491-1925-40b7-8e9c-03c0e33aeecd None None] MFA Rules not processed for user `8ad72d18b99a41bb830245b1b99c2463`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:55:32.917768 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-24346491-1925-40b7-8e9c-03c0e33aeecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:32.947760 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:32.974505 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1371/2772] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:55:32 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:55:32.986964 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316434d-d357-4e12-9d86-a338b66f5b46 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:32.988867 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9316434d-d357-4e12-9d86-a338b66f5b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:33.079235 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316434d-d357-4e12-9d86-a338b66f5b46 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:33.084009 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd57c5c-835d-4f5c-8db1-4b4f6fc99db0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:33.084695 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd57c5c-835d-4f5c-8db1-4b4f6fc99db0 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:33.084973 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd57c5c-835d-4f5c-8db1-4b4f6fc99db0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:33.085251 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd57c5c-835d-4f5c-8db1-4b4f6fc99db0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:33.143177 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd57c5c-835d-4f5c-8db1-4b4f6fc99db0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:33.144606 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd57c5c-835d-4f5c-8db1-4b4f6fc99db0 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:33.153589 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1402/2773] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:55:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 03:55:35.135226 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24346491-1925-40b7-8e9c-03c0e33aeecd None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:35.136183 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-24346491-1925-40b7-8e9c-03c0e33aeecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:35.148885 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24346491-1925-40b7-8e9c-03c0e33aeecd None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:35.152702 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9735e3e-0385-4a34-8fae-4fc54a0bfb34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:35.153355 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9735e3e-0385-4a34-8fae-4fc54a0bfb34 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:35.153665 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9735e3e-0385-4a34-8fae-4fc54a0bfb34 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:35.153971 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9735e3e-0385-4a34-8fae-4fc54a0bfb34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:35.216250 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9735e3e-0385-4a34-8fae-4fc54a0bfb34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:35.217863 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9735e3e-0385-4a34-8fae-4fc54a0bfb34 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:35.227584 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1372/2774] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:55:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:55:36.203822 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd57c5c-835d-4f5c-8db1-4b4f6fc99db0 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:36.205319 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6fd57c5c-835d-4f5c-8db1-4b4f6fc99db0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:36.271725 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd57c5c-835d-4f5c-8db1-4b4f6fc99db0 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:36.276328 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a5806c-afed-47d1-9c71-a1180e10b0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:36.276959 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5806c-afed-47d1-9c71-a1180e10b0e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:36.277240 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5806c-afed-47d1-9c71-a1180e10b0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:36.277540 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5806c-afed-47d1-9c71-a1180e10b0e5 admin admin] PATH_INFO: `/v3/users/19cd32c086444290a5cf34ccd4b630ff` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:36.278725 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a5806c-afed-47d1-9c71-a1180e10b0e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19cd32c086444290a5cf34ccd4b630ff)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:36.280757 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a5806c-afed-47d1-9c71-a1180e10b0e5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:36.286195 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:36.544414 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a0a5806c-afed-47d1-9c71-a1180e10b0e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19cd32c086444290a5cf34ccd4b630ff'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:36.545707 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a0a5806c-afed-47d1-9c71-a1180e10b0e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19cd32c086444290a5cf34ccd4b630ff'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:36.552939 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a0a5806c-afed-47d1-9c71-a1180e10b0e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19cd32c086444290a5cf34ccd4b630ff'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:36.565432 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a0a5806c-afed-47d1-9c71-a1180e10b0e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19cd32c086444290a5cf34ccd4b630ff'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:36.566156 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a0a5806c-afed-47d1-9c71-a1180e10b0e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19cd32c086444290a5cf34ccd4b630ff'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:36.662922 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1403/2775] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:55:36 2022] DELETE /identity/v3/users/19cd32c086444290a5cf34ccd4b630ff => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:55:36.665084 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d8f9a-69a0-4af9-83eb-de38212fbd9e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:36.666181 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d8f9a-69a0-4af9-83eb-de38212fbd9e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:36.666535 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d8f9a-69a0-4af9-83eb-de38212fbd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:36.693305 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e27d8f9a-69a0-4af9-83eb-de38212fbd9e None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:55:36.694609 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e27d8f9a-69a0-4af9-83eb-de38212fbd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:36.781074 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1373/2776] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:55:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:55:36.791000 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a5806c-afed-47d1-9c71-a1180e10b0e5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:36.792423 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a0a5806c-afed-47d1-9c71-a1180e10b0e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:36.862849 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a5806c-afed-47d1-9c71-a1180e10b0e5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:36.867559 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf85059-9958-44c0-8667-ffaea84ce5b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:36.867559 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf85059-9958-44c0-8667-ffaea84ce5b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:36.867559 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf85059-9958-44c0-8667-ffaea84ce5b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:36.867559 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf85059-9958-44c0-8667-ffaea84ce5b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:36.876610 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf85059-9958-44c0-8667-ffaea84ce5b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:36.878641 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf85059-9958-44c0-8667-ffaea84ce5b8 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:36.888072 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1404/2777] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:55:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 03:55:36.932467 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d8f9a-69a0-4af9-83eb-de38212fbd9e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:36.933923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e27d8f9a-69a0-4af9-83eb-de38212fbd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:36.995904 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d8f9a-69a0-4af9-83eb-de38212fbd9e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:36.999500 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64cd985-603d-4d1f-98ad-81a5a0d0f7f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:37.000835 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64cd985-603d-4d1f-98ad-81a5a0d0f7f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:37.001115 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64cd985-603d-4d1f-98ad-81a5a0d0f7f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:37.001394 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64cd985-603d-4d1f-98ad-81a5a0d0f7f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:37.003242 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c64cd985-603d-4d1f-98ad-81a5a0d0f7f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:37.035691 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:37.068508 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64cd985-603d-4d1f-98ad-81a5a0d0f7f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:37.069985 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64cd985-603d-4d1f-98ad-81a5a0d0f7f9 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:37.080367 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1374/2778] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:55:36 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:55:37.323720 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef5c02-f446-46b2-a00e-d011225f74d0 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:37.324287 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef5c02-f446-46b2-a00e-d011225f74d0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:37.324390 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef5c02-f446-46b2-a00e-d011225f74d0 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:37.325882 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1405/2779] 10.222.0.33 () {54 vars in 921 bytes} [Fri Sep 16 03:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:55:37.332836 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa31b3-2c95-4e86-9e7e-baa394a9a1d7 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:37.333201 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa31b3-2c95-4e86-9e7e-baa394a9a1d7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:37.333548 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa31b3-2c95-4e86-9e7e-baa394a9a1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:37.354512 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-58fa31b3-2c95-4e86-9e7e-baa394a9a1d7 None None] MFA Rules not processed for user `c09d1a4ac8b64921a6b05fcd567bb770`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:55:37.356645 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-58fa31b3-2c95-4e86-9e7e-baa394a9a1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:37.415358 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef5c02-f446-46b2-a00e-d011225f74d0 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:37.417741 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-51ef5c02-f446-46b2-a00e-d011225f74d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:37.444200 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef5c02-f446-46b2-a00e-d011225f74d0 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:37.449085 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f9f0d-84dc-4158-829d-f348fa7c3d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:37.449768 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f9f0d-84dc-4158-829d-f348fa7c3d69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:37.450050 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f9f0d-84dc-4158-829d-f348fa7c3d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:37.450348 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f9f0d-84dc-4158-829d-f348fa7c3d69 admin admin] PATH_INFO: `/v3/projects/9e9d1e591e8b4d3b9b736c2ce7520c8e` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:37.452015 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f9f0d-84dc-4158-829d-f348fa7c3d69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e9d1e591e8b4d3b9b736c2ce7520c8e)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:37.453398 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f9f0d-84dc-4158-829d-f348fa7c3d69 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:37.454595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1375/2780] 10.222.0.33 () {58 vars in 1018 bytes} [Fri Sep 16 03:55:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:55:37.466035 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa31b3-2c95-4e86-9e7e-baa394a9a1d7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:37.467829 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-58fa31b3-2c95-4e86-9e7e-baa394a9a1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:37.527424 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa31b3-2c95-4e86-9e7e-baa394a9a1d7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:37.531360 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fab3c6-5e2a-4008-8956-aec30fdbf5c1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aafb065e06c3481bbed8d98e893766ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:37.532056 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fab3c6-5e2a-4008-8956-aec30fdbf5c1 service glance] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:37.532362 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fab3c6-5e2a-4008-8956-aec30fdbf5c1 service glance] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:37.532660 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fab3c6-5e2a-4008-8956-aec30fdbf5c1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:37.545199 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fab3c6-5e2a-4008-8956-aec30fdbf5c1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:37.546653 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fab3c6-5e2a-4008-8956-aec30fdbf5c1 service glance] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:37.557356 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3a8f9f0d-84dc-4158-829d-f348fa7c3d69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e9d1e591e8b4d3b9b736c2ce7520c8e', 'request_id': 'req-3a8f9f0d-84dc-4158-829d-f348fa7c3d69'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:37.557957 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1376/2781] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:55:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 03:55:37.675946 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3a8f9f0d-84dc-4158-829d-f348fa7c3d69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e9d1e591e8b4d3b9b736c2ce7520c8e', 'request_id': 'req-3a8f9f0d-84dc-4158-829d-f348fa7c3d69'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:37.682840 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3a8f9f0d-84dc-4158-829d-f348fa7c3d69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e9d1e591e8b4d3b9b736c2ce7520c8e', 'request_id': 'req-3a8f9f0d-84dc-4158-829d-f348fa7c3d69'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:37.694141 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3a8f9f0d-84dc-4158-829d-f348fa7c3d69 admin admin] The token cache is being invalidate because project 9e9d1e591e8b4d3b9b736c2ce7520c8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:55:37.694511 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3a8f9f0d-84dc-4158-829d-f348fa7c3d69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:37.695187 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3a8f9f0d-84dc-4158-829d-f348fa7c3d69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:37.696927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1406/2782] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:55:37 2022] DELETE /identity/v3/projects/9e9d1e591e8b4d3b9b736c2ce7520c8e => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:55:37.815924 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574829d5-6510-4cb5-b213-7247a75b7480 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:37.816649 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574829d5-6510-4cb5-b213-7247a75b7480 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:37.816649 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574829d5-6510-4cb5-b213-7247a75b7480 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:37.818969 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1377/2783] 10.222.0.33 () {54 vars in 921 bytes} [Fri Sep 16 03:55:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:55:37.826565 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3646ea5-9d65-46b9-ab12-db1912b2a776 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:37.826857 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3646ea5-9d65-46b9-ab12-db1912b2a776 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:37.827136 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3646ea5-9d65-46b9-ab12-db1912b2a776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:37.873221 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d3646ea5-9d65-46b9-ab12-db1912b2a776 None None] MFA Rules not processed for user `ae04099495a24a04801563cf18dc5626`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:55:37.874644 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d3646ea5-9d65-46b9-ab12-db1912b2a776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:37.881856 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:37.941994 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1407/2784] 10.222.0.33 () {58 vars in 1018 bytes} [Fri Sep 16 03:55:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:55:37.955077 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574829d5-6510-4cb5-b213-7247a75b7480 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:37.957551 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-574829d5-6510-4cb5-b213-7247a75b7480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:37.971220 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574829d5-6510-4cb5-b213-7247a75b7480 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:37.974847 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0a854-3bed-4b88-8f4b-91f98705ff22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:37.975482 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0a854-3bed-4b88-8f4b-91f98705ff22 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:37.975766 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0a854-3bed-4b88-8f4b-91f98705ff22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:37.976039 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0a854-3bed-4b88-8f4b-91f98705ff22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:37.983637 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c0a854-3bed-4b88-8f4b-91f98705ff22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:37.985058 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c0a854-3bed-4b88-8f4b-91f98705ff22 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:37.993432 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1378/2785] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:55:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:55:38.082209 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e829c-310f-49bc-a722-d93a8e8d82b5 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:38.082499 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e829c-310f-49bc-a722-d93a8e8d82b5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:38.082774 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e829c-310f-49bc-a722-d93a8e8d82b5 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:38.084136 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1408/2786] 10.222.0.33 () {54 vars in 921 bytes} [Fri Sep 16 03:55:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 03:55:38.089565 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce8652-fa88-4e75-83ae-a46738a03d37 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:38.089921 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce8652-fa88-4e75-83ae-a46738a03d37 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:38.090204 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce8652-fa88-4e75-83ae-a46738a03d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:38.110126 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-fbce8652-fa88-4e75-83ae-a46738a03d37 None None] MFA Rules not processed for user `c09d1a4ac8b64921a6b05fcd567bb770`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:55:38.111329 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fbce8652-fa88-4e75-83ae-a46738a03d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:38.156139 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:38.179084 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1379/2787] 10.222.0.33 () {58 vars in 1018 bytes} [Fri Sep 16 03:55:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:55:38.189499 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e829c-310f-49bc-a722-d93a8e8d82b5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:38.191792 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7e7e829c-310f-49bc-a722-d93a8e8d82b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:38.204694 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e829c-310f-49bc-a722-d93a8e8d82b5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:38.209255 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883834c4-0f7c-4dbc-81a2-3001a22c1934 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:38.210261 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883834c4-0f7c-4dbc-81a2-3001a22c1934 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:38.210672 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883834c4-0f7c-4dbc-81a2-3001a22c1934 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:38.211080 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883834c4-0f7c-4dbc-81a2-3001a22c1934 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:38.220895 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883834c4-0f7c-4dbc-81a2-3001a22c1934 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:38.222348 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883834c4-0f7c-4dbc-81a2-3001a22c1934 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:38.232943 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1409/2788] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:55:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:55:41.735772 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893138e2-198c-41c0-a9b1-1db054f76cde None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:41.736253 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893138e2-198c-41c0-a9b1-1db054f76cde None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:41.736356 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893138e2-198c-41c0-a9b1-1db054f76cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:41.755773 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-893138e2-198c-41c0-a9b1-1db054f76cde None None] MFA Rules not processed for user `b0812002d7b14bcb81a42eb380231feb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:55:41.756890 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-893138e2-198c-41c0-a9b1-1db054f76cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:41.815297 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1380/2789] 10.222.0.33 () {58 vars in 1009 bytes} [Fri Sep 16 03:55:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:55:41.828001 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883834c4-0f7c-4dbc-81a2-3001a22c1934 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:41.829426 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-883834c4-0f7c-4dbc-81a2-3001a22c1934 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:41.851334 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893138e2-198c-41c0-a9b1-1db054f76cde None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:41.852711 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-893138e2-198c-41c0-a9b1-1db054f76cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:41.902370 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883834c4-0f7c-4dbc-81a2-3001a22c1934 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:41.907383 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02d32d-b26b-4660-ac34-afce30d9b4d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f784d98d5f440c681f53ae70f6d1cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:41.908012 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02d32d-b26b-4660-ac34-afce30d9b4d3 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:41.908296 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02d32d-b26b-4660-ac34-afce30d9b4d3 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:41.908626 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02d32d-b26b-4660-ac34-afce30d9b4d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:41.917081 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f02d32d-b26b-4660-ac34-afce30d9b4d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:41.918750 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f02d32d-b26b-4660-ac34-afce30d9b4d3 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:41.918868 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893138e2-198c-41c0-a9b1-1db054f76cde None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:41.923604 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3c215-a3ff-4c04-a045-cce3db5edeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:41.924846 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3c215-a3ff-4c04-a045-cce3db5edeb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:41.925202 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3c215-a3ff-4c04-a045-cce3db5edeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:41.926026 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3c215-a3ff-4c04-a045-cce3db5edeb2 admin admin] PATH_INFO: `/v3/users/2a67c21ee8d641458b54c2574107f24f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:41.927583 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da3c215-a3ff-4c04-a045-cce3db5edeb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a67c21ee8d641458b54c2574107f24f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:41.929394 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1410/2790] 10.222.0.33 () {60 vars in 1384 bytes} [Fri Sep 16 03:55:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 03:55:41.929666 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da3c215-a3ff-4c04-a045-cce3db5edeb2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:42.185325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6da3c215-a3ff-4c04-a045-cce3db5edeb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a67c21ee8d641458b54c2574107f24f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:42.186092 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6da3c215-a3ff-4c04-a045-cce3db5edeb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a67c21ee8d641458b54c2574107f24f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:42.197480 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6da3c215-a3ff-4c04-a045-cce3db5edeb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a67c21ee8d641458b54c2574107f24f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:42.215487 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6da3c215-a3ff-4c04-a045-cce3db5edeb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a67c21ee8d641458b54c2574107f24f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:42.216332 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6da3c215-a3ff-4c04-a045-cce3db5edeb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a67c21ee8d641458b54c2574107f24f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:42.333010 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1381/2791] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:55:41 2022] DELETE /identity/v3/users/2a67c21ee8d641458b54c2574107f24f => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:55:42.337762 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ded6c7-c447-4c74-a756-7fcfc76a8a54 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:42.338055 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ded6c7-c447-4c74-a756-7fcfc76a8a54 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:42.338464 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ded6c7-c447-4c74-a756-7fcfc76a8a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:42.359537 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d2ded6c7-c447-4c74-a756-7fcfc76a8a54 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:55:42.360837 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d2ded6c7-c447-4c74-a756-7fcfc76a8a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:42.457665 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1411/2792] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:55:42.471736 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3c215-a3ff-4c04-a045-cce3db5edeb2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:42.473181 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6da3c215-a3ff-4c04-a045-cce3db5edeb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:42.480130 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:42.539508 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3c215-a3ff-4c04-a045-cce3db5edeb2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:42.543673 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91c23e-1a89-499a-b0f5-9c532c6cd434 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:42.544641 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91c23e-1a89-499a-b0f5-9c532c6cd434 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:42.545045 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91c23e-1a89-499a-b0f5-9c532c6cd434 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:42.545363 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91c23e-1a89-499a-b0f5-9c532c6cd434 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:42.558420 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b91c23e-1a89-499a-b0f5-9c532c6cd434 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:42.561909 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b91c23e-1a89-499a-b0f5-9c532c6cd434 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:42.576333 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1382/2793] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:55:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:55:43.095126 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ded6c7-c447-4c74-a756-7fcfc76a8a54 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:43.096837 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d2ded6c7-c447-4c74-a756-7fcfc76a8a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:43.119295 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ded6c7-c447-4c74-a756-7fcfc76a8a54 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:43.124752 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f45166-305f-4f4b-a79d-24c0738dbe56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:43.125399 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f45166-305f-4f4b-a79d-24c0738dbe56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:43.125712 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f45166-305f-4f4b-a79d-24c0738dbe56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:43.126019 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f45166-305f-4f4b-a79d-24c0738dbe56 admin admin] PATH_INFO: `/v3/projects/c1164d4b287d416abed324fbc11ba29b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:43.127861 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f45166-305f-4f4b-a79d-24c0738dbe56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1164d4b287d416abed324fbc11ba29b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:43.129908 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f45166-305f-4f4b-a79d-24c0738dbe56 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:43.281898 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:43.300965 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-19f45166-305f-4f4b-a79d-24c0738dbe56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1164d4b287d416abed324fbc11ba29b', 'request_id': 'req-19f45166-305f-4f4b-a79d-24c0738dbe56'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:43.384415 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-19f45166-305f-4f4b-a79d-24c0738dbe56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1164d4b287d416abed324fbc11ba29b', 'request_id': 'req-19f45166-305f-4f4b-a79d-24c0738dbe56'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:43.391638 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-19f45166-305f-4f4b-a79d-24c0738dbe56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1164d4b287d416abed324fbc11ba29b', 'request_id': 'req-19f45166-305f-4f4b-a79d-24c0738dbe56'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:43.404682 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-19f45166-305f-4f4b-a79d-24c0738dbe56 admin admin] The token cache is being invalidate because project c1164d4b287d416abed324fbc11ba29b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:55:43.405116 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-19f45166-305f-4f4b-a79d-24c0738dbe56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:43.405979 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-19f45166-305f-4f4b-a79d-24c0738dbe56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:43.407733 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1412/2794] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:55:43 2022] DELETE /identity/v3/projects/c1164d4b287d416abed324fbc11ba29b => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:55:43.411985 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91c23e-1a89-499a-b0f5-9c532c6cd434 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:43.422278 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91c23e-1a89-499a-b0f5-9c532c6cd434 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:43.485797 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c324fa-4335-46bc-80ea-c381b10402c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:43.487039 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c324fa-4335-46bc-80ea-c381b10402c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:43.487232 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c324fa-4335-46bc-80ea-c381b10402c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:43.487583 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c324fa-4335-46bc-80ea-c381b10402c1 admin admin] PATH_INFO: `/v3/users/e146eed948ea46d5979a28769e9afb61` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:43.488999 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c324fa-4335-46bc-80ea-c381b10402c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e146eed948ea46d5979a28769e9afb61)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:43.490896 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c324fa-4335-46bc-80ea-c381b10402c1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:43.716688 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-84c324fa-4335-46bc-80ea-c381b10402c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e146eed948ea46d5979a28769e9afb61'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:43.717404 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-84c324fa-4335-46bc-80ea-c381b10402c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e146eed948ea46d5979a28769e9afb61'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:43.725908 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-84c324fa-4335-46bc-80ea-c381b10402c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e146eed948ea46d5979a28769e9afb61'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:43.738775 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-84c324fa-4335-46bc-80ea-c381b10402c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e146eed948ea46d5979a28769e9afb61'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:43.739490 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-84c324fa-4335-46bc-80ea-c381b10402c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e146eed948ea46d5979a28769e9afb61'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:43.796335 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1383/2795] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:55:43 2022] DELETE /identity/v3/users/e146eed948ea46d5979a28769e9afb61 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:55:44.295330 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f45166-305f-4f4b-a79d-24c0738dbe56 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:44.296880 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-19f45166-305f-4f4b-a79d-24c0738dbe56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:44.310908 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f45166-305f-4f4b-a79d-24c0738dbe56 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:44.401947 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf27656-d889-4b52-9ec9-4b2029c537cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:44.402803 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf27656-d889-4b52-9ec9-4b2029c537cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:44.403162 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf27656-d889-4b52-9ec9-4b2029c537cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:44.403509 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf27656-d889-4b52-9ec9-4b2029c537cd admin admin] PATH_INFO: `/v3/projects/9506034da7714e88bcad69e1952abb8f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:44.404863 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf27656-d889-4b52-9ec9-4b2029c537cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9506034da7714e88bcad69e1952abb8f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:44.407275 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf27656-d889-4b52-9ec9-4b2029c537cd admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:44.575941 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5cf27656-d889-4b52-9ec9-4b2029c537cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9506034da7714e88bcad69e1952abb8f', 'request_id': 'req-5cf27656-d889-4b52-9ec9-4b2029c537cd'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:44.642222 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5cf27656-d889-4b52-9ec9-4b2029c537cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9506034da7714e88bcad69e1952abb8f', 'request_id': 'req-5cf27656-d889-4b52-9ec9-4b2029c537cd'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:44.661708 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5cf27656-d889-4b52-9ec9-4b2029c537cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9506034da7714e88bcad69e1952abb8f', 'request_id': 'req-5cf27656-d889-4b52-9ec9-4b2029c537cd'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:44.673463 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5cf27656-d889-4b52-9ec9-4b2029c537cd admin admin] The token cache is being invalidate because project 9506034da7714e88bcad69e1952abb8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:55:44.673778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5cf27656-d889-4b52-9ec9-4b2029c537cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:44.674505 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5cf27656-d889-4b52-9ec9-4b2029c537cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:44.676286 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1413/2796] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:55:44 2022] DELETE /identity/v3/projects/9506034da7714e88bcad69e1952abb8f => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:55:44.680731 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c324fa-4335-46bc-80ea-c381b10402c1 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:44.682442 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-84c324fa-4335-46bc-80ea-c381b10402c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:44.708734 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c324fa-4335-46bc-80ea-c381b10402c1 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:44.735894 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:44.773047 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3e3a5-7b35-4f92-bcc4-91a4ddf9182b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:44.773948 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3e3a5-7b35-4f92-bcc4-91a4ddf9182b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:44.774335 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3e3a5-7b35-4f92-bcc4-91a4ddf9182b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:44.774713 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3e3a5-7b35-4f92-bcc4-91a4ddf9182b admin admin] PATH_INFO: `/v3/users/8ad72d18b99a41bb830245b1b99c2463` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:44.775986 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df3e3a5-7b35-4f92-bcc4-91a4ddf9182b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ad72d18b99a41bb830245b1b99c2463)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:44.778191 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df3e3a5-7b35-4f92-bcc4-91a4ddf9182b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:44.986235 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3df3e3a5-7b35-4f92-bcc4-91a4ddf9182b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ad72d18b99a41bb830245b1b99c2463'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:44.987519 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3df3e3a5-7b35-4f92-bcc4-91a4ddf9182b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ad72d18b99a41bb830245b1b99c2463'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:44.994720 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3df3e3a5-7b35-4f92-bcc4-91a4ddf9182b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ad72d18b99a41bb830245b1b99c2463'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:45.008225 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3df3e3a5-7b35-4f92-bcc4-91a4ddf9182b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ad72d18b99a41bb830245b1b99c2463'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:45.009243 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3df3e3a5-7b35-4f92-bcc4-91a4ddf9182b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ad72d18b99a41bb830245b1b99c2463'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:45.286336 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1384/2797] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:55:44 2022] DELETE /identity/v3/users/8ad72d18b99a41bb830245b1b99c2463 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:55:46.484443 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf27656-d889-4b52-9ec9-4b2029c537cd admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:46.488352 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5cf27656-d889-4b52-9ec9-4b2029c537cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:46.508764 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf27656-d889-4b52-9ec9-4b2029c537cd admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:46.563558 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:46.578962 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658eef1-5ab4-4791-b7d1-0dabe409fafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:46.580129 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658eef1-5ab4-4791-b7d1-0dabe409fafe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:46.580693 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658eef1-5ab4-4791-b7d1-0dabe409fafe admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:46.581208 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658eef1-5ab4-4791-b7d1-0dabe409fafe admin admin] PATH_INFO: `/v3/projects/71b28744fe0b4f92a2db75bb4663824e` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:46.582780 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658eef1-5ab4-4791-b7d1-0dabe409fafe admin admin] RBAC: Authorizing `identity:delete_project(project_id=71b28744fe0b4f92a2db75bb4663824e)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:46.585516 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658eef1-5ab4-4791-b7d1-0dabe409fafe admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:46.764707 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2658eef1-5ab4-4791-b7d1-0dabe409fafe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71b28744fe0b4f92a2db75bb4663824e', 'request_id': 'req-2658eef1-5ab4-4791-b7d1-0dabe409fafe'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:47.270516 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2658eef1-5ab4-4791-b7d1-0dabe409fafe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71b28744fe0b4f92a2db75bb4663824e', 'request_id': 'req-2658eef1-5ab4-4791-b7d1-0dabe409fafe'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:47.286762 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2658eef1-5ab4-4791-b7d1-0dabe409fafe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71b28744fe0b4f92a2db75bb4663824e', 'request_id': 'req-2658eef1-5ab4-4791-b7d1-0dabe409fafe'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:47.298282 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2658eef1-5ab4-4791-b7d1-0dabe409fafe admin admin] The token cache is being invalidate because project 71b28744fe0b4f92a2db75bb4663824e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:55:47.298883 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2658eef1-5ab4-4791-b7d1-0dabe409fafe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:47.299787 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2658eef1-5ab4-4791-b7d1-0dabe409fafe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:47.301919 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1414/2798] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:55:46 2022] DELETE /identity/v3/projects/71b28744fe0b4f92a2db75bb4663824e => generated 0 bytes in 818 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:55:47.307852 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069879ca-b648-4799-ada1-7c4e4313354d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:47.308457 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069879ca-b648-4799-ada1-7c4e4313354d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:47.308811 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069879ca-b648-4799-ada1-7c4e4313354d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:47.343428 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-069879ca-b648-4799-ada1-7c4e4313354d None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:55:47.344685 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-069879ca-b648-4799-ada1-7c4e4313354d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:47.420683 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1385/2799] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:55:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:55:47.429247 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4139f-e718-453a-aa8f-4de0d852b8d7 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:47.429536 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4139f-e718-453a-aa8f-4de0d852b8d7 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:47.429925 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4139f-e718-453a-aa8f-4de0d852b8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:47.450824 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d8c4139f-e718-453a-aa8f-4de0d852b8d7 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:55:47.452128 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d8c4139f-e718-453a-aa8f-4de0d852b8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:47.464822 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1415/2800] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:55:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:55:47.468311 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069879ca-b648-4799-ada1-7c4e4313354d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:47.478740 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069879ca-b648-4799-ada1-7c4e4313354d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:47.483454 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b119a-3de6-418e-9e78-167f8fe28803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:47.484731 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b119a-3de6-418e-9e78-167f8fe28803 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:47.484731 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b119a-3de6-418e-9e78-167f8fe28803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:47.484731 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b119a-3de6-418e-9e78-167f8fe28803 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:47.485299 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81b119a-3de6-418e-9e78-167f8fe28803 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:55:47.485601 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81b119a-3de6-418e-9e78-167f8fe28803 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:47.487250 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81b119a-3de6-418e-9e78-167f8fe28803 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:47.503259 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1386/2801] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:55:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:55:47.507677 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4139f-e718-453a-aa8f-4de0d852b8d7 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:47.517065 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4139f-e718-453a-aa8f-4de0d852b8d7 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:47.522660 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c97897-c68b-4449-a52d-ed0238da35f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:47.523215 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c97897-c68b-4449-a52d-ed0238da35f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:47.523494 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c97897-c68b-4449-a52d-ed0238da35f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:47.523771 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c97897-c68b-4449-a52d-ed0238da35f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:47.524403 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c97897-c68b-4449-a52d-ed0238da35f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:47.526398 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c97897-c68b-4449-a52d-ed0238da35f6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:47.627800 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1416/2802] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:55:47 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:55:47.632410 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b119a-3de6-418e-9e78-167f8fe28803 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:47.644637 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b119a-3de6-418e-9e78-167f8fe28803 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:47.686299 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:47.726429 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a7635-81da-4968-9b5f-cea65195d5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:47.729782 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a7635-81da-4968-9b5f-cea65195d5d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:47.729782 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a7635-81da-4968-9b5f-cea65195d5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:47.729782 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a7635-81da-4968-9b5f-cea65195d5d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:47.729782 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a7635-81da-4968-9b5f-cea65195d5d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:47.733687 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a7635-81da-4968-9b5f-cea65195d5d3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:47.878559 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1387/2803] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:55:47 2022] POST /identity/v3/users => generated 293 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:55:47.880480 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c97897-c68b-4449-a52d-ed0238da35f6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:47.891352 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c97897-c68b-4449-a52d-ed0238da35f6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:47.906132 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2a6bc-702e-47b7-9984-c6109a26810e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:47.906922 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2a6bc-702e-47b7-9984-c6109a26810e admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:47.907213 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2a6bc-702e-47b7-9984-c6109a26810e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:47.907485 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2a6bc-702e-47b7-9984-c6109a26810e admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:47.908196 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2a6bc-702e-47b7-9984-c6109a26810e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:47.910629 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2a6bc-702e-47b7-9984-c6109a26810e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:47.925920 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1417/2804] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:55:47.931708 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a7635-81da-4968-9b5f-cea65195d5d3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:47.942841 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a7635-81da-4968-9b5f-cea65195d5d3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:47.948262 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4bd2d-df80-468c-8fac-5afd3ebaeddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:47.948998 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4bd2d-df80-468c-8fac-5afd3ebaeddc admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:47.949401 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4bd2d-df80-468c-8fac-5afd3ebaeddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:47.949886 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4bd2d-df80-468c-8fac-5afd3ebaeddc admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:47.950665 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb4bd2d-df80-468c-8fac-5afd3ebaeddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:47.952398 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb4bd2d-df80-468c-8fac-5afd3ebaeddc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:47.964467 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1388/2805] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:55:47.968988 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2a6bc-702e-47b7-9984-c6109a26810e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:47.980607 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2a6bc-702e-47b7-9984-c6109a26810e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:47.985671 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe8821-2468-4020-a5e6-c3210ab5b408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:47.986297 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe8821-2468-4020-a5e6-c3210ab5b408 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:47.986583 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe8821-2468-4020-a5e6-c3210ab5b408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:47.986914 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe8821-2468-4020-a5e6-c3210ab5b408 admin admin] PATH_INFO: `/v3/projects/98e4082e3e6c4d2a86854dfc775d5f2a/users/8e8247d0967847f1a5d1e1c31ab8b4d0/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:48.003733 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe8821-2468-4020-a5e6-c3210ab5b408 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98e4082e3e6c4d2a86854dfc775d5f2a, user_id=8e8247d0967847f1a5d1e1c31ab8b4d0, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:48.006525 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe8821-2468-4020-a5e6-c3210ab5b408 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:48.123290 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1418/2806] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:55:47 2022] PUT /identity/v3/projects/98e4082e3e6c4d2a86854dfc775d5f2a/users/8e8247d0967847f1a5d1e1c31ab8b4d0/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:55:48.134351 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f14b3e-0a3d-417b-9377-ef190e294d82 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:48.134993 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f14b3e-0a3d-417b-9377-ef190e294d82 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:48.135271 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f14b3e-0a3d-417b-9377-ef190e294d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:48.175475 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b4f14b3e-0a3d-417b-9377-ef190e294d82 None None] MFA Rules not processed for user `8e8247d0967847f1a5d1e1c31ab8b4d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:55:48.176875 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b4f14b3e-0a3d-417b-9377-ef190e294d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:48.263960 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1389/2807] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:55:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:55:48.276981 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe8821-2468-4020-a5e6-c3210ab5b408 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:48.278759 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-aefe8821-2468-4020-a5e6-c3210ab5b408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:48.339980 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe8821-2468-4020-a5e6-c3210ab5b408 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:48.343840 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a67dc-5969-4d93-8aea-c3a27f90eaeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:48.344591 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a67dc-5969-4d93-8aea-c3a27f90eaeb service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:48.344880 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a67dc-5969-4d93-8aea-c3a27f90eaeb service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:48.345155 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a67dc-5969-4d93-8aea-c3a27f90eaeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:48.354289 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a67dc-5969-4d93-8aea-c3a27f90eaeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:48.355752 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a67dc-5969-4d93-8aea-c3a27f90eaeb service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:48.365643 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1419/2808] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:55:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:55:52.074369 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f14b3e-0a3d-417b-9377-ef190e294d82 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:52.135853 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f14b3e-0a3d-417b-9377-ef190e294d82 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:52.140353 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb96ae0-d4d8-498c-9a64-62f75126f507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:52.141014 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb96ae0-d4d8-498c-9a64-62f75126f507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:52.141291 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb96ae0-d4d8-498c-9a64-62f75126f507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:52.141564 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb96ae0-d4d8-498c-9a64-62f75126f507 admin admin] PATH_INFO: `/v3/users/8e8247d0967847f1a5d1e1c31ab8b4d0` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:52.142706 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb96ae0-d4d8-498c-9a64-62f75126f507 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e8247d0967847f1a5d1e1c31ab8b4d0)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:52.144609 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb96ae0-d4d8-498c-9a64-62f75126f507 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:52.390564 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:52.393062 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3eb96ae0-d4d8-498c-9a64-62f75126f507 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e8247d0967847f1a5d1e1c31ab8b4d0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:52.393736 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3eb96ae0-d4d8-498c-9a64-62f75126f507 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e8247d0967847f1a5d1e1c31ab8b4d0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:52.400604 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3eb96ae0-d4d8-498c-9a64-62f75126f507 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e8247d0967847f1a5d1e1c31ab8b4d0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:52.412314 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3eb96ae0-d4d8-498c-9a64-62f75126f507 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e8247d0967847f1a5d1e1c31ab8b4d0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:52.413245 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3eb96ae0-d4d8-498c-9a64-62f75126f507 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e8247d0967847f1a5d1e1c31ab8b4d0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:52.487254 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1390/2809] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:55:52 2022] DELETE /identity/v3/users/8e8247d0967847f1a5d1e1c31ab8b4d0 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:55:52.492358 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726edeef-9899-4534-ad35-d2ab276a1a37 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:52.503354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726edeef-9899-4534-ad35-d2ab276a1a37 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:52.503354 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726edeef-9899-4534-ad35-d2ab276a1a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:52.512705 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-726edeef-9899-4534-ad35-d2ab276a1a37 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:55:52.514033 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-726edeef-9899-4534-ad35-d2ab276a1a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:52.526275 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:55:52.574627 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1420/2810] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:55:52.584266 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb96ae0-d4d8-498c-9a64-62f75126f507 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:52.589207 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3eb96ae0-d4d8-498c-9a64-62f75126f507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:52.642608 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb96ae0-d4d8-498c-9a64-62f75126f507 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:52.646778 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7fb9b-2234-4c66-9554-0ef35dd559e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:52.647379 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7fb9b-2234-4c66-9554-0ef35dd559e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:52.647657 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7fb9b-2234-4c66-9554-0ef35dd559e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:52.647925 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7fb9b-2234-4c66-9554-0ef35dd559e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:52.656811 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b7fb9b-2234-4c66-9554-0ef35dd559e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:52.658257 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b7fb9b-2234-4c66-9554-0ef35dd559e6 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:52.668603 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1391/2811] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:55:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:55:53.128410 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726edeef-9899-4534-ad35-d2ab276a1a37 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:53.137457 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-726edeef-9899-4534-ad35-d2ab276a1a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:53.141795 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726edeef-9899-4534-ad35-d2ab276a1a37 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:53.146970 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0579ac-3287-4ab8-adad-bf7f3b9bacf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:53.147603 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0579ac-3287-4ab8-adad-bf7f3b9bacf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:53.147890 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0579ac-3287-4ab8-adad-bf7f3b9bacf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:53.148169 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0579ac-3287-4ab8-adad-bf7f3b9bacf2 admin admin] PATH_INFO: `/v3/projects/98e4082e3e6c4d2a86854dfc775d5f2a` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:53.149521 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0579ac-3287-4ab8-adad-bf7f3b9bacf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98e4082e3e6c4d2a86854dfc775d5f2a)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:53.151466 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0579ac-3287-4ab8-adad-bf7f3b9bacf2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:53.258028 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7a0579ac-3287-4ab8-adad-bf7f3b9bacf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98e4082e3e6c4d2a86854dfc775d5f2a', 'request_id': 'req-7a0579ac-3287-4ab8-adad-bf7f3b9bacf2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:53.338346 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7a0579ac-3287-4ab8-adad-bf7f3b9bacf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98e4082e3e6c4d2a86854dfc775d5f2a', 'request_id': 'req-7a0579ac-3287-4ab8-adad-bf7f3b9bacf2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:53.345178 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7a0579ac-3287-4ab8-adad-bf7f3b9bacf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98e4082e3e6c4d2a86854dfc775d5f2a', 'request_id': 'req-7a0579ac-3287-4ab8-adad-bf7f3b9bacf2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:53.356998 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7a0579ac-3287-4ab8-adad-bf7f3b9bacf2 admin admin] The token cache is being invalidate because project 98e4082e3e6c4d2a86854dfc775d5f2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:55:53.357218 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7a0579ac-3287-4ab8-adad-bf7f3b9bacf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:53.357921 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7a0579ac-3287-4ab8-adad-bf7f3b9bacf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:55:53.359428 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1421/2812] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:55:53 2022] DELETE /identity/v3/projects/98e4082e3e6c4d2a86854dfc775d5f2a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:55:56.744425 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb99a17-8893-497a-9c1a-9ac2f2fc5eb0 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:56.744887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb99a17-8893-497a-9c1a-9ac2f2fc5eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:56.744991 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb99a17-8893-497a-9c1a-9ac2f2fc5eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:56.763859 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-abb99a17-8893-497a-9c1a-9ac2f2fc5eb0 None None] MFA Rules not processed for user `b0812002d7b14bcb81a42eb380231feb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:55:56.765043 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-abb99a17-8893-497a-9c1a-9ac2f2fc5eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:56.819346 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1392/2813] 10.222.0.33 () {58 vars in 967 bytes} [Fri Sep 16 03:55:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:55:56.831356 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0579ac-3287-4ab8-adad-bf7f3b9bacf2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:55:56.832814 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7a0579ac-3287-4ab8-adad-bf7f3b9bacf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:55:56.900304 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0579ac-3287-4ab8-adad-bf7f3b9bacf2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:55:56.905304 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb8d22-ad76-4f7b-b7af-a7ac0cea5b47 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f784d98d5f440c681f53ae70f6d1cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:55:56.905944 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb8d22-ad76-4f7b-b7af-a7ac0cea5b47 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:55:56.906226 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb8d22-ad76-4f7b-b7af-a7ac0cea5b47 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:55:56.906502 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb8d22-ad76-4f7b-b7af-a7ac0cea5b47 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:55:56.914884 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb8d22-ad76-4f7b-b7af-a7ac0cea5b47 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:55:56.916722 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb8d22-ad76-4f7b-b7af-a7ac0cea5b47 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:55:56.924615 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1422/2814] 10.222.0.33 () {60 vars in 1384 bytes} [Fri Sep 16 03:55:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 03:56:06.812714 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=4,keystone:SELECT=64,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:56:06.921408 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=78,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:56:31.250357 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb99a17-8893-497a-9c1a-9ac2f2fc5eb0 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:56:31.251887 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-abb99a17-8893-497a-9c1a-9ac2f2fc5eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:56:31.348227 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb99a17-8893-497a-9c1a-9ac2f2fc5eb0 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:56:31.353475 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6334777-b14a-4154-b9e1-1a55763ef10e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c39fd09bea1a40babc5f629612c6702b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:56:31.354666 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6334777-b14a-4154-b9e1-1a55763ef10e service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:56:31.354947 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6334777-b14a-4154-b9e1-1a55763ef10e service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:56:31.355219 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6334777-b14a-4154-b9e1-1a55763ef10e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:56:31.357226 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c6334777-b14a-4154-b9e1-1a55763ef10e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:56:31.369587 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6334777-b14a-4154-b9e1-1a55763ef10e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:56:31.371195 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6334777-b14a-4154-b9e1-1a55763ef10e service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:56:31.381376 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1393/2815] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:56:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:56:34.872317 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11cec91-6a10-42e2-9567-af4da5dbacea None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:56:34.872806 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11cec91-6a10-42e2-9567-af4da5dbacea None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:56:34.872907 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11cec91-6a10-42e2-9567-af4da5dbacea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:56:34.892452 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f11cec91-6a10-42e2-9567-af4da5dbacea None None] MFA Rules not processed for user `b0812002d7b14bcb81a42eb380231feb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:56:34.893723 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f11cec91-6a10-42e2-9567-af4da5dbacea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:56:34.908129 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1423/2816] 10.222.0.33 () {58 vars in 967 bytes} [Fri Sep 16 03:56:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:56:34.930019 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6334777-b14a-4154-b9e1-1a55763ef10e service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:56:34.941878 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6334777-b14a-4154-b9e1-1a55763ef10e service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:56:34.946822 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99630c67-3c14-4d5b-909c-ce88692038de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f784d98d5f440c681f53ae70f6d1cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:56:34.952025 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99630c67-3c14-4d5b-909c-ce88692038de service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:56:34.952025 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99630c67-3c14-4d5b-909c-ce88692038de service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:56:34.952025 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99630c67-3c14-4d5b-909c-ce88692038de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:56:34.956504 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99630c67-3c14-4d5b-909c-ce88692038de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:56:34.958085 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99630c67-3c14-4d5b-909c-ce88692038de service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:56:34.966081 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1394/2817] 10.222.0.33 () {60 vars in 1384 bytes} [Fri Sep 16 03:56:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 03:56:39.983298 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11cec91-6a10-42e2-9567-af4da5dbacea None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:56:39.984866 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f11cec91-6a10-42e2-9567-af4da5dbacea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:56:40.019642 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11cec91-6a10-42e2-9567-af4da5dbacea None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:56:40.025118 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35491d-870d-4db4-b586-12f39de07d40 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c39fd09bea1a40babc5f629612c6702b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:56:40.026436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35491d-870d-4db4-b586-12f39de07d40 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:56:40.026810 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35491d-870d-4db4-b586-12f39de07d40 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:56:40.027180 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35491d-870d-4db4-b586-12f39de07d40 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:56:40.029598 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9f35491d-870d-4db4-b586-12f39de07d40 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:56:40.041985 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35491d-870d-4db4-b586-12f39de07d40 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:56:40.043609 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35491d-870d-4db4-b586-12f39de07d40 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:56:40.063899 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1424/2818] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:56:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:56:43.655772 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03955b-e17b-4ca1-bc4a-57418d996985 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:56:43.656775 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03955b-e17b-4ca1-bc4a-57418d996985 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:56:43.657241 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03955b-e17b-4ca1-bc4a-57418d996985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:56:43.680205 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ff03955b-e17b-4ca1-bc4a-57418d996985 None None] MFA Rules not processed for user `db489eef960941e8a3c187bbedc978d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:56:43.681523 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ff03955b-e17b-4ca1-bc4a-57418d996985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:56:43.769777 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1395/2819] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:56:43 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:56:44.221322 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35491d-870d-4db4-b586-12f39de07d40 service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:56:44.232926 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35491d-870d-4db4-b586-12f39de07d40 service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:56:44.238559 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81663572-4427-49c8-8e42-053c9e2b6778 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c39fd09bea1a40babc5f629612c6702b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:56:44.239169 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81663572-4427-49c8-8e42-053c9e2b6778 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:56:44.239447 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81663572-4427-49c8-8e42-053c9e2b6778 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:56:44.239815 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81663572-4427-49c8-8e42-053c9e2b6778 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:56:44.241661 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-81663572-4427-49c8-8e42-053c9e2b6778 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:56:44.253737 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81663572-4427-49c8-8e42-053c9e2b6778 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:56:44.255342 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81663572-4427-49c8-8e42-053c9e2b6778 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:56:44.266088 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1425/2820] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:56:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:56:44.618774 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03955b-e17b-4ca1-bc4a-57418d996985 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:56:44.620829 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ff03955b-e17b-4ca1-bc4a-57418d996985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:56:44.693762 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03955b-e17b-4ca1-bc4a-57418d996985 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:56:44.699306 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186bb75-8e38-45c8-89d9-c058e3f9907a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:56:44.699947 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186bb75-8e38-45c8-89d9-c058e3f9907a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:56:44.700230 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186bb75-8e38-45c8-89d9-c058e3f9907a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:56:44.700506 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186bb75-8e38-45c8-89d9-c058e3f9907a admin admin] PATH_INFO: `/v3/users/2a9f5df827e74cbd98513755af517251` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:56:44.701742 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f186bb75-8e38-45c8-89d9-c058e3f9907a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a9f5df827e74cbd98513755af517251)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:56:44.703780 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f186bb75-8e38-45c8-89d9-c058e3f9907a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:56:44.706176 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:56:44.935612 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f186bb75-8e38-45c8-89d9-c058e3f9907a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a9f5df827e74cbd98513755af517251'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:56:44.936272 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f186bb75-8e38-45c8-89d9-c058e3f9907a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a9f5df827e74cbd98513755af517251'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:56:44.943146 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f186bb75-8e38-45c8-89d9-c058e3f9907a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a9f5df827e74cbd98513755af517251'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:56:44.954944 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f186bb75-8e38-45c8-89d9-c058e3f9907a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a9f5df827e74cbd98513755af517251'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:56:44.955573 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f186bb75-8e38-45c8-89d9-c058e3f9907a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a9f5df827e74cbd98513755af517251'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:56:45.052415 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1396/2821] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:56:44 2022] DELETE /identity/v3/users/2a9f5df827e74cbd98513755af517251 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:56:45.340382 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81663572-4427-49c8-8e42-053c9e2b6778 service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:56:45.354535 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81663572-4427-49c8-8e42-053c9e2b6778 service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:56:45.412169 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75368442-1974-4493-9f9a-47b3a4617ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:56:45.412799 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75368442-1974-4493-9f9a-47b3a4617ed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:56:45.413110 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75368442-1974-4493-9f9a-47b3a4617ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:56:45.413387 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75368442-1974-4493-9f9a-47b3a4617ed8 admin admin] PATH_INFO: `/v3/projects/6f7a509357914575bb66a6fb62cce5fe` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:56:45.414540 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75368442-1974-4493-9f9a-47b3a4617ed8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f7a509357914575bb66a6fb62cce5fe)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:56:45.417053 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75368442-1974-4493-9f9a-47b3a4617ed8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:56:45.577128 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-75368442-1974-4493-9f9a-47b3a4617ed8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f7a509357914575bb66a6fb62cce5fe', 'request_id': 'req-75368442-1974-4493-9f9a-47b3a4617ed8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:56:45.686565 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-75368442-1974-4493-9f9a-47b3a4617ed8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f7a509357914575bb66a6fb62cce5fe', 'request_id': 'req-75368442-1974-4493-9f9a-47b3a4617ed8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:56:45.693625 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-75368442-1974-4493-9f9a-47b3a4617ed8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f7a509357914575bb66a6fb62cce5fe', 'request_id': 'req-75368442-1974-4493-9f9a-47b3a4617ed8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:56:45.704689 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-75368442-1974-4493-9f9a-47b3a4617ed8 admin admin] The token cache is being invalidate because project 6f7a509357914575bb66a6fb62cce5fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:56:45.704985 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-75368442-1974-4493-9f9a-47b3a4617ed8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:56:45.705654 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-75368442-1974-4493-9f9a-47b3a4617ed8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:56:45.707226 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1426/2822] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:56:45 2022] DELETE /identity/v3/projects/6f7a509357914575bb66a6fb62cce5fe => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:56:45.711183 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186bb75-8e38-45c8-89d9-c058e3f9907a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:56:45.712651 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f186bb75-8e38-45c8-89d9-c058e3f9907a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:56:45.726273 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186bb75-8e38-45c8-89d9-c058e3f9907a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:56:45.785091 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0015c6-a504-413a-bbae-5dc613a31d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:56:45.785773 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0015c6-a504-413a-bbae-5dc613a31d9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:56:45.786059 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0015c6-a504-413a-bbae-5dc613a31d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:56:45.786338 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0015c6-a504-413a-bbae-5dc613a31d9e admin admin] PATH_INFO: `/v3/users/c1baeebafbc3458e9071cdc9ad14884a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:56:45.787542 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0015c6-a504-413a-bbae-5dc613a31d9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1baeebafbc3458e9071cdc9ad14884a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:56:45.789469 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0015c6-a504-413a-bbae-5dc613a31d9e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:56:46.031934 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fe0015c6-a504-413a-bbae-5dc613a31d9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1baeebafbc3458e9071cdc9ad14884a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:56:46.032819 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fe0015c6-a504-413a-bbae-5dc613a31d9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1baeebafbc3458e9071cdc9ad14884a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:56:46.040940 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fe0015c6-a504-413a-bbae-5dc613a31d9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1baeebafbc3458e9071cdc9ad14884a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:56:46.054054 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fe0015c6-a504-413a-bbae-5dc613a31d9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1baeebafbc3458e9071cdc9ad14884a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:56:46.054777 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fe0015c6-a504-413a-bbae-5dc613a31d9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1baeebafbc3458e9071cdc9ad14884a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:56:46.169211 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:56:46.173831 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1397/2823] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:56:45 2022] DELETE /identity/v3/users/c1baeebafbc3458e9071cdc9ad14884a => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:56:46.425874 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75368442-1974-4493-9f9a-47b3a4617ed8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:56:46.427497 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-75368442-1974-4493-9f9a-47b3a4617ed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:56:46.441711 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75368442-1974-4493-9f9a-47b3a4617ed8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:56:46.490892 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:56:46.500755 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393bc08-69a8-499a-be73-27a5c95119fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:56:46.501906 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393bc08-69a8-499a-be73-27a5c95119fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:56:46.501906 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393bc08-69a8-499a-be73-27a5c95119fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:56:46.502103 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393bc08-69a8-499a-be73-27a5c95119fd admin admin] PATH_INFO: `/v3/projects/61a84bea63a94ccd931c057f0d87a2d7` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:56:46.503319 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5393bc08-69a8-499a-be73-27a5c95119fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=61a84bea63a94ccd931c057f0d87a2d7)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:56:46.505230 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5393bc08-69a8-499a-be73-27a5c95119fd admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:56:46.658256 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5393bc08-69a8-499a-be73-27a5c95119fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61a84bea63a94ccd931c057f0d87a2d7', 'request_id': 'req-5393bc08-69a8-499a-be73-27a5c95119fd'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:56:46.744061 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5393bc08-69a8-499a-be73-27a5c95119fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61a84bea63a94ccd931c057f0d87a2d7', 'request_id': 'req-5393bc08-69a8-499a-be73-27a5c95119fd'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:56:46.751133 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5393bc08-69a8-499a-be73-27a5c95119fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61a84bea63a94ccd931c057f0d87a2d7', 'request_id': 'req-5393bc08-69a8-499a-be73-27a5c95119fd'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:56:46.762152 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5393bc08-69a8-499a-be73-27a5c95119fd admin admin] The token cache is being invalidate because project 61a84bea63a94ccd931c057f0d87a2d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:56:46.762467 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5393bc08-69a8-499a-be73-27a5c95119fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:56:46.763129 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5393bc08-69a8-499a-be73-27a5c95119fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:56:46.764613 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1427/2824] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:56:46 2022] DELETE /identity/v3/projects/61a84bea63a94ccd931c057f0d87a2d7 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:56:57.315548 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=28,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:57:42.487517 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158957d-5748-424f-b009-8ba5e1afcaac None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:57:42.488604 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158957d-5748-424f-b009-8ba5e1afcaac None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:57:42.488604 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158957d-5748-424f-b009-8ba5e1afcaac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:57:42.508356 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c158957d-5748-424f-b009-8ba5e1afcaac None None] MFA Rules not processed for user `b0812002d7b14bcb81a42eb380231feb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:57:42.509579 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c158957d-5748-424f-b009-8ba5e1afcaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:57:42.568134 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1398/2825] 10.222.0.33 () {58 vars in 1009 bytes} [Fri Sep 16 03:57:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:57:42.765449 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393bc08-69a8-499a-be73-27a5c95119fd admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:57:42.766906 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5393bc08-69a8-499a-be73-27a5c95119fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:57:42.834119 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393bc08-69a8-499a-be73-27a5c95119fd admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:57:42.839014 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a8ef2-0bdc-48a7-b2f1-78671d610e49 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f784d98d5f440c681f53ae70f6d1cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:57:42.839609 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a8ef2-0bdc-48a7-b2f1-78671d610e49 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:57:42.839883 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a8ef2-0bdc-48a7-b2f1-78671d610e49 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:57:42.840151 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a8ef2-0bdc-48a7-b2f1-78671d610e49 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:57:42.847915 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a8ef2-0bdc-48a7-b2f1-78671d610e49 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:57:42.849479 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a8ef2-0bdc-48a7-b2f1-78671d610e49 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:57:42.857307 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1428/2826] 10.222.0.33 () {60 vars in 1384 bytes} [Fri Sep 16 03:57:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 03:57:52.560841 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=25 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:57:52.854226 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=32 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:58:02.065849 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459183f3-c733-4cc7-a169-2215c778885b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:58:02.066335 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459183f3-c733-4cc7-a169-2215c778885b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:58:02.066488 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459183f3-c733-4cc7-a169-2215c778885b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:58:02.086021 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-459183f3-c733-4cc7-a169-2215c778885b None None] MFA Rules not processed for user `b0812002d7b14bcb81a42eb380231feb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:58:02.087136 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-459183f3-c733-4cc7-a169-2215c778885b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:58:02.094473 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1399/2827] 10.222.0.33 () {58 vars in 1009 bytes} [Fri Sep 16 03:58:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:58:02.106361 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a8ef2-0bdc-48a7-b2f1-78671d610e49 service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:58:02.117443 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a8ef2-0bdc-48a7-b2f1-78671d610e49 service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:58:02.122516 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a220d2b-c278-482b-bc1c-6c27eeb25ffa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f784d98d5f440c681f53ae70f6d1cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:58:02.123109 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a220d2b-c278-482b-bc1c-6c27eeb25ffa service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:58:02.123389 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a220d2b-c278-482b-bc1c-6c27eeb25ffa service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:58:02.123662 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a220d2b-c278-482b-bc1c-6c27eeb25ffa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:58:02.131558 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a220d2b-c278-482b-bc1c-6c27eeb25ffa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:58:02.133769 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a220d2b-c278-482b-bc1c-6c27eeb25ffa service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:58:02.141704 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1429/2828] 10.222.0.33 () {60 vars in 1384 bytes} [Fri Sep 16 03:58:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 03:58:12.080880 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:58:12.138529 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=6 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:58:17.139772 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79be0a-8ad7-4246-8b93-f0cfd8865c6e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:58:17.140262 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79be0a-8ad7-4246-8b93-f0cfd8865c6e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:58:17.140388 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79be0a-8ad7-4246-8b93-f0cfd8865c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:58:17.160121 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2c79be0a-8ad7-4246-8b93-f0cfd8865c6e None None] MFA Rules not processed for user `b0812002d7b14bcb81a42eb380231feb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:58:17.161331 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2c79be0a-8ad7-4246-8b93-f0cfd8865c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:58:17.169528 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1400/2829] 10.222.0.33 () {58 vars in 967 bytes} [Fri Sep 16 03:58:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:58:17.183480 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a220d2b-c278-482b-bc1c-6c27eeb25ffa service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:58:17.195302 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a220d2b-c278-482b-bc1c-6c27eeb25ffa service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:58:17.200433 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f270f-9378-42ea-88b4-e0487894de2e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f784d98d5f440c681f53ae70f6d1cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:58:17.201044 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f270f-9378-42ea-88b4-e0487894de2e service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:58:17.201945 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f270f-9378-42ea-88b4-e0487894de2e service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:58:17.202248 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f270f-9378-42ea-88b4-e0487894de2e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:58:17.211235 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f270f-9378-42ea-88b4-e0487894de2e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:58:17.212862 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f270f-9378-42ea-88b4-e0487894de2e service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:58:17.221312 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1430/2830] 10.222.0.33 () {60 vars in 1384 bytes} [Fri Sep 16 03:58:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 03:58:18.406298 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79be0a-8ad7-4246-8b93-f0cfd8865c6e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:58:18.407849 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2c79be0a-8ad7-4246-8b93-f0cfd8865c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:58:18.464491 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79be0a-8ad7-4246-8b93-f0cfd8865c6e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:58:18.468122 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77cd30-a00d-4474-9c3b-9e91cc25a628 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:58:18.468730 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77cd30-a00d-4474-9c3b-9e91cc25a628 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:58:18.469010 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77cd30-a00d-4474-9c3b-9e91cc25a628 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:58:18.469282 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77cd30-a00d-4474-9c3b-9e91cc25a628 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:58:18.471025 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1b77cd30-a00d-4474-9c3b-9e91cc25a628 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:58:18.553193 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b77cd30-a00d-4474-9c3b-9e91cc25a628 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:58:18.554565 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b77cd30-a00d-4474-9c3b-9e91cc25a628 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:58:18.575972 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1401/2831] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:58:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:58:19.759703 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f270f-9378-42ea-88b4-e0487894de2e service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:58:19.761138 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9d7f270f-9378-42ea-88b4-e0487894de2e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:58:19.773380 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f270f-9378-42ea-88b4-e0487894de2e service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:58:19.776930 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b048d02-b0da-4138-8ef7-7ba3ab9c5056 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:58:19.777520 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b048d02-b0da-4138-8ef7-7ba3ab9c5056 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:58:19.778312 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b048d02-b0da-4138-8ef7-7ba3ab9c5056 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:58:19.778594 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b048d02-b0da-4138-8ef7-7ba3ab9c5056 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:58:19.780368 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7b048d02-b0da-4138-8ef7-7ba3ab9c5056 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:58:19.796930 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b048d02-b0da-4138-8ef7-7ba3ab9c5056 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:58:19.798373 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b048d02-b0da-4138-8ef7-7ba3ab9c5056 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:58:19.809053 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1431/2832] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:58:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:58:28.572735 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=66 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:58:29.804268 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=12 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:58:52.133778 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77cd30-a00d-4474-9c3b-9e91cc25a628 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:58:52.135314 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1b77cd30-a00d-4474-9c3b-9e91cc25a628 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:58:52.150024 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77cd30-a00d-4474-9c3b-9e91cc25a628 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:58:52.156481 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b10072-5493-40a2-be36-7c3d23adb55d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:58:52.157194 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b10072-5493-40a2-be36-7c3d23adb55d service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:58:52.157549 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b10072-5493-40a2-be36-7c3d23adb55d service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:58:52.157922 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b10072-5493-40a2-be36-7c3d23adb55d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:58:52.159766 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-39b10072-5493-40a2-be36-7c3d23adb55d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:58:52.174065 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b10072-5493-40a2-be36-7c3d23adb55d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:58:52.189153 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b10072-5493-40a2-be36-7c3d23adb55d service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:58:52.190118 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1402/2833] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:58:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:58:57.100512 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b048d02-b0da-4138-8ef7-7ba3ab9c5056 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:58:57.109809 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b048d02-b0da-4138-8ef7-7ba3ab9c5056 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:58:57.113417 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02818dba-4173-42ef-8e22-dff8ccc3801a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:58:57.114061 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02818dba-4173-42ef-8e22-dff8ccc3801a service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:58:57.114360 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02818dba-4173-42ef-8e22-dff8ccc3801a service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:58:57.114744 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02818dba-4173-42ef-8e22-dff8ccc3801a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:58:57.116455 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-02818dba-4173-42ef-8e22-dff8ccc3801a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:58:57.178234 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02818dba-4173-42ef-8e22-dff8ccc3801a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:58:57.179662 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02818dba-4173-42ef-8e22-dff8ccc3801a service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:58:57.189716 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1432/2834] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:58:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:59:00.889377 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b10072-5493-40a2-be36-7c3d23adb55d service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:00.890859 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-39b10072-5493-40a2-be36-7c3d23adb55d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:59:00.904982 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b10072-5493-40a2-be36-7c3d23adb55d service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:00.909579 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22516765-7de5-4fcc-85b7-1e3d92fd9f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:00.910241 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22516765-7de5-4fcc-85b7-1e3d92fd9f14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:00.910524 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22516765-7de5-4fcc-85b7-1e3d92fd9f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:00.910799 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22516765-7de5-4fcc-85b7-1e3d92fd9f14 admin admin] PATH_INFO: `/v3/users/db489eef960941e8a3c187bbedc978d9` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:00.911955 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22516765-7de5-4fcc-85b7-1e3d92fd9f14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db489eef960941e8a3c187bbedc978d9)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:00.913888 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22516765-7de5-4fcc-85b7-1e3d92fd9f14 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:01.105805 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-22516765-7de5-4fcc-85b7-1e3d92fd9f14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db489eef960941e8a3c187bbedc978d9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:01.106318 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-22516765-7de5-4fcc-85b7-1e3d92fd9f14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db489eef960941e8a3c187bbedc978d9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:01.114268 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-22516765-7de5-4fcc-85b7-1e3d92fd9f14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db489eef960941e8a3c187bbedc978d9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:01.126195 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-22516765-7de5-4fcc-85b7-1e3d92fd9f14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db489eef960941e8a3c187bbedc978d9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:01.126840 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-22516765-7de5-4fcc-85b7-1e3d92fd9f14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db489eef960941e8a3c187bbedc978d9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:01.224300 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1403/2835] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:59:00 2022] DELETE /identity/v3/users/db489eef960941e8a3c187bbedc978d9 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:59:01.481592 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02818dba-4173-42ef-8e22-dff8ccc3801a service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:01.496599 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02818dba-4173-42ef-8e22-dff8ccc3801a service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:01.550300 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46456bc2-05fc-4c41-a319-747cccf4624d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:01.550929 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46456bc2-05fc-4c41-a319-747cccf4624d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:01.551212 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46456bc2-05fc-4c41-a319-747cccf4624d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:01.551486 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46456bc2-05fc-4c41-a319-747cccf4624d admin admin] PATH_INFO: `/v3/projects/d4cf4ff943214f6ba4e97dbf0bdb89ef` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:01.552598 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46456bc2-05fc-4c41-a319-747cccf4624d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4cf4ff943214f6ba4e97dbf0bdb89ef)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:01.554537 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46456bc2-05fc-4c41-a319-747cccf4624d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:01.670170 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-46456bc2-05fc-4c41-a319-747cccf4624d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4cf4ff943214f6ba4e97dbf0bdb89ef', 'request_id': 'req-46456bc2-05fc-4c41-a319-747cccf4624d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:01.746002 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-46456bc2-05fc-4c41-a319-747cccf4624d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4cf4ff943214f6ba4e97dbf0bdb89ef', 'request_id': 'req-46456bc2-05fc-4c41-a319-747cccf4624d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:01.753228 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-46456bc2-05fc-4c41-a319-747cccf4624d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4cf4ff943214f6ba4e97dbf0bdb89ef', 'request_id': 'req-46456bc2-05fc-4c41-a319-747cccf4624d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:01.764408 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-46456bc2-05fc-4c41-a319-747cccf4624d admin admin] The token cache is being invalidate because project d4cf4ff943214f6ba4e97dbf0bdb89ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:59:01.768755 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-46456bc2-05fc-4c41-a319-747cccf4624d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:01.768755 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-46456bc2-05fc-4c41-a319-747cccf4624d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:01.768755 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1433/2836] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:59:01 2022] DELETE /identity/v3/projects/d4cf4ff943214f6ba4e97dbf0bdb89ef => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:59:01.771789 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855c1c9-a6b8-4513-a52b-8d8dd1baf5f2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:01.772079 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855c1c9-a6b8-4513-a52b-8d8dd1baf5f2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:01.772358 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855c1c9-a6b8-4513-a52b-8d8dd1baf5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:01.792042 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a855c1c9-a6b8-4513-a52b-8d8dd1baf5f2 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:59:01.793501 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a855c1c9-a6b8-4513-a52b-8d8dd1baf5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:59:01.851574 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1404/2837] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:59:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:59:01.859957 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc35b4b-9d57-4599-a345-620e404d85d4 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:01.860249 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc35b4b-9d57-4599-a345-620e404d85d4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:01.860536 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc35b4b-9d57-4599-a345-620e404d85d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:01.881803 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6cc35b4b-9d57-4599-a345-620e404d85d4 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:59:01.883018 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6cc35b4b-9d57-4599-a345-620e404d85d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:59:01.891514 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1434/2838] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:59:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:59:01.895661 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855c1c9-a6b8-4513-a52b-8d8dd1baf5f2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:01.905787 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855c1c9-a6b8-4513-a52b-8d8dd1baf5f2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:01.910385 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e0bcf-5d2c-40ea-b216-ed15017bf932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:01.910979 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e0bcf-5d2c-40ea-b216-ed15017bf932 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:01.911262 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e0bcf-5d2c-40ea-b216-ed15017bf932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:01.911536 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e0bcf-5d2c-40ea-b216-ed15017bf932 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:01.912178 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e0bcf-5d2c-40ea-b216-ed15017bf932 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:59:01.912479 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e0bcf-5d2c-40ea-b216-ed15017bf932 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:01.914097 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e0bcf-5d2c-40ea-b216-ed15017bf932 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:01.926321 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1405/2839] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:59:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:59:01.930459 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc35b4b-9d57-4599-a345-620e404d85d4 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:01.939789 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc35b4b-9d57-4599-a345-620e404d85d4 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:01.944448 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc80f19-9b5b-4b79-8010-c57f40d072f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:01.945038 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc80f19-9b5b-4b79-8010-c57f40d072f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:01.945320 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc80f19-9b5b-4b79-8010-c57f40d072f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:01.945613 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc80f19-9b5b-4b79-8010-c57f40d072f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:01.946294 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc80f19-9b5b-4b79-8010-c57f40d072f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:01.948218 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc80f19-9b5b-4b79-8010-c57f40d072f1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:01.963807 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:59:02.133158 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1435/2840] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:59:01 2022] POST /identity/v3/projects => generated 367 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:59:02.137496 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e0bcf-5d2c-40ea-b216-ed15017bf932 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:02.147905 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e0bcf-5d2c-40ea-b216-ed15017bf932 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:02.190832 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:59:02.203633 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98838421-7c7c-42b7-b1eb-b5ff24ce9ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:02.204245 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98838421-7c7c-42b7-b1eb-b5ff24ce9ff4 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:02.204525 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98838421-7c7c-42b7-b1eb-b5ff24ce9ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:02.204797 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98838421-7c7c-42b7-b1eb-b5ff24ce9ff4 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:02.205420 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98838421-7c7c-42b7-b1eb-b5ff24ce9ff4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:02.207359 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98838421-7c7c-42b7-b1eb-b5ff24ce9ff4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:02.371935 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1406/2841] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:59:02 2022] POST /identity/v3/users => generated 284 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:59:02.375959 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc80f19-9b5b-4b79-8010-c57f40d072f1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:02.386130 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc80f19-9b5b-4b79-8010-c57f40d072f1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:02.391187 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b61a3-a049-43d6-b0a9-6d2abcb80622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:02.391993 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b61a3-a049-43d6-b0a9-6d2abcb80622 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:02.392385 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b61a3-a049-43d6-b0a9-6d2abcb80622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:02.392764 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b61a3-a049-43d6-b0a9-6d2abcb80622 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:02.393551 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b61a3-a049-43d6-b0a9-6d2abcb80622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:02.395431 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b61a3-a049-43d6-b0a9-6d2abcb80622 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:02.406362 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1436/2842] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:59:02.410326 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98838421-7c7c-42b7-b1eb-b5ff24ce9ff4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:02.420828 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98838421-7c7c-42b7-b1eb-b5ff24ce9ff4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:02.425448 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83493b5d-b7c7-43af-8e41-8f30c2922311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:02.426076 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83493b5d-b7c7-43af-8e41-8f30c2922311 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:02.426356 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83493b5d-b7c7-43af-8e41-8f30c2922311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:02.426626 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83493b5d-b7c7-43af-8e41-8f30c2922311 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:02.427284 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83493b5d-b7c7-43af-8e41-8f30c2922311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:02.428853 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83493b5d-b7c7-43af-8e41-8f30c2922311 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:02.440134 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1407/2843] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:59:02.444573 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b61a3-a049-43d6-b0a9-6d2abcb80622 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:02.454967 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b61a3-a049-43d6-b0a9-6d2abcb80622 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:02.459507 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b567c-676d-4522-bba0-45b555a34f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:02.460137 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b567c-676d-4522-bba0-45b555a34f02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:02.460421 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b567c-676d-4522-bba0-45b555a34f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:02.460694 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b567c-676d-4522-bba0-45b555a34f02 admin admin] PATH_INFO: `/v3/projects/514b99eddb5a4cd69dc4842916fd18c8/users/1bba2270772d49dc91b5c889b56df144/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:02.475509 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b567c-676d-4522-bba0-45b555a34f02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=514b99eddb5a4cd69dc4842916fd18c8, user_id=1bba2270772d49dc91b5c889b56df144, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:02.478188 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b567c-676d-4522-bba0-45b555a34f02 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:02.543006 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1437/2844] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:59:02 2022] PUT /identity/v3/projects/514b99eddb5a4cd69dc4842916fd18c8/users/1bba2270772d49dc91b5c889b56df144/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:59:02.562061 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c38a1b-7b98-4388-a571-8ff0148a8b31 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:02.562348 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c38a1b-7b98-4388-a571-8ff0148a8b31 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:02.562623 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c38a1b-7b98-4388-a571-8ff0148a8b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:02.590307 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b6c38a1b-7b98-4388-a571-8ff0148a8b31 None None] MFA Rules not processed for user `1bba2270772d49dc91b5c889b56df144`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:59:02.591519 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b6c38a1b-7b98-4388-a571-8ff0148a8b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:59:02.656926 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1408/2845] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:59:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:59:02.667731 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b567c-676d-4522-bba0-45b555a34f02 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:02.669825 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-542b567c-676d-4522-bba0-45b555a34f02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:59:02.728365 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b567c-676d-4522-bba0-45b555a34f02 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:02.731994 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df3f72-6fee-49f9-b061-2dcde414eeda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:02.732595 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df3f72-6fee-49f9-b061-2dcde414eeda service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:02.732877 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df3f72-6fee-49f9-b061-2dcde414eeda service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:02.733151 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df3f72-6fee-49f9-b061-2dcde414eeda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:02.741310 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df3f72-6fee-49f9-b061-2dcde414eeda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:02.742792 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df3f72-6fee-49f9-b061-2dcde414eeda service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:02.752168 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1438/2846] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:59:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 03:59:12.653851 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=45,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:59:12.747618 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=43,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:59:12.840907 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c38a1b-7b98-4388-a571-8ff0148a8b31 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:12.902117 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c38a1b-7b98-4388-a571-8ff0148a8b31 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:12.906705 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18673d-e6bd-46e8-8c24-d60cd381178b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:12.907922 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18673d-e6bd-46e8-8c24-d60cd381178b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:12.908214 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18673d-e6bd-46e8-8c24-d60cd381178b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:12.908494 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18673d-e6bd-46e8-8c24-d60cd381178b admin admin] PATH_INFO: `/v3/users/1bba2270772d49dc91b5c889b56df144` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:12.909646 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18673d-e6bd-46e8-8c24-d60cd381178b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bba2270772d49dc91b5c889b56df144)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:12.911586 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18673d-e6bd-46e8-8c24-d60cd381178b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:13.059377 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4f18673d-e6bd-46e8-8c24-d60cd381178b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bba2270772d49dc91b5c889b56df144'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:13.060018 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4f18673d-e6bd-46e8-8c24-d60cd381178b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bba2270772d49dc91b5c889b56df144'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:13.067066 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4f18673d-e6bd-46e8-8c24-d60cd381178b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bba2270772d49dc91b5c889b56df144'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:13.078809 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4f18673d-e6bd-46e8-8c24-d60cd381178b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bba2270772d49dc91b5c889b56df144'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:13.079433 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4f18673d-e6bd-46e8-8c24-d60cd381178b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bba2270772d49dc91b5c889b56df144'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:13.153738 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1409/2847] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:59:12 2022] DELETE /identity/v3/users/1bba2270772d49dc91b5c889b56df144 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:59:13.158742 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988ec92-731c-482a-ae6c-53b7abc6f7a3 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:13.159028 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988ec92-731c-482a-ae6c-53b7abc6f7a3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:13.159304 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988ec92-731c-482a-ae6c-53b7abc6f7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:13.178778 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1988ec92-731c-482a-ae6c-53b7abc6f7a3 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:59:13.179981 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1988ec92-731c-482a-ae6c-53b7abc6f7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:59:13.237849 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1439/2848] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:59:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:59:13.247277 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18673d-e6bd-46e8-8c24-d60cd381178b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:13.248674 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4f18673d-e6bd-46e8-8c24-d60cd381178b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:59:13.305706 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18673d-e6bd-46e8-8c24-d60cd381178b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:13.309339 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24fdc3-eed3-4a0a-9688-06918a2bc233 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:13.309996 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24fdc3-eed3-4a0a-9688-06918a2bc233 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:13.310277 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24fdc3-eed3-4a0a-9688-06918a2bc233 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:13.310552 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24fdc3-eed3-4a0a-9688-06918a2bc233 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:13.319471 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24fdc3-eed3-4a0a-9688-06918a2bc233 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:13.320889 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24fdc3-eed3-4a0a-9688-06918a2bc233 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:13.330674 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1410/2849] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:59:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:59:13.737241 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988ec92-731c-482a-ae6c-53b7abc6f7a3 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:13.742203 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1988ec92-731c-482a-ae6c-53b7abc6f7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:59:13.750580 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988ec92-731c-482a-ae6c-53b7abc6f7a3 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:13.755281 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c296a5-9615-4753-b07b-ea9fbe992912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:13.756021 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c296a5-9615-4753-b07b-ea9fbe992912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:13.756304 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c296a5-9615-4753-b07b-ea9fbe992912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:13.756576 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c296a5-9615-4753-b07b-ea9fbe992912 admin admin] PATH_INFO: `/v3/projects/514b99eddb5a4cd69dc4842916fd18c8` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:13.757744 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c296a5-9615-4753-b07b-ea9fbe992912 admin admin] RBAC: Authorizing `identity:delete_project(project_id=514b99eddb5a4cd69dc4842916fd18c8)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:13.759663 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c296a5-9615-4753-b07b-ea9fbe992912 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:13.880148 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-04c296a5-9615-4753-b07b-ea9fbe992912 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '514b99eddb5a4cd69dc4842916fd18c8', 'request_id': 'req-04c296a5-9615-4753-b07b-ea9fbe992912'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:13.983039 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-04c296a5-9615-4753-b07b-ea9fbe992912 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '514b99eddb5a4cd69dc4842916fd18c8', 'request_id': 'req-04c296a5-9615-4753-b07b-ea9fbe992912'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:13.990438 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-04c296a5-9615-4753-b07b-ea9fbe992912 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '514b99eddb5a4cd69dc4842916fd18c8', 'request_id': 'req-04c296a5-9615-4753-b07b-ea9fbe992912'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:14.001544 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-04c296a5-9615-4753-b07b-ea9fbe992912 admin admin] The token cache is being invalidate because project 514b99eddb5a4cd69dc4842916fd18c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:59:14.001866 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-04c296a5-9615-4753-b07b-ea9fbe992912 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:14.002525 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-04c296a5-9615-4753-b07b-ea9fbe992912 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:14.004013 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1440/2850] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:59:13 2022] DELETE /identity/v3/projects/514b99eddb5a4cd69dc4842916fd18c8 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:59:14.009094 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a34a99-95cf-48b1-9c91-6dd1b55b44c3 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:14.009610 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a34a99-95cf-48b1-9c91-6dd1b55b44c3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:14.009750 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a34a99-95cf-48b1-9c91-6dd1b55b44c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:14.029597 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-24a34a99-95cf-48b1-9c91-6dd1b55b44c3 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:59:14.030891 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-24a34a99-95cf-48b1-9c91-6dd1b55b44c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:59:14.048640 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:59:14.090433 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1411/2851] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:59:14.099161 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e66ab-4207-49b3-b61b-678a4be9c34e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:14.099447 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e66ab-4207-49b3-b61b-678a4be9c34e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:14.099722 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e66ab-4207-49b3-b61b-678a4be9c34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:14.120157 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ef4e66ab-4207-49b3-b61b-678a4be9c34e None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:59:14.121346 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ef4e66ab-4207-49b3-b61b-678a4be9c34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:59:14.129804 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1441/2852] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:59:14.134145 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a34a99-95cf-48b1-9c91-6dd1b55b44c3 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:14.144898 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a34a99-95cf-48b1-9c91-6dd1b55b44c3 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:14.149345 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3589929-5db6-4c16-b75e-1c1df533145c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:14.149970 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3589929-5db6-4c16-b75e-1c1df533145c admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:14.150249 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3589929-5db6-4c16-b75e-1c1df533145c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:14.150517 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3589929-5db6-4c16-b75e-1c1df533145c admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:14.151154 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3589929-5db6-4c16-b75e-1c1df533145c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:59:14.151450 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3589929-5db6-4c16-b75e-1c1df533145c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:14.153029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3589929-5db6-4c16-b75e-1c1df533145c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:14.164798 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1412/2853] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:59:14.169230 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e66ab-4207-49b3-b61b-678a4be9c34e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:14.178528 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e66ab-4207-49b3-b61b-678a4be9c34e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:14.183233 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250eb851-933d-47ca-a63a-4fe49fb68b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:14.183822 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250eb851-933d-47ca-a63a-4fe49fb68b49 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:14.184098 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250eb851-933d-47ca-a63a-4fe49fb68b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:14.184370 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250eb851-933d-47ca-a63a-4fe49fb68b49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:14.184996 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250eb851-933d-47ca-a63a-4fe49fb68b49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:14.186913 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250eb851-933d-47ca-a63a-4fe49fb68b49 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:14.292977 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1442/2854] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:59:14 2022] POST /identity/v3/projects => generated 403 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:59:14.297275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3589929-5db6-4c16-b75e-1c1df533145c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:14.307589 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3589929-5db6-4c16-b75e-1c1df533145c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:14.364229 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d25dd2-051a-4b08-a4d8-604e5cf2bd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:14.364836 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d25dd2-051a-4b08-a4d8-604e5cf2bd05 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:14.365116 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d25dd2-051a-4b08-a4d8-604e5cf2bd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:14.365391 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d25dd2-051a-4b08-a4d8-604e5cf2bd05 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:14.366046 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d25dd2-051a-4b08-a4d8-604e5cf2bd05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:14.367967 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d25dd2-051a-4b08-a4d8-604e5cf2bd05 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:14.448880 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1413/2855] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:59:14 2022] POST /identity/v3/users => generated 302 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:59:14.465493 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250eb851-933d-47ca-a63a-4fe49fb68b49 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:14.475971 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250eb851-933d-47ca-a63a-4fe49fb68b49 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:14.480702 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61a4eb-896a-4f28-a3a5-ed620c58e94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:14.481294 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61a4eb-896a-4f28-a3a5-ed620c58e94c admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:14.481577 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61a4eb-896a-4f28-a3a5-ed620c58e94c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:14.481910 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61a4eb-896a-4f28-a3a5-ed620c58e94c admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:14.482546 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61a4eb-896a-4f28-a3a5-ed620c58e94c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:14.484131 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61a4eb-896a-4f28-a3a5-ed620c58e94c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:14.493853 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1443/2856] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:59:14.497654 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d25dd2-051a-4b08-a4d8-604e5cf2bd05 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:14.507899 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d25dd2-051a-4b08-a4d8-604e5cf2bd05 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:14.512644 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894802ce-062d-4b0e-8e22-73fb0f5b7094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:14.513232 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894802ce-062d-4b0e-8e22-73fb0f5b7094 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:14.513515 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894802ce-062d-4b0e-8e22-73fb0f5b7094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:14.513910 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894802ce-062d-4b0e-8e22-73fb0f5b7094 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:14.514549 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894802ce-062d-4b0e-8e22-73fb0f5b7094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:14.516121 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894802ce-062d-4b0e-8e22-73fb0f5b7094 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:14.527114 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1414/2857] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:59:14.531123 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61a4eb-896a-4f28-a3a5-ed620c58e94c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:14.545244 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61a4eb-896a-4f28-a3a5-ed620c58e94c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:14.549755 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5314a-4bb5-4217-b0c8-2c245f523d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:14.550390 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5314a-4bb5-4217-b0c8-2c245f523d25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:14.550688 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5314a-4bb5-4217-b0c8-2c245f523d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:14.550946 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5314a-4bb5-4217-b0c8-2c245f523d25 admin admin] PATH_INFO: `/v3/projects/45f8ce67dcf7482f88e1df06aa176198/users/26d5e276208b4165bdb7e985395bf1d5/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:14.565583 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5314a-4bb5-4217-b0c8-2c245f523d25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45f8ce67dcf7482f88e1df06aa176198, user_id=26d5e276208b4165bdb7e985395bf1d5, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:14.568322 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5314a-4bb5-4217-b0c8-2c245f523d25 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:14.680640 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1444/2858] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:59:14 2022] PUT /identity/v3/projects/45f8ce67dcf7482f88e1df06aa176198/users/26d5e276208b4165bdb7e985395bf1d5/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:59:14.685806 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c587a-282a-4dd0-9b86-1a5e4ac9e143 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:14.686096 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c587a-282a-4dd0-9b86-1a5e4ac9e143 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:14.686369 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c587a-282a-4dd0-9b86-1a5e4ac9e143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:14.706632 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-da6c587a-282a-4dd0-9b86-1a5e4ac9e143 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:59:14.712149 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-da6c587a-282a-4dd0-9b86-1a5e4ac9e143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:59:14.767507 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1415/2859] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:59:14.777190 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5314a-4bb5-4217-b0c8-2c245f523d25 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:14.778924 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f9f5314a-4bb5-4217-b0c8-2c245f523d25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:59:14.801265 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:59:14.835844 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5314a-4bb5-4217-b0c8-2c245f523d25 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:14.839474 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5f693-b987-400e-a587-787d1bf06903 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:14.840075 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5f693-b987-400e-a587-787d1bf06903 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:14.840353 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5f693-b987-400e-a587-787d1bf06903 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:14.840625 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5f693-b987-400e-a587-787d1bf06903 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:14.849495 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f5f693-b987-400e-a587-787d1bf06903 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:14.850937 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f5f693-b987-400e-a587-787d1bf06903 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:14.860274 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1445/2860] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:59:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:59:16.093131 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8b3a7-b0da-43dd-b425-e31d45c132ef None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:16.093699 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8b3a7-b0da-43dd-b425-e31d45c132ef None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:16.093699 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8b3a7-b0da-43dd-b425-e31d45c132ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:16.121885 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-34d8b3a7-b0da-43dd-b425-e31d45c132ef None None] MFA Rules not processed for user `26d5e276208b4165bdb7e985395bf1d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:59:16.123155 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-34d8b3a7-b0da-43dd-b425-e31d45c132ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:59:16.141148 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:59:16.191744 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1416/2861] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:59:16 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:59:16.196250 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5f693-b987-400e-a587-787d1bf06903 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:16.206523 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5f693-b987-400e-a587-787d1bf06903 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:16.211053 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11414097-842c-475f-bbd7-f8f048bc0c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:16.211639 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11414097-842c-475f-bbd7-f8f048bc0c93 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:16.211915 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11414097-842c-475f-bbd7-f8f048bc0c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:16.212184 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11414097-842c-475f-bbd7-f8f048bc0c93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:16.212815 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11414097-842c-475f-bbd7-f8f048bc0c93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:16.214726 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11414097-842c-475f-bbd7-f8f048bc0c93 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:16.295318 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1446/2862] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:59:16 2022] POST /identity/v3/projects => generated 403 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:59:16.299900 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d8b3a7-b0da-43dd-b425-e31d45c132ef None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:16.310509 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d8b3a7-b0da-43dd-b425-e31d45c132ef None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:16.368204 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99da74-7ce4-40e5-9b41-65c0becac3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:16.368809 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99da74-7ce4-40e5-9b41-65c0becac3a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:16.369091 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99da74-7ce4-40e5-9b41-65c0becac3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:16.369366 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99da74-7ce4-40e5-9b41-65c0becac3a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:16.370022 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99da74-7ce4-40e5-9b41-65c0becac3a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:16.371960 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99da74-7ce4-40e5-9b41-65c0becac3a6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:16.482722 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1417/2863] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:59:16 2022] POST /identity/v3/users => generated 308 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:59:16.487289 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11414097-842c-475f-bbd7-f8f048bc0c93 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:16.497461 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11414097-842c-475f-bbd7-f8f048bc0c93 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:16.502777 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6399f-7884-4bba-86e5-76536839bd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:16.503367 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6399f-7884-4bba-86e5-76536839bd87 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:16.503642 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6399f-7884-4bba-86e5-76536839bd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:16.503945 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6399f-7884-4bba-86e5-76536839bd87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:16.504678 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6399f-7884-4bba-86e5-76536839bd87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:16.506293 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6399f-7884-4bba-86e5-76536839bd87 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:16.516608 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1447/2864] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:59:16.520576 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99da74-7ce4-40e5-9b41-65c0becac3a6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:16.530466 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99da74-7ce4-40e5-9b41-65c0becac3a6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:16.535069 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd70c5c-3f50-4b5f-994c-03a0cc1bf5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:16.535707 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd70c5c-3f50-4b5f-994c-03a0cc1bf5f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:16.535984 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd70c5c-3f50-4b5f-994c-03a0cc1bf5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:16.536253 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd70c5c-3f50-4b5f-994c-03a0cc1bf5f8 admin admin] PATH_INFO: `/v3/projects/ad3a2188a7be4d60a01fd7c3669997c6/users/4e6f7af45d9d4afc82c0337def1651ba/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:16.551801 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd70c5c-3f50-4b5f-994c-03a0cc1bf5f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad3a2188a7be4d60a01fd7c3669997c6, user_id=4e6f7af45d9d4afc82c0337def1651ba, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:16.554513 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd70c5c-3f50-4b5f-994c-03a0cc1bf5f8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:16.620087 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1418/2865] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:59:16 2022] PUT /identity/v3/projects/ad3a2188a7be4d60a01fd7c3669997c6/users/4e6f7af45d9d4afc82c0337def1651ba/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:59:16.624078 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6399f-7884-4bba-86e5-76536839bd87 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:16.635459 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6399f-7884-4bba-86e5-76536839bd87 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:16.691220 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396199cd-a5fe-4aae-a161-35a07651e0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:16.691845 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396199cd-a5fe-4aae-a161-35a07651e0fe admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:16.692124 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396199cd-a5fe-4aae-a161-35a07651e0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:16.692393 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396199cd-a5fe-4aae-a161-35a07651e0fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:16.693024 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396199cd-a5fe-4aae-a161-35a07651e0fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:16.694735 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396199cd-a5fe-4aae-a161-35a07651e0fe admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:16.704954 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1448/2866] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:59:16.709170 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd70c5c-3f50-4b5f-994c-03a0cc1bf5f8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:16.719406 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd70c5c-3f50-4b5f-994c-03a0cc1bf5f8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:16.724478 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04279fdb-132f-4dc1-80da-ad98c12fe18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:16.725126 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04279fdb-132f-4dc1-80da-ad98c12fe18a admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:16.725404 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04279fdb-132f-4dc1-80da-ad98c12fe18a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:16.725701 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04279fdb-132f-4dc1-80da-ad98c12fe18a admin admin] PATH_INFO: `/v3/projects/ad3a2188a7be4d60a01fd7c3669997c6/users/4e6f7af45d9d4afc82c0337def1651ba/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:16.727649 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04279fdb-132f-4dc1-80da-ad98c12fe18a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad3a2188a7be4d60a01fd7c3669997c6, user_id=4e6f7af45d9d4afc82c0337def1651ba, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:16.730307 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04279fdb-132f-4dc1-80da-ad98c12fe18a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:16.741008 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1419/2867] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:59:16 2022] PUT /identity/v3/projects/ad3a2188a7be4d60a01fd7c3669997c6/users/4e6f7af45d9d4afc82c0337def1651ba/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:59:17.992667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f69b6-2ce5-477c-9298-e96201ec3866 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:17.993260 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f69b6-2ce5-477c-9298-e96201ec3866 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:17.993260 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f69b6-2ce5-477c-9298-e96201ec3866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:18.023774 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-854f69b6-2ce5-477c-9298-e96201ec3866 None None] MFA Rules not processed for user `4e6f7af45d9d4afc82c0337def1651ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:59:18.025019 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-854f69b6-2ce5-477c-9298-e96201ec3866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:59:18.099321 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1449/2868] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:59:17 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:59:19.391902 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04279fdb-132f-4dc1-80da-ad98c12fe18a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:19.456410 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04279fdb-132f-4dc1-80da-ad98c12fe18a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:19.460989 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff1caf-3eab-48e4-b127-de7c8af01455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:19.461614 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff1caf-3eab-48e4-b127-de7c8af01455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:19.461921 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff1caf-3eab-48e4-b127-de7c8af01455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:19.462196 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff1caf-3eab-48e4-b127-de7c8af01455 admin admin] PATH_INFO: `/v3/users/26d5e276208b4165bdb7e985395bf1d5` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:19.463307 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aff1caf-3eab-48e4-b127-de7c8af01455 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26d5e276208b4165bdb7e985395bf1d5)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:19.465211 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aff1caf-3eab-48e4-b127-de7c8af01455 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:19.477577 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:59:19.707805 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6aff1caf-3eab-48e4-b127-de7c8af01455 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26d5e276208b4165bdb7e985395bf1d5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:19.708460 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6aff1caf-3eab-48e4-b127-de7c8af01455 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26d5e276208b4165bdb7e985395bf1d5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:19.715463 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6aff1caf-3eab-48e4-b127-de7c8af01455 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26d5e276208b4165bdb7e985395bf1d5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:19.728231 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6aff1caf-3eab-48e4-b127-de7c8af01455 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26d5e276208b4165bdb7e985395bf1d5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:19.728874 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6aff1caf-3eab-48e4-b127-de7c8af01455 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26d5e276208b4165bdb7e985395bf1d5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:19.827828 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1420/2869] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:59:19 2022] DELETE /identity/v3/users/26d5e276208b4165bdb7e985395bf1d5 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:59:20.078646 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f69b6-2ce5-477c-9298-e96201ec3866 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:20.089612 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f69b6-2ce5-477c-9298-e96201ec3866 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:20.101019 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:59:20.148564 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3f8eb-1ffc-4a1c-ac7e-ddc7f12eaec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:20.149199 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3f8eb-1ffc-4a1c-ac7e-ddc7f12eaec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:20.149476 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3f8eb-1ffc-4a1c-ac7e-ddc7f12eaec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:20.149784 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3f8eb-1ffc-4a1c-ac7e-ddc7f12eaec8 admin admin] PATH_INFO: `/v3/projects/45f8ce67dcf7482f88e1df06aa176198` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:20.150983 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3f8eb-1ffc-4a1c-ac7e-ddc7f12eaec8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45f8ce67dcf7482f88e1df06aa176198)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:20.152890 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3f8eb-1ffc-4a1c-ac7e-ddc7f12eaec8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:20.264769 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f1c3f8eb-1ffc-4a1c-ac7e-ddc7f12eaec8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45f8ce67dcf7482f88e1df06aa176198', 'request_id': 'req-f1c3f8eb-1ffc-4a1c-ac7e-ddc7f12eaec8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:20.313923 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f1c3f8eb-1ffc-4a1c-ac7e-ddc7f12eaec8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45f8ce67dcf7482f88e1df06aa176198', 'request_id': 'req-f1c3f8eb-1ffc-4a1c-ac7e-ddc7f12eaec8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:20.320136 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f1c3f8eb-1ffc-4a1c-ac7e-ddc7f12eaec8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45f8ce67dcf7482f88e1df06aa176198', 'request_id': 'req-f1c3f8eb-1ffc-4a1c-ac7e-ddc7f12eaec8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:20.331100 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f1c3f8eb-1ffc-4a1c-ac7e-ddc7f12eaec8 admin admin] The token cache is being invalidate because project 45f8ce67dcf7482f88e1df06aa176198 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:59:20.331387 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f1c3f8eb-1ffc-4a1c-ac7e-ddc7f12eaec8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:20.332015 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f1c3f8eb-1ffc-4a1c-ac7e-ddc7f12eaec8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:20.333515 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1450/2870] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:59:20 2022] DELETE /identity/v3/projects/45f8ce67dcf7482f88e1df06aa176198 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:59:20.337750 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff1caf-3eab-48e4-b127-de7c8af01455 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:20.339226 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6aff1caf-3eab-48e4-b127-de7c8af01455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:59:20.352612 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff1caf-3eab-48e4-b127-de7c8af01455 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:20.408362 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe017b-51e1-47f3-93c3-3e531f0a2d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:20.409036 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe017b-51e1-47f3-93c3-3e531f0a2d53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:20.409313 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe017b-51e1-47f3-93c3-3e531f0a2d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:20.409581 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe017b-51e1-47f3-93c3-3e531f0a2d53 admin admin] PATH_INFO: `/v3/users/4e6f7af45d9d4afc82c0337def1651ba` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:20.410834 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe017b-51e1-47f3-93c3-3e531f0a2d53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e6f7af45d9d4afc82c0337def1651ba)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:20.412775 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe017b-51e1-47f3-93c3-3e531f0a2d53 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:20.648575 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bebe017b-51e1-47f3-93c3-3e531f0a2d53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e6f7af45d9d4afc82c0337def1651ba'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:20.649147 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bebe017b-51e1-47f3-93c3-3e531f0a2d53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e6f7af45d9d4afc82c0337def1651ba'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:20.656213 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bebe017b-51e1-47f3-93c3-3e531f0a2d53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e6f7af45d9d4afc82c0337def1651ba'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:20.668371 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bebe017b-51e1-47f3-93c3-3e531f0a2d53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e6f7af45d9d4afc82c0337def1651ba'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:20.669275 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bebe017b-51e1-47f3-93c3-3e531f0a2d53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e6f7af45d9d4afc82c0337def1651ba'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:20.734318 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1421/2871] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:59:20 2022] DELETE /identity/v3/users/4e6f7af45d9d4afc82c0337def1651ba => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:59:20.995946 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3f8eb-1ffc-4a1c-ac7e-ddc7f12eaec8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:20.995946 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f1c3f8eb-1ffc-4a1c-ac7e-ddc7f12eaec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:59:21.009258 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3f8eb-1ffc-4a1c-ac7e-ddc7f12eaec8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:21.066476 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07756b-9cb3-4052-8d10-bf97b85d079f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:21.067097 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07756b-9cb3-4052-8d10-bf97b85d079f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:21.067376 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07756b-9cb3-4052-8d10-bf97b85d079f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:21.067647 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07756b-9cb3-4052-8d10-bf97b85d079f admin admin] PATH_INFO: `/v3/projects/ad3a2188a7be4d60a01fd7c3669997c6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:21.068747 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07756b-9cb3-4052-8d10-bf97b85d079f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad3a2188a7be4d60a01fd7c3669997c6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:21.070756 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07756b-9cb3-4052-8d10-bf97b85d079f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:21.202495 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:59:21.206066 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4f07756b-9cb3-4052-8d10-bf97b85d079f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad3a2188a7be4d60a01fd7c3669997c6', 'request_id': 'req-4f07756b-9cb3-4052-8d10-bf97b85d079f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:21.268563 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4f07756b-9cb3-4052-8d10-bf97b85d079f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad3a2188a7be4d60a01fd7c3669997c6', 'request_id': 'req-4f07756b-9cb3-4052-8d10-bf97b85d079f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:21.275079 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4f07756b-9cb3-4052-8d10-bf97b85d079f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad3a2188a7be4d60a01fd7c3669997c6', 'request_id': 'req-4f07756b-9cb3-4052-8d10-bf97b85d079f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:21.286499 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4f07756b-9cb3-4052-8d10-bf97b85d079f admin admin] The token cache is being invalidate because project ad3a2188a7be4d60a01fd7c3669997c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:59:21.286790 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4f07756b-9cb3-4052-8d10-bf97b85d079f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:21.287533 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4f07756b-9cb3-4052-8d10-bf97b85d079f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:21.289035 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1451/2872] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:59:20 2022] DELETE /identity/v3/projects/ad3a2188a7be4d60a01fd7c3669997c6 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:59:21.294396 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c65b6-90e2-43c5-8622-ca25b993b952 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:21.294688 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c65b6-90e2-43c5-8622-ca25b993b952 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:21.294967 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c65b6-90e2-43c5-8622-ca25b993b952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:21.315441 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-6a0c65b6-90e2-43c5-8622-ca25b993b952 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:59:21.316649 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6a0c65b6-90e2-43c5-8622-ca25b993b952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:59:21.320851 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:59:21.375260 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1422/2873] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:59:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:59:21.383349 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10ac3a-5e14-499e-bc5d-d35d449b025b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:21.383640 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10ac3a-5e14-499e-bc5d-d35d449b025b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:21.383917 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10ac3a-5e14-499e-bc5d-d35d449b025b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:21.403484 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ad10ac3a-5e14-499e-bc5d-d35d449b025b None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:59:21.404764 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ad10ac3a-5e14-499e-bc5d-d35d449b025b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:59:21.413118 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1452/2874] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:59:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:59:21.417454 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c65b6-90e2-43c5-8622-ca25b993b952 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:21.427894 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c65b6-90e2-43c5-8622-ca25b993b952 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:21.432549 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbf1ac-45e3-4482-93ca-610e6e12d40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:21.433148 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbf1ac-45e3-4482-93ca-610e6e12d40f admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:21.433448 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbf1ac-45e3-4482-93ca-610e6e12d40f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:21.433742 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbf1ac-45e3-4482-93ca-610e6e12d40f admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:21.434390 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbf1ac-45e3-4482-93ca-610e6e12d40f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:59:21.434724 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbf1ac-45e3-4482-93ca-610e6e12d40f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:21.436347 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbf1ac-45e3-4482-93ca-610e6e12d40f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:21.447754 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1423/2875] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:59:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:59:21.452107 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10ac3a-5e14-499e-bc5d-d35d449b025b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:21.461623 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10ac3a-5e14-499e-bc5d-d35d449b025b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:21.466432 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ccae84-5e58-46dc-b5ff-0fc5190d42e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:21.467057 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccae84-5e58-46dc-b5ff-0fc5190d42e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:21.467358 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccae84-5e58-46dc-b5ff-0fc5190d42e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:21.467632 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccae84-5e58-46dc-b5ff-0fc5190d42e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:21.468262 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ccae84-5e58-46dc-b5ff-0fc5190d42e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:21.470289 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ccae84-5e58-46dc-b5ff-0fc5190d42e4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:21.544091 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1453/2876] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:59:21 2022] POST /identity/v3/projects => generated 375 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:59:21.548269 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbf1ac-45e3-4482-93ca-610e6e12d40f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:21.558588 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbf1ac-45e3-4482-93ca-610e6e12d40f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:21.615125 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38d281-1df3-4875-9441-55062974403d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:21.615731 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38d281-1df3-4875-9441-55062974403d admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:21.616016 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38d281-1df3-4875-9441-55062974403d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:21.616289 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38d281-1df3-4875-9441-55062974403d admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:21.616928 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38d281-1df3-4875-9441-55062974403d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:21.618866 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38d281-1df3-4875-9441-55062974403d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:21.691270 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1424/2877] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:59:21 2022] POST /identity/v3/users => generated 288 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:59:21.695481 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ccae84-5e58-46dc-b5ff-0fc5190d42e4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:21.706567 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ccae84-5e58-46dc-b5ff-0fc5190d42e4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:21.711262 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4999e24-47a9-4046-b30f-c6752aa44981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:21.711912 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4999e24-47a9-4046-b30f-c6752aa44981 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:21.712173 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4999e24-47a9-4046-b30f-c6752aa44981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:21.712500 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4999e24-47a9-4046-b30f-c6752aa44981 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:21.713244 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4999e24-47a9-4046-b30f-c6752aa44981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:21.714885 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4999e24-47a9-4046-b30f-c6752aa44981 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:21.725580 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1454/2878] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:59:21.729448 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38d281-1df3-4875-9441-55062974403d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:21.739716 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38d281-1df3-4875-9441-55062974403d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:21.744338 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ccf4a-553b-42a8-9f04-b2419014206c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:21.744926 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ccf4a-553b-42a8-9f04-b2419014206c admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:21.745203 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ccf4a-553b-42a8-9f04-b2419014206c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:21.745474 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ccf4a-553b-42a8-9f04-b2419014206c admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:21.746145 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7ccf4a-553b-42a8-9f04-b2419014206c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:21.747713 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7ccf4a-553b-42a8-9f04-b2419014206c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:21.758280 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1425/2879] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:59:21.762252 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4999e24-47a9-4046-b30f-c6752aa44981 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:21.772627 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4999e24-47a9-4046-b30f-c6752aa44981 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:21.777251 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278bfcb4-4fd7-4a53-848e-f64b60295550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:21.777998 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278bfcb4-4fd7-4a53-848e-f64b60295550 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:21.778284 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278bfcb4-4fd7-4a53-848e-f64b60295550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:21.778581 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278bfcb4-4fd7-4a53-848e-f64b60295550 admin admin] PATH_INFO: `/v3/projects/d02e5071a61e497fa6817d1be294cf02/users/1939353bab9b4e6b982ffc962cb2dc60/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:21.793401 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278bfcb4-4fd7-4a53-848e-f64b60295550 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d02e5071a61e497fa6817d1be294cf02, user_id=1939353bab9b4e6b982ffc962cb2dc60, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:21.796384 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278bfcb4-4fd7-4a53-848e-f64b60295550 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:21.898206 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1455/2880] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:59:21 2022] PUT /identity/v3/projects/d02e5071a61e497fa6817d1be294cf02/users/1939353bab9b4e6b982ffc962cb2dc60/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:59:21.908655 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf425d0-4881-49e8-a00c-b7b5c8267d94 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:21.910793 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf425d0-4881-49e8-a00c-b7b5c8267d94 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:21.910793 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf425d0-4881-49e8-a00c-b7b5c8267d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:21.938475 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-adf425d0-4881-49e8-a00c-b7b5c8267d94 None None] MFA Rules not processed for user `1939353bab9b4e6b982ffc962cb2dc60`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:59:21.942465 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-adf425d0-4881-49e8-a00c-b7b5c8267d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:59:22.005475 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1426/2881] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:59:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:59:22.010103 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278bfcb4-4fd7-4a53-848e-f64b60295550 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:22.072080 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278bfcb4-4fd7-4a53-848e-f64b60295550 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:22.076797 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f83d26-0825-481c-945e-a13082364362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:22.077400 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f83d26-0825-481c-945e-a13082364362 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:22.077720 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f83d26-0825-481c-945e-a13082364362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:22.078002 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f83d26-0825-481c-945e-a13082364362 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:22.078631 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f83d26-0825-481c-945e-a13082364362 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:22.081160 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f83d26-0825-481c-945e-a13082364362 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:22.247394 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1456/2882] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:59:22 2022] POST /identity/v3/projects => generated 375 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:59:22.251555 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf425d0-4881-49e8-a00c-b7b5c8267d94 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:22.258749 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:59:22.263152 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf425d0-4881-49e8-a00c-b7b5c8267d94 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:22.319865 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa0080-c394-4d90-9cc3-87c0d86c74a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:22.320475 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa0080-c394-4d90-9cc3-87c0d86c74a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:22.320861 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa0080-c394-4d90-9cc3-87c0d86c74a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:22.321130 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa0080-c394-4d90-9cc3-87c0d86c74a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:22.321817 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa0080-c394-4d90-9cc3-87c0d86c74a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:22.323724 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa0080-c394-4d90-9cc3-87c0d86c74a2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:22.421947 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1427/2883] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:59:22 2022] POST /identity/v3/users => generated 294 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:59:22.426668 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f83d26-0825-481c-945e-a13082364362 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:22.436945 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f83d26-0825-481c-945e-a13082364362 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:22.442456 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873c2ef-d50a-4119-9a03-ec63a3df211a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:22.443074 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873c2ef-d50a-4119-9a03-ec63a3df211a admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:22.443353 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873c2ef-d50a-4119-9a03-ec63a3df211a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:22.443645 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873c2ef-d50a-4119-9a03-ec63a3df211a admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:22.444278 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e873c2ef-d50a-4119-9a03-ec63a3df211a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:22.446015 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e873c2ef-d50a-4119-9a03-ec63a3df211a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:22.456294 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1457/2884] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:59:22.460329 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa0080-c394-4d90-9cc3-87c0d86c74a2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:22.470447 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa0080-c394-4d90-9cc3-87c0d86c74a2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:22.475128 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822a7cf-80e3-475c-b16e-c052ca74430a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:22.480620 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822a7cf-80e3-475c-b16e-c052ca74430a admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:22.480620 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822a7cf-80e3-475c-b16e-c052ca74430a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:22.480620 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822a7cf-80e3-475c-b16e-c052ca74430a admin admin] PATH_INFO: `/v3/projects/03f5cec601a040b6bd5c57e58650104d/users/96ad74ec2c93468b92c9050405fbc30a/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:22.491420 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b822a7cf-80e3-475c-b16e-c052ca74430a admin admin] RBAC: Authorizing `identity:create_grant(project_id=03f5cec601a040b6bd5c57e58650104d, user_id=96ad74ec2c93468b92c9050405fbc30a, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:22.494194 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b822a7cf-80e3-475c-b16e-c052ca74430a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:22.585498 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1428/2885] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:59:22 2022] PUT /identity/v3/projects/03f5cec601a040b6bd5c57e58650104d/users/96ad74ec2c93468b92c9050405fbc30a/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:59:22.589940 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873c2ef-d50a-4119-9a03-ec63a3df211a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:22.600839 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873c2ef-d50a-4119-9a03-ec63a3df211a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:22.640145 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:59:22.655816 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbdc05c-23d5-4b1d-a8ff-98efa39647c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:22.656451 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdc05c-23d5-4b1d-a8ff-98efa39647c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:22.656737 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdc05c-23d5-4b1d-a8ff-98efa39647c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:22.657022 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdc05c-23d5-4b1d-a8ff-98efa39647c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:22.657657 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbdc05c-23d5-4b1d-a8ff-98efa39647c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:22.659793 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbdc05c-23d5-4b1d-a8ff-98efa39647c3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:22.669540 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1458/2886] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:59:22.673626 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822a7cf-80e3-475c-b16e-c052ca74430a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:22.684418 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822a7cf-80e3-475c-b16e-c052ca74430a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:22.689059 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233cb85-c0b6-4740-a983-189b0f6ecf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:22.689758 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233cb85-c0b6-4740-a983-189b0f6ecf1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:22.690045 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233cb85-c0b6-4740-a983-189b0f6ecf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:22.690321 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233cb85-c0b6-4740-a983-189b0f6ecf1a admin admin] PATH_INFO: `/v3/projects/03f5cec601a040b6bd5c57e58650104d/users/96ad74ec2c93468b92c9050405fbc30a/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:22.692294 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0233cb85-c0b6-4740-a983-189b0f6ecf1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=03f5cec601a040b6bd5c57e58650104d, user_id=96ad74ec2c93468b92c9050405fbc30a, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:22.695001 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0233cb85-c0b6-4740-a983-189b0f6ecf1a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:22.705788 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1429/2887] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:59:22 2022] PUT /identity/v3/projects/03f5cec601a040b6bd5c57e58650104d/users/96ad74ec2c93468b92c9050405fbc30a/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:59:22.717329 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330db78b-c92d-454e-8b64-fe86316fe915 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:22.721356 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330db78b-c92d-454e-8b64-fe86316fe915 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:22.721356 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330db78b-c92d-454e-8b64-fe86316fe915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:22.747029 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-330db78b-c92d-454e-8b64-fe86316fe915 None None] MFA Rules not processed for user `96ad74ec2c93468b92c9050405fbc30a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:59:22.748234 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-330db78b-c92d-454e-8b64-fe86316fe915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:59:22.815979 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1459/2888] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:59:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:59:22.826571 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233cb85-c0b6-4740-a983-189b0f6ecf1a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:22.828258 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0233cb85-c0b6-4740-a983-189b0f6ecf1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:59:22.885030 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233cb85-c0b6-4740-a983-189b0f6ecf1a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:22.888587 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773cc17-cddc-4ed2-aacc-da12a129ef7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:22.889184 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773cc17-cddc-4ed2-aacc-da12a129ef7a service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:22.889459 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773cc17-cddc-4ed2-aacc-da12a129ef7a service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:22.889759 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773cc17-cddc-4ed2-aacc-da12a129ef7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:22.944557 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2773cc17-cddc-4ed2-aacc-da12a129ef7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:22.946005 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2773cc17-cddc-4ed2-aacc-da12a129ef7a service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:22.954712 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1430/2889] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:59:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:59:25.993360 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330db78b-c92d-454e-8b64-fe86316fe915 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:26.055838 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330db78b-c92d-454e-8b64-fe86316fe915 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:26.060267 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66beb80d-4699-4c27-9c0b-ee3c45e3ff48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:26.060895 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66beb80d-4699-4c27-9c0b-ee3c45e3ff48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:26.061170 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66beb80d-4699-4c27-9c0b-ee3c45e3ff48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:26.061440 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66beb80d-4699-4c27-9c0b-ee3c45e3ff48 admin admin] PATH_INFO: `/v3/users/1939353bab9b4e6b982ffc962cb2dc60` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:26.062677 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66beb80d-4699-4c27-9c0b-ee3c45e3ff48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1939353bab9b4e6b982ffc962cb2dc60)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:26.064611 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66beb80d-4699-4c27-9c0b-ee3c45e3ff48 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:26.253026 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-66beb80d-4699-4c27-9c0b-ee3c45e3ff48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1939353bab9b4e6b982ffc962cb2dc60'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:26.253597 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-66beb80d-4699-4c27-9c0b-ee3c45e3ff48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1939353bab9b4e6b982ffc962cb2dc60'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:26.260383 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-66beb80d-4699-4c27-9c0b-ee3c45e3ff48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1939353bab9b4e6b982ffc962cb2dc60'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:26.267187 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:59:26.272826 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-66beb80d-4699-4c27-9c0b-ee3c45e3ff48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1939353bab9b4e6b982ffc962cb2dc60'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:26.273514 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-66beb80d-4699-4c27-9c0b-ee3c45e3ff48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1939353bab9b4e6b982ffc962cb2dc60'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:26.353461 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1460/2890] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:59:25 2022] DELETE /identity/v3/users/1939353bab9b4e6b982ffc962cb2dc60 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:59:26.358005 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940da19b-50ad-4ae1-90c8-d580bb20db7c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:26.358467 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940da19b-50ad-4ae1-90c8-d580bb20db7c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:26.358589 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940da19b-50ad-4ae1-90c8-d580bb20db7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:26.377816 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-940da19b-50ad-4ae1-90c8-d580bb20db7c None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:59:26.381848 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-940da19b-50ad-4ae1-90c8-d580bb20db7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:59:26.383951 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:59:26.436412 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1431/2891] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:59:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:59:26.448161 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66beb80d-4699-4c27-9c0b-ee3c45e3ff48 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:26.449553 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-66beb80d-4699-4c27-9c0b-ee3c45e3ff48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:59:26.505657 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66beb80d-4699-4c27-9c0b-ee3c45e3ff48 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:26.509075 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856e0b2-ccf9-4c7a-8284-388c02646ae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:26.509723 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856e0b2-ccf9-4c7a-8284-388c02646ae1 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:26.510005 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856e0b2-ccf9-4c7a-8284-388c02646ae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:26.510275 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856e0b2-ccf9-4c7a-8284-388c02646ae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:26.519464 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1856e0b2-ccf9-4c7a-8284-388c02646ae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:26.520884 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1856e0b2-ccf9-4c7a-8284-388c02646ae1 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:26.530007 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1461/2892] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:59:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:59:26.909649 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940da19b-50ad-4ae1-90c8-d580bb20db7c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:26.915064 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-940da19b-50ad-4ae1-90c8-d580bb20db7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:59:26.923151 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940da19b-50ad-4ae1-90c8-d580bb20db7c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:26.928672 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d229a-7107-4bcd-923b-ca2534cc2bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:26.929423 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d229a-7107-4bcd-923b-ca2534cc2bac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:26.929822 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d229a-7107-4bcd-923b-ca2534cc2bac admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:26.930166 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d229a-7107-4bcd-923b-ca2534cc2bac admin admin] PATH_INFO: `/v3/projects/d02e5071a61e497fa6817d1be294cf02` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:26.931435 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d229a-7107-4bcd-923b-ca2534cc2bac admin admin] RBAC: Authorizing `identity:delete_project(project_id=d02e5071a61e497fa6817d1be294cf02)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:26.933698 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d229a-7107-4bcd-923b-ca2534cc2bac admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:27.042939 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5d1d229a-7107-4bcd-923b-ca2534cc2bac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd02e5071a61e497fa6817d1be294cf02', 'request_id': 'req-5d1d229a-7107-4bcd-923b-ca2534cc2bac'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:27.136769 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5d1d229a-7107-4bcd-923b-ca2534cc2bac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd02e5071a61e497fa6817d1be294cf02', 'request_id': 'req-5d1d229a-7107-4bcd-923b-ca2534cc2bac'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:27.144323 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5d1d229a-7107-4bcd-923b-ca2534cc2bac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd02e5071a61e497fa6817d1be294cf02', 'request_id': 'req-5d1d229a-7107-4bcd-923b-ca2534cc2bac'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:27.154739 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5d1d229a-7107-4bcd-923b-ca2534cc2bac admin admin] The token cache is being invalidate because project d02e5071a61e497fa6817d1be294cf02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:59:27.155030 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5d1d229a-7107-4bcd-923b-ca2534cc2bac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:27.155677 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5d1d229a-7107-4bcd-923b-ca2534cc2bac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:27.157135 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1432/2893] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:59:26 2022] DELETE /identity/v3/projects/d02e5071a61e497fa6817d1be294cf02 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:59:27.161740 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856e0b2-ccf9-4c7a-8284-388c02646ae1 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:27.171627 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856e0b2-ccf9-4c7a-8284-388c02646ae1 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:27.226205 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0011607-716a-4e87-9a26-f6194a79814c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:27.226820 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0011607-716a-4e87-9a26-f6194a79814c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:27.227096 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0011607-716a-4e87-9a26-f6194a79814c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:27.227363 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0011607-716a-4e87-9a26-f6194a79814c admin admin] PATH_INFO: `/v3/users/96ad74ec2c93468b92c9050405fbc30a` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:27.228470 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0011607-716a-4e87-9a26-f6194a79814c admin admin] RBAC: Authorizing `identity:delete_user(user_id=96ad74ec2c93468b92c9050405fbc30a)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:27.230404 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0011607-716a-4e87-9a26-f6194a79814c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:27.373387 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c0011607-716a-4e87-9a26-f6194a79814c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96ad74ec2c93468b92c9050405fbc30a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:27.373948 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c0011607-716a-4e87-9a26-f6194a79814c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96ad74ec2c93468b92c9050405fbc30a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:27.380725 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c0011607-716a-4e87-9a26-f6194a79814c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96ad74ec2c93468b92c9050405fbc30a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:27.392135 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c0011607-716a-4e87-9a26-f6194a79814c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96ad74ec2c93468b92c9050405fbc30a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:27.392748 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c0011607-716a-4e87-9a26-f6194a79814c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96ad74ec2c93468b92c9050405fbc30a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:27.488281 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1462/2894] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:59:27 2022] DELETE /identity/v3/users/96ad74ec2c93468b92c9050405fbc30a => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:59:27.924394 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d229a-7107-4bcd-923b-ca2534cc2bac admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:27.925923 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5d1d229a-7107-4bcd-923b-ca2534cc2bac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:59:27.939867 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d229a-7107-4bcd-923b-ca2534cc2bac admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:27.996424 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ad1c0-1746-4c77-8ba6-f6b0259ab688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:27.997058 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ad1c0-1746-4c77-8ba6-f6b0259ab688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:27.997340 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ad1c0-1746-4c77-8ba6-f6b0259ab688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:27.997684 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ad1c0-1746-4c77-8ba6-f6b0259ab688 admin admin] PATH_INFO: `/v3/projects/03f5cec601a040b6bd5c57e58650104d` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:27.998835 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ad1c0-1746-4c77-8ba6-f6b0259ab688 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03f5cec601a040b6bd5c57e58650104d)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:28.000735 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ad1c0-1746-4c77-8ba6-f6b0259ab688 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:28.103365 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:59:28.111729 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f03ad1c0-1746-4c77-8ba6-f6b0259ab688 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03f5cec601a040b6bd5c57e58650104d', 'request_id': 'req-f03ad1c0-1746-4c77-8ba6-f6b0259ab688'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:28.199608 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f03ad1c0-1746-4c77-8ba6-f6b0259ab688 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03f5cec601a040b6bd5c57e58650104d', 'request_id': 'req-f03ad1c0-1746-4c77-8ba6-f6b0259ab688'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:28.206843 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f03ad1c0-1746-4c77-8ba6-f6b0259ab688 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03f5cec601a040b6bd5c57e58650104d', 'request_id': 'req-f03ad1c0-1746-4c77-8ba6-f6b0259ab688'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:28.217044 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f03ad1c0-1746-4c77-8ba6-f6b0259ab688 admin admin] The token cache is being invalidate because project 03f5cec601a040b6bd5c57e58650104d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:59:28.217336 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f03ad1c0-1746-4c77-8ba6-f6b0259ab688 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:28.217988 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f03ad1c0-1746-4c77-8ba6-f6b0259ab688 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:28.219476 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1433/2895] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:59:27 2022] DELETE /identity/v3/projects/03f5cec601a040b6bd5c57e58650104d => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:59:28.224397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074a2ce-e4cc-4acc-af45-a5ef84683103 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:28.224883 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074a2ce-e4cc-4acc-af45-a5ef84683103 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:28.224978 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074a2ce-e4cc-4acc-af45-a5ef84683103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:28.233468 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:59:28.244755 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7074a2ce-e4cc-4acc-af45-a5ef84683103 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:59:28.246056 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7074a2ce-e4cc-4acc-af45-a5ef84683103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:59:28.304660 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1463/2896] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:59:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:59:28.312332 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c5f0b-5a53-4adf-a738-a19e6973e6e8 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:28.312646 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c5f0b-5a53-4adf-a738-a19e6973e6e8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:28.312924 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c5f0b-5a53-4adf-a738-a19e6973e6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:28.333597 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-796c5f0b-5a53-4adf-a738-a19e6973e6e8 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:59:28.334831 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-796c5f0b-5a53-4adf-a738-a19e6973e6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:59:28.342817 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1434/2897] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:59:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:59:28.346970 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7074a2ce-e4cc-4acc-af45-a5ef84683103 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:28.356395 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7074a2ce-e4cc-4acc-af45-a5ef84683103 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:28.361917 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237c31d-7344-41be-be2f-6b4bf239130a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:28.362514 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237c31d-7344-41be-be2f-6b4bf239130a admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:28.362791 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237c31d-7344-41be-be2f-6b4bf239130a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:28.366077 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237c31d-7344-41be-be2f-6b4bf239130a admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:28.366077 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237c31d-7344-41be-be2f-6b4bf239130a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:59:28.366077 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237c31d-7344-41be-be2f-6b4bf239130a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:28.366077 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237c31d-7344-41be-be2f-6b4bf239130a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:28.377484 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1464/2898] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:59:28.381429 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c5f0b-5a53-4adf-a738-a19e6973e6e8 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:28.390643 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c5f0b-5a53-4adf-a738-a19e6973e6e8 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:28.395181 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066991b-9a08-48f6-9b8c-2b586dfb63e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:28.395780 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066991b-9a08-48f6-9b8c-2b586dfb63e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:28.396057 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066991b-9a08-48f6-9b8c-2b586dfb63e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:28.396328 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066991b-9a08-48f6-9b8c-2b586dfb63e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:28.396961 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066991b-9a08-48f6-9b8c-2b586dfb63e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:28.398933 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066991b-9a08-48f6-9b8c-2b586dfb63e9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:28.507256 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1435/2899] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:59:28 2022] POST /identity/v3/projects => generated 375 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 03:59:28.511343 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237c31d-7344-41be-be2f-6b4bf239130a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:28.521584 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237c31d-7344-41be-be2f-6b4bf239130a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:28.577191 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe21e9-68b8-448f-a694-603dfcc5d7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:28.577813 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe21e9-68b8-448f-a694-603dfcc5d7d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:28.578090 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe21e9-68b8-448f-a694-603dfcc5d7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:28.578363 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe21e9-68b8-448f-a694-603dfcc5d7d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:28.578985 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfe21e9-68b8-448f-a694-603dfcc5d7d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:28.580950 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfe21e9-68b8-448f-a694-603dfcc5d7d1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:28.650977 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1465/2900] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:59:28 2022] POST /identity/v3/users => generated 288 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:59:28.655183 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066991b-9a08-48f6-9b8c-2b586dfb63e9 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:28.665836 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066991b-9a08-48f6-9b8c-2b586dfb63e9 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:28.670579 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf05860-b91c-4955-8919-e03a93688a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:28.671167 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf05860-b91c-4955-8919-e03a93688a9d admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:28.671446 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf05860-b91c-4955-8919-e03a93688a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:28.671717 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf05860-b91c-4955-8919-e03a93688a9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:28.672352 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf05860-b91c-4955-8919-e03a93688a9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:28.674554 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf05860-b91c-4955-8919-e03a93688a9d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:28.684425 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1436/2901] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:59:28.688258 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe21e9-68b8-448f-a694-603dfcc5d7d1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:28.698392 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe21e9-68b8-448f-a694-603dfcc5d7d1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:28.703111 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea9d9c-6386-42f4-97b9-d9c498308e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:28.703706 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea9d9c-6386-42f4-97b9-d9c498308e0c admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:28.703985 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea9d9c-6386-42f4-97b9-d9c498308e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:28.704257 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea9d9c-6386-42f4-97b9-d9c498308e0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:28.704891 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea9d9c-6386-42f4-97b9-d9c498308e0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:28.706551 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea9d9c-6386-42f4-97b9-d9c498308e0c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:28.717115 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1466/2902] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:59:28.721761 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf05860-b91c-4955-8919-e03a93688a9d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:28.731988 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf05860-b91c-4955-8919-e03a93688a9d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:28.737442 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd2d9f-c34e-4dee-a8fc-91ee7fee4e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:28.738135 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd2d9f-c34e-4dee-a8fc-91ee7fee4e90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:28.738411 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd2d9f-c34e-4dee-a8fc-91ee7fee4e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:28.738683 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd2d9f-c34e-4dee-a8fc-91ee7fee4e90 admin admin] PATH_INFO: `/v3/projects/1e65b8a54d7d42788de37537f92c1999/users/b01efd5eba1d42a0a4c9997bc9fc19b1/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:28.753022 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd2d9f-c34e-4dee-a8fc-91ee7fee4e90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e65b8a54d7d42788de37537f92c1999, user_id=b01efd5eba1d42a0a4c9997bc9fc19b1, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:28.755673 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd2d9f-c34e-4dee-a8fc-91ee7fee4e90 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:28.825193 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1437/2903] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:59:28 2022] PUT /identity/v3/projects/1e65b8a54d7d42788de37537f92c1999/users/b01efd5eba1d42a0a4c9997bc9fc19b1/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:59:28.835381 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97160266-b67c-474a-a155-33c2576b4470 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:28.835707 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97160266-b67c-474a-a155-33c2576b4470 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:28.835982 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97160266-b67c-474a-a155-33c2576b4470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:28.864277 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-97160266-b67c-474a-a155-33c2576b4470 None None] MFA Rules not processed for user `b01efd5eba1d42a0a4c9997bc9fc19b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:59:28.865512 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-97160266-b67c-474a-a155-33c2576b4470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:59:28.925334 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:59:28.929257 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1467/2904] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:59:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:59:28.942306 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd2d9f-c34e-4dee-a8fc-91ee7fee4e90 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:28.943978 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-befd2d9f-c34e-4dee-a8fc-91ee7fee4e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:59:29.001058 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd2d9f-c34e-4dee-a8fc-91ee7fee4e90 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:29.004803 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e1c59-5dd9-48e4-b96f-461ad2b57c90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd193a353763e43d0b5e8b49702f09faa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:29.005406 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e1c59-5dd9-48e4-b96f-461ad2b57c90 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:29.005723 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e1c59-5dd9-48e4-b96f-461ad2b57c90 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:29.005999 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e1c59-5dd9-48e4-b96f-461ad2b57c90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:29.014412 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e1c59-5dd9-48e4-b96f-461ad2b57c90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:29.015823 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e1c59-5dd9-48e4-b96f-461ad2b57c90 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:29.025164 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1438/2905] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:59:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:59:39.021230 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=64,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:59:43.879972 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97160266-b67c-474a-a155-33c2576b4470 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:43.941279 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97160266-b67c-474a-a155-33c2576b4470 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:43.945800 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275768d2-f22b-462f-bf08-148a6e4e5be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:43.946417 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275768d2-f22b-462f-bf08-148a6e4e5be9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:43.946696 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275768d2-f22b-462f-bf08-148a6e4e5be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:43.946969 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275768d2-f22b-462f-bf08-148a6e4e5be9 admin admin] PATH_INFO: `/v3/users/b01efd5eba1d42a0a4c9997bc9fc19b1` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:43.948063 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275768d2-f22b-462f-bf08-148a6e4e5be9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b01efd5eba1d42a0a4c9997bc9fc19b1)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:43.950057 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275768d2-f22b-462f-bf08-148a6e4e5be9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:44.132909 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-275768d2-f22b-462f-bf08-148a6e4e5be9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b01efd5eba1d42a0a4c9997bc9fc19b1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:44.133562 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-275768d2-f22b-462f-bf08-148a6e4e5be9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b01efd5eba1d42a0a4c9997bc9fc19b1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:44.140554 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-275768d2-f22b-462f-bf08-148a6e4e5be9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b01efd5eba1d42a0a4c9997bc9fc19b1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:44.153200 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-275768d2-f22b-462f-bf08-148a6e4e5be9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b01efd5eba1d42a0a4c9997bc9fc19b1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:44.153914 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-275768d2-f22b-462f-bf08-148a6e4e5be9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b01efd5eba1d42a0a4c9997bc9fc19b1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:44.259486 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1468/2906] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 03:59:43 2022] DELETE /identity/v3/users/b01efd5eba1d42a0a4c9997bc9fc19b1 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:59:44.264012 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2357f-557b-401f-85dd-b10d30e4d1ac None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:44.270943 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2357f-557b-401f-85dd-b10d30e4d1ac None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:44.270943 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2357f-557b-401f-85dd-b10d30e4d1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:44.284532 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-08b2357f-557b-401f-85dd-b10d30e4d1ac None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:59:44.285764 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-08b2357f-557b-401f-85dd-b10d30e4d1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:59:44.344498 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1439/2907] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:59:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:59:44.354004 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275768d2-f22b-462f-bf08-148a6e4e5be9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:44.355397 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-275768d2-f22b-462f-bf08-148a6e4e5be9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:59:44.410478 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275768d2-f22b-462f-bf08-148a6e4e5be9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:44.414076 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a132a36-f4cd-40b5-9626-be9c73818210 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:44.414667 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a132a36-f4cd-40b5-9626-be9c73818210 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:44.414946 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a132a36-f4cd-40b5-9626-be9c73818210 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:44.415213 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a132a36-f4cd-40b5-9626-be9c73818210 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:44.424079 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a132a36-f4cd-40b5-9626-be9c73818210 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:44.425496 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a132a36-f4cd-40b5-9626-be9c73818210 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:44.434639 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1469/2908] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:59:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 03:59:44.972789 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2357f-557b-401f-85dd-b10d30e4d1ac None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:44.974825 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-08b2357f-557b-401f-85dd-b10d30e4d1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:59:44.990635 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2357f-557b-401f-85dd-b10d30e4d1ac None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:44.995726 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a6e6c-4be8-4912-bbab-b7818055eb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:45.003444 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a6e6c-4be8-4912-bbab-b7818055eb1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:45.003732 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a6e6c-4be8-4912-bbab-b7818055eb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:45.004009 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a6e6c-4be8-4912-bbab-b7818055eb1e admin admin] PATH_INFO: `/v3/projects/1e65b8a54d7d42788de37537f92c1999` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:45.005199 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a6e6c-4be8-4912-bbab-b7818055eb1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e65b8a54d7d42788de37537f92c1999)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:45.007493 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a6e6c-4be8-4912-bbab-b7818055eb1e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:45.140055 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ff1a6e6c-4be8-4912-bbab-b7818055eb1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e65b8a54d7d42788de37537f92c1999', 'request_id': 'req-ff1a6e6c-4be8-4912-bbab-b7818055eb1e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:45.240082 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ff1a6e6c-4be8-4912-bbab-b7818055eb1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e65b8a54d7d42788de37537f92c1999', 'request_id': 'req-ff1a6e6c-4be8-4912-bbab-b7818055eb1e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:45.246377 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ff1a6e6c-4be8-4912-bbab-b7818055eb1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e65b8a54d7d42788de37537f92c1999', 'request_id': 'req-ff1a6e6c-4be8-4912-bbab-b7818055eb1e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:45.256782 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ff1a6e6c-4be8-4912-bbab-b7818055eb1e admin admin] The token cache is being invalidate because project 1e65b8a54d7d42788de37537f92c1999 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 03:59:45.263651 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ff1a6e6c-4be8-4912-bbab-b7818055eb1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:45.263651 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ff1a6e6c-4be8-4912-bbab-b7818055eb1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 03:59:45.263651 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1440/2909] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 03:59:44 2022] DELETE /identity/v3/projects/1e65b8a54d7d42788de37537f92c1999 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:59:45.265829 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406dccd-64bf-46b8-b9dd-247e4753938d None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:45.266333 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406dccd-64bf-46b8-b9dd-247e4753938d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:45.266444 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406dccd-64bf-46b8-b9dd-247e4753938d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:45.287243 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2406dccd-64bf-46b8-b9dd-247e4753938d None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:59:45.294059 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2406dccd-64bf-46b8-b9dd-247e4753938d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:59:45.305085 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:59:45.345863 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1470/2910] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:59:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:59:45.354064 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494e3ee-17d6-4015-acfe-f6355e4cd939 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:45.354570 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494e3ee-17d6-4015-acfe-f6355e4cd939 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:45.354688 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494e3ee-17d6-4015-acfe-f6355e4cd939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:45.374994 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-7494e3ee-17d6-4015-acfe-f6355e4cd939 None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:59:45.376206 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7494e3ee-17d6-4015-acfe-f6355e4cd939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:59:45.384927 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1441/2911] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:59:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:59:45.389116 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406dccd-64bf-46b8-b9dd-247e4753938d None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:45.398716 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406dccd-64bf-46b8-b9dd-247e4753938d None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:45.403231 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58068454-e942-4217-a68c-7985ff007dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:45.403827 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58068454-e942-4217-a68c-7985ff007dcf admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:45.404102 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58068454-e942-4217-a68c-7985ff007dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:45.404374 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58068454-e942-4217-a68c-7985ff007dcf admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:45.405011 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58068454-e942-4217-a68c-7985ff007dcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 03:59:45.405307 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58068454-e942-4217-a68c-7985ff007dcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:45.407032 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58068454-e942-4217-a68c-7985ff007dcf admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:45.418099 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1471/2912] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 03:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 03:59:45.422565 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494e3ee-17d6-4015-acfe-f6355e4cd939 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:45.432461 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494e3ee-17d6-4015-acfe-f6355e4cd939 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:45.437144 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be187e-9f4f-4a92-b4b8-c29774a96b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:45.437770 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be187e-9f4f-4a92-b4b8-c29774a96b6b admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:45.438053 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be187e-9f4f-4a92-b4b8-c29774a96b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:45.438385 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be187e-9f4f-4a92-b4b8-c29774a96b6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:45.439029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be187e-9f4f-4a92-b4b8-c29774a96b6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:45.440948 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be187e-9f4f-4a92-b4b8-c29774a96b6b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:45.532230 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1442/2913] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:59:45 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:59:45.536042 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58068454-e942-4217-a68c-7985ff007dcf admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:45.546237 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58068454-e942-4217-a68c-7985ff007dcf admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:45.601623 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915cc98-e1bc-48df-a551-7f674d0d78b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:45.602251 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915cc98-e1bc-48df-a551-7f674d0d78b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:45.602532 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915cc98-e1bc-48df-a551-7f674d0d78b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:45.602804 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915cc98-e1bc-48df-a551-7f674d0d78b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:45.603432 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7915cc98-e1bc-48df-a551-7f674d0d78b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:45.605337 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7915cc98-e1bc-48df-a551-7f674d0d78b9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:45.683252 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1472/2914] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:59:45 2022] POST /identity/v3/users => generated 286 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:59:45.687481 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be187e-9f4f-4a92-b4b8-c29774a96b6b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:45.698871 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be187e-9f4f-4a92-b4b8-c29774a96b6b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:45.703509 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57983549-0ae1-4049-949c-c5d0fcb9e191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:45.704114 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57983549-0ae1-4049-949c-c5d0fcb9e191 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:45.705912 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57983549-0ae1-4049-949c-c5d0fcb9e191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:45.705912 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57983549-0ae1-4049-949c-c5d0fcb9e191 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:45.705912 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57983549-0ae1-4049-949c-c5d0fcb9e191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:45.707540 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57983549-0ae1-4049-949c-c5d0fcb9e191 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:45.717491 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1443/2915] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 03:59:45.721850 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915cc98-e1bc-48df-a551-7f674d0d78b9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:45.734114 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915cc98-e1bc-48df-a551-7f674d0d78b9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:45.738670 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0cf384-3aea-457b-b5fb-6fc07c648327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:45.739264 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0cf384-3aea-457b-b5fb-6fc07c648327 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:45.739542 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0cf384-3aea-457b-b5fb-6fc07c648327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:45.739814 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0cf384-3aea-457b-b5fb-6fc07c648327 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:45.740438 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0cf384-3aea-457b-b5fb-6fc07c648327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:45.742057 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0cf384-3aea-457b-b5fb-6fc07c648327 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:45.752804 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1473/2916] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:59:45.756845 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57983549-0ae1-4049-949c-c5d0fcb9e191 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:45.766863 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57983549-0ae1-4049-949c-c5d0fcb9e191 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:45.771465 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fee3bd-79e8-4714-8e0f-0a814fb28de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:45.772111 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fee3bd-79e8-4714-8e0f-0a814fb28de2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:45.772392 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fee3bd-79e8-4714-8e0f-0a814fb28de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:45.772666 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fee3bd-79e8-4714-8e0f-0a814fb28de2 admin admin] PATH_INFO: `/v3/projects/744002d536444ff8a0ea5d3bc4ecb8e1/users/8d0093a4e3b8438abbfbcd04ec21d951/roles/7591562cf9564b288c108609d8e334b3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:45.786989 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fee3bd-79e8-4714-8e0f-0a814fb28de2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=744002d536444ff8a0ea5d3bc4ecb8e1, user_id=8d0093a4e3b8438abbfbcd04ec21d951, role_id=7591562cf9564b288c108609d8e334b3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:45.790110 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fee3bd-79e8-4714-8e0f-0a814fb28de2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:45.874855 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1444/2917] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:59:45 2022] PUT /identity/v3/projects/744002d536444ff8a0ea5d3bc4ecb8e1/users/8d0093a4e3b8438abbfbcd04ec21d951/roles/7591562cf9564b288c108609d8e334b3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:59:45.879996 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49adc5-7e6c-49bf-bd1d-c598210c6bfc None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:45.880280 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49adc5-7e6c-49bf-bd1d-c598210c6bfc None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:45.880579 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49adc5-7e6c-49bf-bd1d-c598210c6bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:45.899389 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ef49adc5-7e6c-49bf-bd1d-c598210c6bfc None None] MFA Rules not processed for user `a6d47188867a4d9384390f05eba70a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:59:45.900575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ef49adc5-7e6c-49bf-bd1d-c598210c6bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:59:45.958684 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1474/2918] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:59:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:59:45.969050 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fee3bd-79e8-4714-8e0f-0a814fb28de2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:45.971170 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-29fee3bd-79e8-4714-8e0f-0a814fb28de2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:59:45.992601 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:59:46.030143 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fee3bd-79e8-4714-8e0f-0a814fb28de2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:46.034148 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c00d96-0b4c-43a7-a734-42d3486fd8e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:46.034754 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c00d96-0b4c-43a7-a734-42d3486fd8e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:46.035366 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c00d96-0b4c-43a7-a734-42d3486fd8e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:46.035640 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c00d96-0b4c-43a7-a734-42d3486fd8e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:46.045691 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c00d96-0b4c-43a7-a734-42d3486fd8e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:46.047117 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c00d96-0b4c-43a7-a734-42d3486fd8e0 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:46.056618 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1445/2919] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:59:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 03:59:51.298005 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520977f7-dc83-4991-821b-fb71086fd872 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:51.298538 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520977f7-dc83-4991-821b-fb71086fd872 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:51.298538 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520977f7-dc83-4991-821b-fb71086fd872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:51.328635 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-520977f7-dc83-4991-821b-fb71086fd872 None None] MFA Rules not processed for user `8d0093a4e3b8438abbfbcd04ec21d951`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:59:51.329993 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-520977f7-dc83-4991-821b-fb71086fd872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:59:51.348183 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:59:51.401559 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1475/2920] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:59:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 03:59:51.406222 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c00d96-0b4c-43a7-a734-42d3486fd8e0 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:51.417708 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c00d96-0b4c-43a7-a734-42d3486fd8e0 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:51.423458 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95859e40-0535-4797-ae02-c1e35c9ee692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:51.424166 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95859e40-0535-4797-ae02-c1e35c9ee692 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:51.424449 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95859e40-0535-4797-ae02-c1e35c9ee692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:51.424726 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95859e40-0535-4797-ae02-c1e35c9ee692 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:51.425362 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95859e40-0535-4797-ae02-c1e35c9ee692 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:51.427591 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95859e40-0535-4797-ae02-c1e35c9ee692 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:51.520754 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1446/2921] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 03:59:51 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:59:51.525318 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520977f7-dc83-4991-821b-fb71086fd872 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:51.535965 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520977f7-dc83-4991-821b-fb71086fd872 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:51.591654 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1c844-057e-4f69-bc34-6c9d8243cd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:51.592271 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1c844-057e-4f69-bc34-6c9d8243cd2b admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:51.592554 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1c844-057e-4f69-bc34-6c9d8243cd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:51.592833 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1c844-057e-4f69-bc34-6c9d8243cd2b admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:51.593488 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1c844-057e-4f69-bc34-6c9d8243cd2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:51.595467 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1c844-057e-4f69-bc34-6c9d8243cd2b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:51.714906 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1476/2922] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 03:59:51 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 03:59:51.721045 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95859e40-0535-4797-ae02-c1e35c9ee692 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:51.729080 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95859e40-0535-4797-ae02-c1e35c9ee692 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:51.733922 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce1bce-1c2f-4261-b1fc-bdb74e1a8260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:51.734520 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce1bce-1c2f-4261-b1fc-bdb74e1a8260 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:51.734798 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce1bce-1c2f-4261-b1fc-bdb74e1a8260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:51.735067 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce1bce-1c2f-4261-b1fc-bdb74e1a8260 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:51.735729 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce1bce-1c2f-4261-b1fc-bdb74e1a8260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:51.737594 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce1bce-1c2f-4261-b1fc-bdb74e1a8260 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:51.748142 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1447/2923] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:59:51.752148 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1c844-057e-4f69-bc34-6c9d8243cd2b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:51.762552 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1c844-057e-4f69-bc34-6c9d8243cd2b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:51.767436 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad8c2b-c112-4fd3-9e69-3bb4c180e99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:51.768076 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad8c2b-c112-4fd3-9e69-3bb4c180e99b admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:51.768357 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad8c2b-c112-4fd3-9e69-3bb4c180e99b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:51.768628 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad8c2b-c112-4fd3-9e69-3bb4c180e99b admin admin] PATH_INFO: `/v3/projects/efd0124e697a47549eaaec1493766795/users/bc14827f1ab74a2f816cb23eb21a5ae6/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:51.783855 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad8c2b-c112-4fd3-9e69-3bb4c180e99b admin admin] RBAC: Authorizing `identity:create_grant(project_id=efd0124e697a47549eaaec1493766795, user_id=bc14827f1ab74a2f816cb23eb21a5ae6, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:51.786512 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad8c2b-c112-4fd3-9e69-3bb4c180e99b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:51.863153 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1477/2924] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:59:51 2022] PUT /identity/v3/projects/efd0124e697a47549eaaec1493766795/users/bc14827f1ab74a2f816cb23eb21a5ae6/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 03:59:51.867208 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce1bce-1c2f-4261-b1fc-bdb74e1a8260 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:51.877521 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce1bce-1c2f-4261-b1fc-bdb74e1a8260 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:51.934843 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92459529-a2cd-4113-be2d-4ee49729103c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:51.935452 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92459529-a2cd-4113-be2d-4ee49729103c admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:51.935731 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92459529-a2cd-4113-be2d-4ee49729103c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:51.936003 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92459529-a2cd-4113-be2d-4ee49729103c admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:51.936643 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92459529-a2cd-4113-be2d-4ee49729103c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:51.938259 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92459529-a2cd-4113-be2d-4ee49729103c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:51.948570 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1448/2925] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 03:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 03:59:51.952323 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad8c2b-c112-4fd3-9e69-3bb4c180e99b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:51.965210 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad8c2b-c112-4fd3-9e69-3bb4c180e99b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:51.970732 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95dbd5a-d5e1-4a15-876d-17ee864c3916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:51.971401 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95dbd5a-d5e1-4a15-876d-17ee864c3916 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:51.971677 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95dbd5a-d5e1-4a15-876d-17ee864c3916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:51.971953 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95dbd5a-d5e1-4a15-876d-17ee864c3916 admin admin] PATH_INFO: `/v3/projects/efd0124e697a47549eaaec1493766795/users/bc14827f1ab74a2f816cb23eb21a5ae6/roles/4ffac54101e248479bcdc0e54890020f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:51.973975 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95dbd5a-d5e1-4a15-876d-17ee864c3916 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efd0124e697a47549eaaec1493766795, user_id=bc14827f1ab74a2f816cb23eb21a5ae6, role_id=4ffac54101e248479bcdc0e54890020f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:51.976641 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95dbd5a-d5e1-4a15-876d-17ee864c3916 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:51.987951 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1478/2926] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 03:59:51 2022] PUT /identity/v3/projects/efd0124e697a47549eaaec1493766795/users/bc14827f1ab74a2f816cb23eb21a5ae6/roles/4ffac54101e248479bcdc0e54890020f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 03:59:57.235377 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe07f6d-fc31-435b-b39e-a0fdf02ca053 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:57.235943 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe07f6d-fc31-435b-b39e-a0fdf02ca053 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:57.235943 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe07f6d-fc31-435b-b39e-a0fdf02ca053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:57.266310 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-dfe07f6d-fc31-435b-b39e-a0fdf02ca053 None None] MFA Rules not processed for user `bc14827f1ab74a2f816cb23eb21a5ae6`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 03:59:57.267537 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dfe07f6d-fc31-435b-b39e-a0fdf02ca053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:59:57.342196 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1449/2927] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 03:59:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 03:59:57.357867 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95dbd5a-d5e1-4a15-876d-17ee864c3916 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 03:59:57.359748 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a95dbd5a-d5e1-4a15-876d-17ee864c3916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 03:59:57.436992 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95dbd5a-d5e1-4a15-876d-17ee864c3916 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 03:59:57.442769 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087fb67-ab35-4bda-a5d8-4ec6309d1e11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 03:59:57.443418 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087fb67-ab35-4bda-a5d8-4ec6309d1e11 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 03:59:57.443713 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087fb67-ab35-4bda-a5d8-4ec6309d1e11 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 03:59:57.443986 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087fb67-ab35-4bda-a5d8-4ec6309d1e11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 03:59:57.450041 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 03:59:57.502930 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b087fb67-ab35-4bda-a5d8-4ec6309d1e11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 03:59:57.504605 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b087fb67-ab35-4bda-a5d8-4ec6309d1e11 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 03:59:57.516230 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1479/2928] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 03:59:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 04:00:00.116720 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030f115-abd0-4e12-a922-769e325b3887 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 04:00:00.117716 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030f115-abd0-4e12-a922-769e325b3887 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 04:00:00.117958 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030f115-abd0-4e12-a922-769e325b3887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 04:00:00.145707 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a030f115-abd0-4e12-a922-769e325b3887 None None] MFA Rules not processed for user `8d0093a4e3b8438abbfbcd04ec21d951`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 04:00:00.146945 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a030f115-abd0-4e12-a922-769e325b3887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 04:00:00.154267 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1450/2929] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 04:00:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 04:00:07.519453 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=24 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 04:00:10.139447 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 04:00:14.051318 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087fb67-ab35-4bda-a5d8-4ec6309d1e11 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 04:00:14.052745 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b087fb67-ab35-4bda-a5d8-4ec6309d1e11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 04:00:14.107645 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087fb67-ab35-4bda-a5d8-4ec6309d1e11 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 04:00:14.111847 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f7c55-e851-48e2-a9a4-4121a932b012 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 04:00:14.112453 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f7c55-e851-48e2-a9a4-4121a932b012 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 04:00:14.112733 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f7c55-e851-48e2-a9a4-4121a932b012 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 04:00:14.113010 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f7c55-e851-48e2-a9a4-4121a932b012 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 04:00:14.114784 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-581f7c55-e851-48e2-a9a4-4121a932b012 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 04:00:14.124260 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f7c55-e851-48e2-a9a4-4121a932b012 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 04:00:14.125730 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f7c55-e851-48e2-a9a4-4121a932b012 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 04:00:14.133819 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1480/2930] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 04:00:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 04:00:14.999859 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030f115-abd0-4e12-a922-769e325b3887 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 04:00:15.001917 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a030f115-abd0-4e12-a922-769e325b3887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 04:00:15.073904 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030f115-abd0-4e12-a922-769e325b3887 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 04:00:15.079428 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1925a-cb77-46cc-9f5a-5031f801a906 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c39fd09bea1a40babc5f629612c6702b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 04:00:15.080039 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1925a-cb77-46cc-9f5a-5031f801a906 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 04:00:15.080316 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1925a-cb77-46cc-9f5a-5031f801a906 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 04:00:15.080587 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1925a-cb77-46cc-9f5a-5031f801a906 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 04:00:15.082310 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3ea1925a-cb77-46cc-9f5a-5031f801a906 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 04:00:15.093446 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea1925a-cb77-46cc-9f5a-5031f801a906 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 04:00:15.095042 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea1925a-cb77-46cc-9f5a-5031f801a906 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 04:00:15.104763 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1451/2931] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 04:00:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 04:00:18.092479 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f7c55-e851-48e2-a9a4-4121a932b012 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 04:00:18.101809 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f7c55-e851-48e2-a9a4-4121a932b012 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 04:00:18.105810 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b712b-93d7-41e7-b715-d0e4be84db59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 04:00:18.106474 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b712b-93d7-41e7-b715-d0e4be84db59 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 04:00:18.106756 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b712b-93d7-41e7-b715-d0e4be84db59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 04:00:18.107030 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b712b-93d7-41e7-b715-d0e4be84db59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 04:00:18.108738 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-530b712b-93d7-41e7-b715-d0e4be84db59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 04:00:18.118531 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b712b-93d7-41e7-b715-d0e4be84db59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 04:00:18.119941 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b712b-93d7-41e7-b715-d0e4be84db59 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 04:00:18.128545 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1481/2932] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 04:00:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 04:00:24.364274 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1925a-cb77-46cc-9f5a-5031f801a906 service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 04:00:24.365845 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3ea1925a-cb77-46cc-9f5a-5031f801a906 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 04:00:24.381378 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1925a-cb77-46cc-9f5a-5031f801a906 service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 04:00:24.386810 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6495a9-232d-495b-9a24-0de31b57a6b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 04:00:24.387405 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6495a9-232d-495b-9a24-0de31b57a6b6 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 04:00:24.387681 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6495a9-232d-495b-9a24-0de31b57a6b6 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 04:00:24.387953 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6495a9-232d-495b-9a24-0de31b57a6b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 04:00:24.389595 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dc6495a9-232d-495b-9a24-0de31b57a6b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 04:00:24.401509 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6495a9-232d-495b-9a24-0de31b57a6b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 04:00:24.403107 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6495a9-232d-495b-9a24-0de31b57a6b6 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 04:00:24.413783 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1452/2933] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 04:00:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 04:00:27.208963 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b712b-93d7-41e7-b715-d0e4be84db59 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 04:00:27.217562 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b712b-93d7-41e7-b715-d0e4be84db59 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 04:00:27.221824 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31d001-110e-44fc-850c-d4a9fc6e270f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 04:00:27.222428 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31d001-110e-44fc-850c-d4a9fc6e270f service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 04:00:27.222710 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31d001-110e-44fc-850c-d4a9fc6e270f service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 04:00:27.222983 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31d001-110e-44fc-850c-d4a9fc6e270f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 04:00:27.231877 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31d001-110e-44fc-850c-d4a9fc6e270f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 04:00:27.233308 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31d001-110e-44fc-850c-d4a9fc6e270f service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 04:00:27.242697 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1482/2934] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 04:00:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 04:00:34.409314 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=38 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 04:00:37.238529 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=38 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 04:01:37.264202 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6495a9-232d-495b-9a24-0de31b57a6b6 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 04:01:37.265586 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dc6495a9-232d-495b-9a24-0de31b57a6b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 04:01:37.280899 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6495a9-232d-495b-9a24-0de31b57a6b6 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 04:01:37.285876 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16986ac3-eab2-4100-ab89-60de90b3a73e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c39fd09bea1a40babc5f629612c6702b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 04:01:37.286471 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16986ac3-eab2-4100-ab89-60de90b3a73e service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 04:01:37.286749 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16986ac3-eab2-4100-ab89-60de90b3a73e service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 04:01:37.287016 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16986ac3-eab2-4100-ab89-60de90b3a73e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 04:01:37.288722 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-16986ac3-eab2-4100-ab89-60de90b3a73e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 04:01:37.301218 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16986ac3-eab2-4100-ab89-60de90b3a73e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 04:01:37.302824 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16986ac3-eab2-4100-ab89-60de90b3a73e service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 04:01:37.312718 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1453/2935] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 04:01:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 04:01:47.308376 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 04:02:36.983626 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31d001-110e-44fc-850c-d4a9fc6e270f service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 04:02:36.992528 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31d001-110e-44fc-850c-d4a9fc6e270f service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 04:02:36.996843 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9edaf-bc42-443c-96bb-d9ff175aa771 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 04:02:37.000143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9edaf-bc42-443c-96bb-d9ff175aa771 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 04:02:37.000143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9edaf-bc42-443c-96bb-d9ff175aa771 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 04:02:37.000143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9edaf-bc42-443c-96bb-d9ff175aa771 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 04:02:37.000143 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-46e9edaf-bc42-443c-96bb-d9ff175aa771 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 04:02:37.009502 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e9edaf-bc42-443c-96bb-d9ff175aa771 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 04:02:37.011155 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e9edaf-bc42-443c-96bb-d9ff175aa771 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 04:02:37.020103 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1483/2936] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 04:02:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 04:02:38.109093 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16986ac3-eab2-4100-ab89-60de90b3a73e service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 04:02:38.119404 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16986ac3-eab2-4100-ab89-60de90b3a73e service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 04:02:38.123679 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842cfc0-14c5-4320-b03e-50a6435daa99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 04:02:38.124300 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842cfc0-14c5-4320-b03e-50a6435daa99 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 04:02:38.124631 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842cfc0-14c5-4320-b03e-50a6435daa99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 04:02:38.124910 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842cfc0-14c5-4320-b03e-50a6435daa99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 04:02:38.126806 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d842cfc0-14c5-4320-b03e-50a6435daa99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 04:02:38.141042 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d842cfc0-14c5-4320-b03e-50a6435daa99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 04:02:38.142510 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d842cfc0-14c5-4320-b03e-50a6435daa99 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 04:02:38.154197 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1454/2937] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 04:02:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 04:02:47.015869 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=6 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 04:02:48.148694 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 04:04:02.218089 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9edaf-bc42-443c-96bb-d9ff175aa771 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 04:04:02.238945 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9edaf-bc42-443c-96bb-d9ff175aa771 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 04:04:02.254905 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02f7e1-1a12-4ee5-8ca1-204af27711dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c09d1a4ac8b64921a6b05fcd567bb770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 04:04:02.254905 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02f7e1-1a12-4ee5-8ca1-204af27711dd service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 04:04:02.254905 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02f7e1-1a12-4ee5-8ca1-204af27711dd service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 04:04:02.254905 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02f7e1-1a12-4ee5-8ca1-204af27711dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 04:04:02.255504 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2a02f7e1-1a12-4ee5-8ca1-204af27711dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 04:04:02.263225 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02f7e1-1a12-4ee5-8ca1-204af27711dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 04:04:02.265314 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02f7e1-1a12-4ee5-8ca1-204af27711dd service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 04:04:02.278132 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1484/2938] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 04:04:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 04:04:03.584221 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842cfc0-14c5-4320-b03e-50a6435daa99 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 04:04:03.593542 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842cfc0-14c5-4320-b03e-50a6435daa99 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 04:04:03.597286 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848dfe69-0b0f-4546-b36e-e3fd83a9c13d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 04:04:03.597910 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848dfe69-0b0f-4546-b36e-e3fd83a9c13d service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 04:04:03.598188 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848dfe69-0b0f-4546-b36e-e3fd83a9c13d service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 04:04:03.598462 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848dfe69-0b0f-4546-b36e-e3fd83a9c13d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 04:04:03.600150 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-848dfe69-0b0f-4546-b36e-e3fd83a9c13d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 04:04:03.613622 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848dfe69-0b0f-4546-b36e-e3fd83a9c13d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 04:04:03.615056 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848dfe69-0b0f-4546-b36e-e3fd83a9c13d service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 04:04:03.626616 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1455/2939] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 04:04:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 04:04:04.811894 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02f7e1-1a12-4ee5-8ca1-204af27711dd service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 04:04:04.821104 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02f7e1-1a12-4ee5-8ca1-204af27711dd service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 04:04:04.824699 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303a17c-6e5b-42d3-8749-dc67eb1f9db5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae04099495a24a04801563cf18dc5626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 04:04:04.825289 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303a17c-6e5b-42d3-8749-dc67eb1f9db5 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 04:04:04.825571 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303a17c-6e5b-42d3-8749-dc67eb1f9db5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 04:04:04.825875 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303a17c-6e5b-42d3-8749-dc67eb1f9db5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 04:04:04.827575 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4303a17c-6e5b-42d3-8749-dc67eb1f9db5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 04:04:04.840559 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303a17c-6e5b-42d3-8749-dc67eb1f9db5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 04:04:04.842020 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303a17c-6e5b-42d3-8749-dc67eb1f9db5 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 04:04:04.853255 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1485/2940] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 04:04:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 04:04:10.837365 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848dfe69-0b0f-4546-b36e-e3fd83a9c13d service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 04:04:10.848823 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848dfe69-0b0f-4546-b36e-e3fd83a9c13d service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 04:04:10.854451 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0971fa0-2b40-4691-b28c-e23854cb3dae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c39fd09bea1a40babc5f629612c6702b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 04:04:10.855051 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0971fa0-2b40-4691-b28c-e23854cb3dae service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 04:04:10.855331 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0971fa0-2b40-4691-b28c-e23854cb3dae service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 04:04:10.855609 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0971fa0-2b40-4691-b28c-e23854cb3dae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 04:04:10.857539 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f0971fa0-2b40-4691-b28c-e23854cb3dae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 04:04:10.870508 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0971fa0-2b40-4691-b28c-e23854cb3dae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 04:04:10.872098 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0971fa0-2b40-4691-b28c-e23854cb3dae service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 04:04:10.882437 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1456/2941] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 04:04:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 04:04:14.302154 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303a17c-6e5b-42d3-8749-dc67eb1f9db5 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 04:04:14.373681 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303a17c-6e5b-42d3-8749-dc67eb1f9db5 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 04:04:14.378204 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba5586-b5b4-493d-83b2-388bda42e1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 04:04:14.381668 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba5586-b5b4-493d-83b2-388bda42e1d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 04:04:14.381668 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba5586-b5b4-493d-83b2-388bda42e1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 04:04:14.381668 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba5586-b5b4-493d-83b2-388bda42e1d0 admin admin] PATH_INFO: `/v3/users/8d0093a4e3b8438abbfbcd04ec21d951` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 04:04:14.381668 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba5586-b5b4-493d-83b2-388bda42e1d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d0093a4e3b8438abbfbcd04ec21d951)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 04:04:14.382502 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba5586-b5b4-493d-83b2-388bda42e1d0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 04:04:14.581085 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-28ba5586-b5b4-493d-83b2-388bda42e1d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d0093a4e3b8438abbfbcd04ec21d951'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 04:04:14.581849 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-28ba5586-b5b4-493d-83b2-388bda42e1d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d0093a4e3b8438abbfbcd04ec21d951'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 04:04:14.589520 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-28ba5586-b5b4-493d-83b2-388bda42e1d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d0093a4e3b8438abbfbcd04ec21d951'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 04:04:14.601310 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-28ba5586-b5b4-493d-83b2-388bda42e1d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d0093a4e3b8438abbfbcd04ec21d951'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 04:04:14.601945 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-28ba5586-b5b4-493d-83b2-388bda42e1d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d0093a4e3b8438abbfbcd04ec21d951'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 04:04:14.699361 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1486/2942] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 04:04:14 2022] DELETE /identity/v3/users/8d0093a4e3b8438abbfbcd04ec21d951 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 04:04:14.940561 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0971fa0-2b40-4691-b28c-e23854cb3dae service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 04:04:14.951629 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0971fa0-2b40-4691-b28c-e23854cb3dae service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 04:04:15.008315 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15817d7-9dff-4c57-a107-a268e1cc2d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 04:04:15.008945 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15817d7-9dff-4c57-a107-a268e1cc2d8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 04:04:15.009229 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15817d7-9dff-4c57-a107-a268e1cc2d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 04:04:15.009508 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15817d7-9dff-4c57-a107-a268e1cc2d8a admin admin] PATH_INFO: `/v3/projects/744002d536444ff8a0ea5d3bc4ecb8e1` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 04:04:15.010653 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15817d7-9dff-4c57-a107-a268e1cc2d8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=744002d536444ff8a0ea5d3bc4ecb8e1)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 04:04:15.012550 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15817d7-9dff-4c57-a107-a268e1cc2d8a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 04:04:15.104196 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a15817d7-9dff-4c57-a107-a268e1cc2d8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '744002d536444ff8a0ea5d3bc4ecb8e1', 'request_id': 'req-a15817d7-9dff-4c57-a107-a268e1cc2d8a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 04:04:15.173325 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a15817d7-9dff-4c57-a107-a268e1cc2d8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '744002d536444ff8a0ea5d3bc4ecb8e1', 'request_id': 'req-a15817d7-9dff-4c57-a107-a268e1cc2d8a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 04:04:15.180486 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a15817d7-9dff-4c57-a107-a268e1cc2d8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '744002d536444ff8a0ea5d3bc4ecb8e1', 'request_id': 'req-a15817d7-9dff-4c57-a107-a268e1cc2d8a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 04:04:15.190742 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a15817d7-9dff-4c57-a107-a268e1cc2d8a admin admin] The token cache is being invalidate because project 744002d536444ff8a0ea5d3bc4ecb8e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 04:04:15.191029 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a15817d7-9dff-4c57-a107-a268e1cc2d8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 04:04:15.191646 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a15817d7-9dff-4c57-a107-a268e1cc2d8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 04:04:15.193192 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1457/2943] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 04:04:14 2022] DELETE /identity/v3/projects/744002d536444ff8a0ea5d3bc4ecb8e1 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 04:04:15.197931 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba5586-b5b4-493d-83b2-388bda42e1d0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 04:04:15.199365 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-28ba5586-b5b4-493d-83b2-388bda42e1d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 04:04:15.212138 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba5586-b5b4-493d-83b2-388bda42e1d0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 04:04:15.259135 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 04:04:15.267703 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11970d95-0538-41df-bede-e9dec8e38124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 04:04:15.270922 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11970d95-0538-41df-bede-e9dec8e38124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 04:04:15.270922 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11970d95-0538-41df-bede-e9dec8e38124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 04:04:15.270922 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11970d95-0538-41df-bede-e9dec8e38124 admin admin] PATH_INFO: `/v3/users/bc14827f1ab74a2f816cb23eb21a5ae6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 04:04:15.270922 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11970d95-0538-41df-bede-e9dec8e38124 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc14827f1ab74a2f816cb23eb21a5ae6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 04:04:15.271946 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11970d95-0538-41df-bede-e9dec8e38124 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 04:04:15.438054 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-11970d95-0538-41df-bede-e9dec8e38124 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc14827f1ab74a2f816cb23eb21a5ae6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 04:04:15.438702 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-11970d95-0538-41df-bede-e9dec8e38124 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc14827f1ab74a2f816cb23eb21a5ae6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 04:04:15.445556 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-11970d95-0538-41df-bede-e9dec8e38124 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc14827f1ab74a2f816cb23eb21a5ae6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 04:04:15.457979 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-11970d95-0538-41df-bede-e9dec8e38124 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc14827f1ab74a2f816cb23eb21a5ae6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 04:04:15.458616 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-11970d95-0538-41df-bede-e9dec8e38124 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc14827f1ab74a2f816cb23eb21a5ae6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 04:04:15.544582 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1487/2944] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 04:04:15 2022] DELETE /identity/v3/users/bc14827f1ab74a2f816cb23eb21a5ae6 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 04:04:15.786268 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15817d7-9dff-4c57-a107-a268e1cc2d8a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 04:04:15.787710 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a15817d7-9dff-4c57-a107-a268e1cc2d8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 04:04:15.801304 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15817d7-9dff-4c57-a107-a268e1cc2d8a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 04:04:15.859668 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab6eca-743c-47cf-8abb-98eb92e8208d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6d47188867a4d9384390f05eba70a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c378d507cbc42e4b80e3f5c14a93477', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 04:04:15.860300 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab6eca-743c-47cf-8abb-98eb92e8208d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 04:04:15.860585 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab6eca-743c-47cf-8abb-98eb92e8208d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 04:04:15.860884 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab6eca-743c-47cf-8abb-98eb92e8208d admin admin] PATH_INFO: `/v3/projects/efd0124e697a47549eaaec1493766795` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 04:04:15.862044 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab6eca-743c-47cf-8abb-98eb92e8208d admin admin] RBAC: Authorizing `identity:delete_project(project_id=efd0124e697a47549eaaec1493766795)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 04:04:15.863972 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab6eca-743c-47cf-8abb-98eb92e8208d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 04:04:15.870760 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 04:04:15.967626 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d8ab6eca-743c-47cf-8abb-98eb92e8208d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efd0124e697a47549eaaec1493766795', 'request_id': 'req-d8ab6eca-743c-47cf-8abb-98eb92e8208d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 04:04:16.047950 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d8ab6eca-743c-47cf-8abb-98eb92e8208d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efd0124e697a47549eaaec1493766795', 'request_id': 'req-d8ab6eca-743c-47cf-8abb-98eb92e8208d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 04:04:16.055172 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d8ab6eca-743c-47cf-8abb-98eb92e8208d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efd0124e697a47549eaaec1493766795', 'request_id': 'req-d8ab6eca-743c-47cf-8abb-98eb92e8208d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 04:04:16.065699 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d8ab6eca-743c-47cf-8abb-98eb92e8208d admin admin] The token cache is being invalidate because project efd0124e697a47549eaaec1493766795 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 04:04:16.065993 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d8ab6eca-743c-47cf-8abb-98eb92e8208d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 04:04:16.066637 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d8ab6eca-743c-47cf-8abb-98eb92e8208d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 04:04:16.068138 dv-cinder-857993-1-smb devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1458/2945] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 04:04:15 2022] DELETE /identity/v3/projects/efd0124e697a47549eaaec1493766795 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 04:04:25.540991 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 04:04:26.207974 dv-cinder-857993-1-smb devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 04:06:43.233450 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11970d95-0538-41df-bede-e9dec8e38124 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 04:06:43.235140 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-11970d95-0538-41df-bede-e9dec8e38124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 04:06:43.371328 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11970d95-0538-41df-bede-e9dec8e38124 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 04:06:43.428320 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec11b9-6b56-4b1f-87ea-c1050cf0551f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c39fd09bea1a40babc5f629612c6702b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0e46c2a2c62402dbf6d8461204b47d2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 04:06:43.428927 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec11b9-6b56-4b1f-87ea-c1050cf0551f service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 04:06:43.429204 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec11b9-6b56-4b1f-87ea-c1050cf0551f service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 04:06:43.429475 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec11b9-6b56-4b1f-87ea-c1050cf0551f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 04:06:43.431290 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5bec11b9-6b56-4b1f-87ea-c1050cf0551f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 04:06:43.442345 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bec11b9-6b56-4b1f-87ea-c1050cf0551f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 04:06:43.443929 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bec11b9-6b56-4b1f-87ea-c1050cf0551f service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 04:06:43.453773 dv-cinder-857993-1-smb devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1488/2946] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 04:06:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 04:06:53.449434 dv-cinder-857993-1-smb devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}